-- Logs begin at Mon 2022-05-23 16:22:22 UTC, end at Mon 2022-05-23 17:27:29 UTC. -- May 23 16:53:55.149835 dv-cinder-842998-1-smb systemd[1]: Starting Devstack devstack@keystone.service... May 23 16:53:55.157002 dv-cinder-842998-1-smb devstack@keystone.service[80398]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 16:53:55 2022] *** May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: nodename: dv-cinder-842998-1-smb May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: machine: x86_64 May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: clock source: unix May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: pcre jit disabled May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: detected number of CPU cores: 4 May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: current working directory: / May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: detected binary path: /usr/bin/uwsgi-core May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: your processes number limit is 47680 May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: your memory page size is 4096 bytes May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: detected max file descriptor number: 2048 May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: lock engine: pthread robust mutexes May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: thunder lock: enabled May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 23 16:53:55.162468 dv-cinder-842998-1-smb devstack@keystone.service[80398]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 16:53:55.206948 dv-cinder-842998-1-smb devstack@keystone.service[80398]: Python main interpreter initialized at 0x561780dfa9c0 May 23 16:53:55.206948 dv-cinder-842998-1-smb devstack@keystone.service[80398]: python threads support enabled May 23 16:53:55.206948 dv-cinder-842998-1-smb devstack@keystone.service[80398]: your server socket listen backlog is limited to 100 connections May 23 16:53:55.206948 dv-cinder-842998-1-smb devstack@keystone.service[80398]: your mercy for graceful operations on workers is 90 seconds May 23 16:53:55.207342 dv-cinder-842998-1-smb devstack@keystone.service[80398]: mapped 403077 bytes (393 KB) for 2 cores May 23 16:53:55.207415 dv-cinder-842998-1-smb devstack@keystone.service[80398]: *** Operational MODE: preforking *** May 23 16:53:55.207675 dv-cinder-842998-1-smb devstack@keystone.service[80398]: *** uWSGI is running in multiple interpreter mode *** May 23 16:53:55.207675 dv-cinder-842998-1-smb devstack@keystone.service[80398]: spawned uWSGI master process (pid: 80398) May 23 16:53:55.207886 dv-cinder-842998-1-smb systemd[1]: Started Devstack devstack@keystone.service. May 23 16:53:55.209410 dv-cinder-842998-1-smb devstack@keystone.service[80398]: spawned uWSGI worker 1 (pid: 80412, cores: 1) May 23 16:53:55.209410 dv-cinder-842998-1-smb devstack@keystone.service[80398]: spawned uWSGI worker 2 (pid: 80413, cores: 1) May 23 16:53:55.209410 dv-cinder-842998-1-smb devstack@keystone.service[80398]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 16:54:00.841808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:54:00.841808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: from cryptography.utils import int_from_bytes May 23 16:54:00.842557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:54:00.842557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: from cryptography.utils import int_from_bytes May 23 16:54:00.891737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 16:54:00.891925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 16:54:00.892117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] command line args: [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 16:54:00.892385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 16:54:00.892563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ================================================================================ {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 16:54:00.892815 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] admin_token = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.893060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] config_dir = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.893246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.893426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] config_source = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.894116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] debug = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.894237 dv-cinder-842998-1-smb devstack@keystone.service[80412]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:54:00.894237 dv-cinder-842998-1-smb devstack@keystone.service[80412]: from cryptography.utils import int_from_bytes May 23 16:54:00.894745 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.894986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:54:00.894986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: from cryptography.utils import int_from_bytes May 23 16:54:00.895091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.895091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.895267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.895609 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.895738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.895894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_config_append = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.896075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.896273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_dir = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.896428 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_file = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.896665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.896914 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.897161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.897407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.897584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.897761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.898007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.898252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.898516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.898752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.898985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.899217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.899464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.899709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.899983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.900471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.900654 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] publish_errors = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.900884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.901121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.901299 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.901544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.901778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.902011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] standard_threads = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.902241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.902509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.902686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.902861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] use_journal = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.903036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] use_json = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.903209 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] use_stderr = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.903384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] use_syslog = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.903613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.903868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.904104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.904365 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.904601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.904851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.905088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.905336 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.905573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.905819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.906082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.906316 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.906582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.906830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.907066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.907312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.907560 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.907798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.908053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.908307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.908552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.908788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.909042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.909362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.909615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.909864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.910094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.910324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.910577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.910811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.911062 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.911308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.911535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.911762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.912007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.912254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.912490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.912738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.912967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.913199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.913433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.913662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.913890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.914118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.914345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.914603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.914850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.915080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.915316 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.915544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.915776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.916010 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.916256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.916483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.916718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.916952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.917187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.917421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.917655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.917881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.918127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.918373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.918615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.918845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.919105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.919339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.919568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.919804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.920037 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.920303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.920539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.920785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.921033 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.921267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.921500 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.921734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.921978 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.922214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.922476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.922719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.922955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.923192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.923425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.923658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.923892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.924151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.924389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.924628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.925396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.925632 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.925869 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.926107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.926340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.926589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.926818 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.927045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.927276 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.927503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.927741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.927973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.928218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.928452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.928705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.928964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.929200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.929429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.external = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.929658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.929953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.930182 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.930434 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.password = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.930759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.token = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.930890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.931121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.931370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.931599 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.931845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.932090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.932318 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.932550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.932793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.933038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.933282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.933517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.933759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.933990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.934252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.934528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.934763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.935015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.935298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.935543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.935805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.936043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.936297 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.936530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.936765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.937009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.937253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.937481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.937725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.937959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.938209 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.938467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.938721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.938957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.939201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.939433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.939678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.939923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.940156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.940980 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.941247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.941477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.941713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.941967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.942217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.942471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.942708 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.942825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 16:54:00.942924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 16:54:00.942993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.943094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] command line args: [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 16:54:00.943166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.943375 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 16:54:00.943463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.943552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ================================================================================ {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 16:54:00.943702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.943862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] admin_token = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.943940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.944070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] config_dir = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.944193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.944273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.944405 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] config_source = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.944490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.944570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] debug = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.944693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.944932 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.945019 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.945162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.945245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.945363 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.945445 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.945618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.945702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.945850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.945927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.946084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.946171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.946290 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_config_append = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.946397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.946485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.946589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.946674 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_dir = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.946758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_file = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.946835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.946993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.947147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.947272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.947395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.947489 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.947562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.947680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.947757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.947873 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.947977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.948062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.948205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.948284 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.948445 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.948526 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.948675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.949054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.949178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.949256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.949415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.949495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.949640 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.949709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.949873 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.949951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.950106 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.950182 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.950353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.950469 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.950621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.950850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.950927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.951037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] publish_errors = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.951115 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.951267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.951346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.951495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.951582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.951663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.951774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.951901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.952012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.952132 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.952245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.952361 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] standard_threads = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.952472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.952594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.952712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.952833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.952971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.953050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.953168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] use_journal = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.953246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.953343 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] use_json = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.953423 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.953515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] use_stderr = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.953669 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.953750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] use_syslog = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.953900 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:54:00.953977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.954133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.954210 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.954384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.954466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.954614 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.954709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.954847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.954926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.955091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.955176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.955321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.955409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.955566 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.955644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.955800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.955879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.956065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.956309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.956531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.956756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.956756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.956908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.957010 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.957092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.957247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.957333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.957482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.957570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.957719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.957799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.957953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.958032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.958198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.958286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.958468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.958549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.958706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.958785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.958960 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.959060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.959187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.959267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.959427 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.959506 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.959663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.959751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.959897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.959976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.960132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.960211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.960376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.960462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.960615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.960695 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.960842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.960920 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.961078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.961166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.961317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.961395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.961559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.961667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.961924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.962160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.962265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.962437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.962521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.962690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.962781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.962927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.963008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.963172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.963252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.963409 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.963488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.963635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.963717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.963868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] role.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.963948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.964101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.964178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] role.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.964328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.964409 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.964555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.964633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.964794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.964873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.965023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.965104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.965257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.965336 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.965503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.965589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.965733 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.965812 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.965967 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.966045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.966194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.966280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.966445 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.966527 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.966682 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.966763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.966927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.967014 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.967155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.967234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.967390 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.967469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.967625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.967800 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.967881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.968038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.968117 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.968288 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.968368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.968511 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.968590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.968756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.968834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.968987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.969067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.969218 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.969298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.969446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.969542 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.969701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.969781 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.969937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.970055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.970191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.970318 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.970476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.970601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.970763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.970900 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.971022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.971149 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.971273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.971396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.971532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.971745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.971937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.972113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.972113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.972472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.972472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.972783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.972912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.973042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.973181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.973305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.973440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.973440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.973681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.973816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.973944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.974069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.974202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.974328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.974474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.974602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.974727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.974851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.974987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.975113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.975237 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.975363 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.975497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.975622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.975754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.975886 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.976010 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.976135 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.976266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.976392 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.976525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.976651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.976776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.976900 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.977024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.977148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.977294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.977294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.977529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.connection = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.977662 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.977797 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.977923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.978047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.978181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.978305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.978460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.978582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.978709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.978846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.978978 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.979113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.979239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.979364 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.979488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.979613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.979745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.979871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.979995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.980119 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.980244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.980368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.980500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.980625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.980749 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.external = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.980890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.981015 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.981138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.981270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.981435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.981555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.981682 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.981807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.password = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.981933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.982087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.token = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.982218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.982218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 16:54:00.982428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.982428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.982428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.982428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.982428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.982428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.982428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.982914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.982914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.983048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.983212 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.983446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.983688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.983917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.984177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.984429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.984663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.984912 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.985193 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.985437 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.985696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.985945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.986205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.986460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.986700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.986944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.987190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.988024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.988460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.988705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.988962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.989202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.989458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.989694 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.989941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.990173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.990439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.990688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.990921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.991154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.991399 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.991625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.991859 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.992103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.992352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.992580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.992806 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.993038 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.993279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.993523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.993766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.994016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.994261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.994555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.994794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.995031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.995261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.995496 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.995725 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.995956 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.996194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.996433 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.996836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.997092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.997563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.997833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.998285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.998577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.999046 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.999298 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:00.999755 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.000008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.000461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.000723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.001179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.001440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.001894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.002166 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.002671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.003527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.004228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.004513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.005000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.005263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.005717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.005979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.006431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.006698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.007184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.007456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.007935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.008206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.008673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.008931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.009348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.009593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.010055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.010324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.010805 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.011088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.011368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.011648 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.011954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.012281 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.012544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.012673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.012771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.012988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.013069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.013245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.013488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.013727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.013963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.014209 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.014505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.014745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.014998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.015226 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.015469 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.015705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.015938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.016174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.016418 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.016657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.016885 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.017119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.017356 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.017603 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.017848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.018080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.018328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.018677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.019112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.019368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.019606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.020087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] role.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.020332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] role.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.020561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.020808 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.021054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.021297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.021541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.021746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.021828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.022016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.022259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.022525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.022760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.023006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.023252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.023501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.023743 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.024153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.024387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.024632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.024878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.025124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.025368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.025598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.025848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.026097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.026332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.026588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.026817 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.027044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.027292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.027543 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.027789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.028022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.028254 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.028481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.028712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.028945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.029188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.029420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.029671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.029913 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.030147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.030406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.030648 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.030892 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.031124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.031359 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.031589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.031830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.032072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.032296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.032535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.032867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.033087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.connection = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.033338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.033588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.033823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.034060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.034490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.034908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.035330 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.035761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.036204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.036649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.037107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.037520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.037968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.038436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.038901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.039346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.039619 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.039862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:54:01.040036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 16:54:01.050624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.050835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.067749 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.067977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.068200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.078467 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.097394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.097623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.103739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.136300 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.154998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.155234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.173599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.173832 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.220994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.221230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.221453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.221721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.221941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.222155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.222246 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.222494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.222721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.222941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.223160 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.223377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.245061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.245285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.245402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.245507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.245592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.245728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.245811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.245948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.246032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.246158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.246241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.246385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.246481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.246594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.259025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.259267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.271636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.271865 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.271954 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.272087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.272170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.272308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.272394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.272528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.272613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.272743 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.272823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.272954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.273046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.273164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:54:01.291382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.291542 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 16:54:01.291722 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.291878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.291964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 16:54:01.292081 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 16:54:01.292246 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.292355 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.292439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 16:54:01.292616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.292700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.292875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.292958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.293129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.293220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.293419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.304329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.304607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.304878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.305161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.306442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.306725 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.306991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.307269 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.313264 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.315340 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.317262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.317540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.317820 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.318103 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.318404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.318670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.318936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.319315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.319538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.319621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.319814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.319899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.320091 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.320173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.320369 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.320652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.320910 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.321288 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.321756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.322038 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.322314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.322604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.347662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.349297 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.349690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.354981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.355089 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.355261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.355541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.356764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.357054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.362368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.362871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.362959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.363151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.363231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.367638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.367928 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.368214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.368612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.368895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.369178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.369455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.369731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.370446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.370728 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.375189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.375587 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.375868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.376148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.376425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.376697 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.376962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.377228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.388961 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.389239 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.394482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.397431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.397704 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.398126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.398449 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.402317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.403510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.405911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.406201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.407112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.411009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.411306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.411535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.411710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.412008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.412294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.412580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.415189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.418946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.419243 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.419534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.419811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.420089 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.420370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.436595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.436885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.437156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.437419 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.439604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.439890 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.440155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.440927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.446163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.447899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.448186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.449418 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.451416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.451535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.451698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.451815 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.452095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.452374 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.452651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.454754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.455033 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.455312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.455592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.455868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.467099 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.467382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.467666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.467955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.468237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.468530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.468817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.470202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.470507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.470789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.471075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.471354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.472046 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.472526 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.486703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.490278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.490738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.493601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.493973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.495251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.496870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.497161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.497283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.497445 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.498923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.500523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.500808 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.501096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.505427 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.507063 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.509303 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.510339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.510659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.510923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.511005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.511206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.514126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.514441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.514721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.515033 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.520539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.520822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.521105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.524766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.525053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.525431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.529109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.529390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.529670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.529948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.530228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.530524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.530834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.531107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.531379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.531657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.531926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.532187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.532467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.532731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.533305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:54:01.533582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.533860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.534670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.535071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.535518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.535806 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.536093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.536365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.536644 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.536916 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.537177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.537448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.537718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:54:01.572593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561780dfa9c0 pid: 80413 (default app) May 23 16:54:01.576039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542c463-c452-415b-a086-21fde2ed2ef8 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:01.576335 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542c463-c452-415b-a086-21fde2ed2ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:01.576614 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542c463-c452-415b-a086-21fde2ed2ef8 None None] PATH_INFO: `/v3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:01.577881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561780dfa9c0 pid: 80412 (default app) May 23 16:54:01.580918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Mon May 23 16:54:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:09.557133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315af5b-7731-40a3-b932-4efc7f886312 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:09.557702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315af5b-7731-40a3-b932-4efc7f886312 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:09.557702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315af5b-7731-40a3-b932-4efc7f886312 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:09.562095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:54:09.567797 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56383f94-6fa2-4b8a-90c4-54e638beb98a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:09.568199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56383f94-6fa2-4b8a-90c4-54e638beb98a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:09.568359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56383f94-6fa2-4b8a-90c4-54e638beb98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:09.637763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: INFO dbcounter [None req-56383f94-6fa2-4b8a-90c4-54e638beb98a None None] Registered counter for database keystone May 23 16:54:09.659639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG oslo_db.sqlalchemy.engines [None req-56383f94-6fa2-4b8a-90c4-54e638beb98a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:54:09.665777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writer thread running {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:54:09.840749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG passlib.handlers.bcrypt [None req-56383f94-6fa2-4b8a-90c4-54e638beb98a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80413) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 16:54:09.841103 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG passlib.handlers.bcrypt [None req-56383f94-6fa2-4b8a-90c4-54e638beb98a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80413) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 16:54:09.896680 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-56383f94-6fa2-4b8a-90c4-54e638beb98a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:09.898273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-56383f94-6fa2-4b8a-90c4-54e638beb98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:10.022602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 23 16:54:10.225153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315af5b-7731-40a3-b932-4efc7f886312 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:10.295497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: INFO dbcounter [None req-9315af5b-7731-40a3-b932-4efc7f886312 None None] Registered counter for database keystone May 23 16:54:10.315631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG oslo_db.sqlalchemy.engines [None req-9315af5b-7731-40a3-b932-4efc7f886312 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:54:10.321946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writer thread running {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:54:10.443702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315af5b-7731-40a3-b932-4efc7f886312 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:10.447891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb55a21-4893-4f71-9887-694a0ef14d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:10.448556 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb55a21-4893-4f71-9887-694a0ef14d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:10.449092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb55a21-4893-4f71-9887-694a0ef14d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:10.449366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb55a21-4893-4f71-9887-694a0ef14d24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:10.457884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb55a21-4893-4f71-9887-694a0ef14d24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:10.509900 dv-cinder-842998-1-smb devstack@keystone.service[80412]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dfb55a21-4893-4f71-9887-694a0ef14d24 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 16:54:10.510192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb55a21-4893-4f71-9887-694a0ef14d24 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:10.519941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Mon May 23 16:54:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 16:54:10.525952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56383f94-6fa2-4b8a-90c4-54e638beb98a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:10.540663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56383f94-6fa2-4b8a-90c4-54e638beb98a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:10.545065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d38070-d5b4-45dc-a7e6-c8d07fdb8fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:10.546173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d38070-d5b4-45dc-a7e6-c8d07fdb8fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:10.546494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d38070-d5b4-45dc-a7e6-c8d07fdb8fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:10.546775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d38070-d5b4-45dc-a7e6-c8d07fdb8fd5 admin admin] PATH_INFO: `/v3/projects/1e61a710b27f4ea29e3f6c7963fdf0c4` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:10.548284 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d38070-d5b4-45dc-a7e6-c8d07fdb8fd5 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e61a710b27f4ea29e3f6c7963fdf0c4)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:10.708312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d4d38070-d5b4-45dc-a7e6-c8d07fdb8fd5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 16:54:10.708973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d38070-d5b4-45dc-a7e6-c8d07fdb8fd5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:10.713295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Mon May 23 16:54:10 2022] GET /identity/v3/projects/1e61a710b27f4ea29e3f6c7963fdf0c4 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:12.864465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d19787-c39c-46ff-85f3-bb6d74a8c738 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:12.864972 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d19787-c39c-46ff-85f3-bb6d74a8c738 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:12.865075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d19787-c39c-46ff-85f3-bb6d74a8c738 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:12.869125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:12.874419 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd05c6-f724-49c7-b86f-025563d85260 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:12.874792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd05c6-f724-49c7-b86f-025563d85260 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:12.874987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd05c6-f724-49c7-b86f-025563d85260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:12.894347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-21cd05c6-f724-49c7-b86f-025563d85260 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:12.895866 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-21cd05c6-f724-49c7-b86f-025563d85260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:12.903544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 23 16:54:12.925481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d19787-c39c-46ff-85f3-bb6d74a8c738 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:12.937313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d19787-c39c-46ff-85f3-bb6d74a8c738 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:12.941500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c02423-7a78-4578-8b37-02068fd12b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:12.942119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c02423-7a78-4578-8b37-02068fd12b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:12.942425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c02423-7a78-4578-8b37-02068fd12b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:12.942881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c02423-7a78-4578-8b37-02068fd12b45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:12.950736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c02423-7a78-4578-8b37-02068fd12b45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:12.952468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c02423-7a78-4578-8b37-02068fd12b45 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:12.961717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Mon May 23 16:54:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:54:12.966815 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd05c6-f724-49c7-b86f-025563d85260 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:12.976274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd05c6-f724-49c7-b86f-025563d85260 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:12.980641 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ac5cf-2824-4b30-9d6c-ad633cff2eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:12.981495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ac5cf-2824-4b30-9d6c-ad633cff2eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:12.981784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ac5cf-2824-4b30-9d6c-ad633cff2eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:12.982063 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ac5cf-2824-4b30-9d6c-ad633cff2eb2 admin admin] PATH_INFO: `/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:12.983557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ac5cf-2824-4b30-9d6c-ad633cff2eb2 admin admin] RBAC: Authorizing `identity:get_user(user_id=c22f03b3c05b411a8e1b74bbae3a8adc)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:12.985356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ac5cf-2824-4b30-9d6c-ad633cff2eb2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:12.986921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Mon May 23 16:54:12 2022] GET /identity/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:15.217284 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a8e81-76b1-4b51-8fe5-1adacb81255a None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:15.217823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a8e81-76b1-4b51-8fe5-1adacb81255a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:15.217933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a8e81-76b1-4b51-8fe5-1adacb81255a None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:15.219309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:15.225315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d885a5-e9ab-45e7-883c-364bca9b216f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:15.225743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d885a5-e9ab-45e7-883c-364bca9b216f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:15.225950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d885a5-e9ab-45e7-883c-364bca9b216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:15.242761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-93d885a5-e9ab-45e7-883c-364bca9b216f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:15.243937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-93d885a5-e9ab-45e7-883c-364bca9b216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:15.278486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66666a62-82aa-42b2-bfd2-64869bb5e242 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:15.278774 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66666a62-82aa-42b2-bfd2-64869bb5e242 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:15.279058 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66666a62-82aa-42b2-bfd2-64869bb5e242 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:15.280403 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:54:15.285926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5fbfb-ae6f-4005-a959-c8981931fd13 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:15.286210 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5fbfb-ae6f-4005-a959-c8981931fd13 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:15.286514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5fbfb-ae6f-4005-a959-c8981931fd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:15.323133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:15.325809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG passlib.handlers.bcrypt [None req-92d5fbfb-ae6f-4005-a959-c8981931fd13 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80412) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 16:54:15.326230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG passlib.handlers.bcrypt [None req-92d5fbfb-ae6f-4005-a959-c8981931fd13 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80412) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 16:54:15.347138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d885a5-e9ab-45e7-883c-364bca9b216f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:15.369801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:15.373422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-92d5fbfb-ae6f-4005-a959-c8981931fd13 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:15.375069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-92d5fbfb-ae6f-4005-a959-c8981931fd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:15.450121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d885a5-e9ab-45e7-883c-364bca9b216f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:15.474479 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:54:15.486548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e9454-50c5-42f9-918f-f052ea18e0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:15.487382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e9454-50c5-42f9-918f-f052ea18e0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:15.487665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e9454-50c5-42f9-918f-f052ea18e0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:15.487945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e9454-50c5-42f9-918f-f052ea18e0b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:15.496118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5fbfb-ae6f-4005-a959-c8981931fd13 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:15.499271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e9454-50c5-42f9-918f-f052ea18e0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-869e9454-50c5-42f9-918f-f052ea18e0b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:15.510910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:15.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:15.512746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:54:15.517662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e9454-50c5-42f9-918f-f052ea18e0b7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:15.598418 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5fbfb-ae6f-4005-a959-c8981931fd13 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:15.599962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:15.601073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:15.621298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e9454-50c5-42f9-918f-f052ea18e0b7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:15.637651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd75b0-d3e1-4376-be51-2431223ca1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:15.638658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd75b0-d3e1-4376-be51-2431223ca1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:15.639024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd75b0-d3e1-4376-be51-2431223ca1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:15.639302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd75b0-d3e1-4376-be51-2431223ca1f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:15.654875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0cf2a-c675-45e9-8746-f019d1671548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:15.655543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0cf2a-c675-45e9-8746-f019d1671548 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:15.655838 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0cf2a-c675-45e9-8746-f019d1671548 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:15.656118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0cf2a-c675-45e9-8746-f019d1671548 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:15.656875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0cf2a-c675-45e9-8746-f019d1671548 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:15.657186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0cf2a-c675-45e9-8746-f019d1671548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:15.658602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0cf2a-c675-45e9-8746-f019d1671548 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:15.670954 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:15.677306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0cf2a-c675-45e9-8746-f019d1671548 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:15.709428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd75b0-d3e1-4376-be51-2431223ca1f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:15.710977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd75b0-d3e1-4376-be51-2431223ca1f9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:15.777203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0cf2a-c675-45e9-8746-f019d1671548 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:15.811055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 16:54:15.811775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c48baa-3760-4dd8-ad08-7cb1cd900514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:15.812652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c48baa-3760-4dd8-ad08-7cb1cd900514 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:15.812937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c48baa-3760-4dd8-ad08-7cb1cd900514 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:15.813219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c48baa-3760-4dd8-ad08-7cb1cd900514 None admin] PATH_INFO: `/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:15.814455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c48baa-3760-4dd8-ad08-7cb1cd900514 None admin] RBAC: Authorizing `identity:get_user(user_id=c22f03b3c05b411a8e1b74bbae3a8adc)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:15.816807 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c48baa-3760-4dd8-ad08-7cb1cd900514 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:15.817197 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd75b0-d3e1-4376-be51-2431223ca1f9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:15.818421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:15 2022] GET /identity/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:15.820585 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:15.824439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c48baa-3760-4dd8-ad08-7cb1cd900514 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:15.838613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:15.914123 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd75b0-d3e1-4376-be51-2431223ca1f9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:15.920890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c48baa-3760-4dd8-ad08-7cb1cd900514 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:15.947951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1dc86-f66c-4fb6-b8c9-9bf45b3d975e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:15.948781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1dc86-f66c-4fb6-b8c9-9bf45b3d975e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:15.949345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1dc86-f66c-4fb6-b8c9-9bf45b3d975e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:15.949628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1dc86-f66c-4fb6-b8c9-9bf45b3d975e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:15.954287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5810dcb-80c6-409a-9ae8-2149c1b4306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:15.955096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5810dcb-80c6-409a-9ae8-2149c1b4306d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:15.955378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5810dcb-80c6-409a-9ae8-2149c1b4306d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:15.956512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5810dcb-80c6-409a-9ae8-2149c1b4306d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:15.957800 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5810dcb-80c6-409a-9ae8-2149c1b4306d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:15.959267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5810dcb-80c6-409a-9ae8-2149c1b4306d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:15.960850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:15.969150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5810dcb-80c6-409a-9ae8-2149c1b4306d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:15.972318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1dc86-f66c-4fb6-b8c9-9bf45b3d975e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:15.973911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1dc86-f66c-4fb6-b8c9-9bf45b3d975e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-58a1dc86-f66c-4fb6-b8c9-9bf45b3d975e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:54:15.994772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:15.995609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:15.996618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:54:15.996618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:54:15.996618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:54:15.996618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:54:15.996618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:54:16.001777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1dc86-f66c-4fb6-b8c9-9bf45b3d975e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:16.051075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:16.062434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:16.070329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5810dcb-80c6-409a-9ae8-2149c1b4306d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:16.105602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ae749-81be-4ca7-a25b-f54f7d9a06ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:16.106256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ae749-81be-4ca7-a25b-f54f7d9a06ca None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:16.106580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ae749-81be-4ca7-a25b-f54f7d9a06ca None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:16.106861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ae749-81be-4ca7-a25b-f54f7d9a06ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:16.107177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1dc86-f66c-4fb6-b8c9-9bf45b3d975e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:16.107697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ae749-81be-4ca7-a25b-f54f7d9a06ca None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.domain.id=default, user.id=c22f03b3c05b411a8e1b74bbae3a8adc) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:16.108014 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ae749-81be-4ca7-a25b-f54f7d9a06ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:16.109453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ae749-81be-4ca7-a25b-f54f7d9a06ca None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:16.116208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Mon May 23 16:54:15 2022] GET /identity/v3/role_assignments?user.id=c22f03b3c05b411a8e1b74bbae3a8adc&scope.domain.id=default&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:16.254113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a5320-6df3-4a33-8849-0023c26d5358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:16.254828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a5320-6df3-4a33-8849-0023c26d5358 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:16.255117 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a5320-6df3-4a33-8849-0023c26d5358 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:16.255395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a5320-6df3-4a33-8849-0023c26d5358 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:16.256150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a5320-6df3-4a33-8849-0023c26d5358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:16.256463 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a5320-6df3-4a33-8849-0023c26d5358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:16.257883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a5320-6df3-4a33-8849-0023c26d5358 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:16.277057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:18.674846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff1284-4bb4-406f-b49a-501816756790 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:18.675907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff1284-4bb4-406f-b49a-501816756790 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:18.676397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff1284-4bb4-406f-b49a-501816756790 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:18.678022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:18.683178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3ea1d-0f65-437e-bc20-8a03cb49a4c1 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:18.683960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3ea1d-0f65-437e-bc20-8a03cb49a4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:18.684455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3ea1d-0f65-437e-bc20-8a03cb49a4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:18.712481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-72f3ea1d-0f65-437e-bc20-8a03cb49a4c1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:18.714027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-72f3ea1d-0f65-437e-bc20-8a03cb49a4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:18.805820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:18.837370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff1284-4bb4-406f-b49a-501816756790 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:18.968388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33918e52-972d-4121-aabf-303a902bebe2 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:18.968675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33918e52-972d-4121-aabf-303a902bebe2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:18.968880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33918e52-972d-4121-aabf-303a902bebe2 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:18.970462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:18.980250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb1c4-e627-4d87-83f5-c555d53d145d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:18.980590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb1c4-e627-4d87-83f5-c555d53d145d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:18.980811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb1c4-e627-4d87-83f5-c555d53d145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.008192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff1284-4bb4-406f-b49a-501816756790 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.010403 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ba0eb1c4-e627-4d87-83f5-c555d53d145d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:19.011599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ba0eb1c4-e627-4d87-83f5-c555d53d145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:19.088495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafb783-cf0e-4ebc-93b4-00b8aa520c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.089312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafb783-cf0e-4ebc-93b4-00b8aa520c1e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.089599 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafb783-cf0e-4ebc-93b4-00b8aa520c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.089878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafb783-cf0e-4ebc-93b4-00b8aa520c1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.113569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:19.119155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafb783-cf0e-4ebc-93b4-00b8aa520c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-9cafb783-cf0e-4ebc-93b4-00b8aa520c1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:19.135024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:19.135923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:19.136684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 13/25] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:54:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:19.145837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafb783-cf0e-4ebc-93b4-00b8aa520c1e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:19.155280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:19.185888 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 13/26] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:54:19.206827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c20767-7180-46a2-9fbb-397108c12bc1 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.207429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c20767-7180-46a2-9fbb-397108c12bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.207921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c20767-7180-46a2-9fbb-397108c12bc1 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.209577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 14/27] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:54:19.215082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fe521-0efc-400f-8291-a4862b822328 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.215606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fe521-0efc-400f-8291-a4862b822328 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.216111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fe521-0efc-400f-8291-a4862b822328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.245663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7e7fe521-0efc-400f-8291-a4862b822328 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:19.246832 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7e7fe521-0efc-400f-8291-a4862b822328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:19.298226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafb783-cf0e-4ebc-93b4-00b8aa520c1e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.369269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc200971-05d6-490c-b2a7-12607a8c5328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.369945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200971-05d6-490c-b2a7-12607a8c5328 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.370228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200971-05d6-490c-b2a7-12607a8c5328 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.370527 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200971-05d6-490c-b2a7-12607a8c5328 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.371277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc200971-05d6-490c-b2a7-12607a8c5328 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:19.371582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc200971-05d6-490c-b2a7-12607a8c5328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:19.374286 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc200971-05d6-490c-b2a7-12607a8c5328 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.393732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 14/28] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:19.394881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc200971-05d6-490c-b2a7-12607a8c5328 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:19.400639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 15/29] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:54:19.402578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fe521-0efc-400f-8291-a4862b822328 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:19.510917 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:19.539624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fe521-0efc-400f-8291-a4862b822328 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.547778 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:19.576582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc200971-05d6-490c-b2a7-12607a8c5328 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.607866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e34340-207e-4c82-bd0f-12e9bb2b55cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.608621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e34340-207e-4c82-bd0f-12e9bb2b55cb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.608916 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e34340-207e-4c82-bd0f-12e9bb2b55cb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.609198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e34340-207e-4c82-bd0f-12e9bb2b55cb None admin] PATH_INFO: `/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.615477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e34340-207e-4c82-bd0f-12e9bb2b55cb None admin] RBAC: Authorizing `identity:get_user(user_id=c22f03b3c05b411a8e1b74bbae3a8adc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:19.616942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e34340-207e-4c82-bd0f-12e9bb2b55cb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.619232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 16/30] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:19 2022] GET /identity/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:19.620161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e34340-207e-4c82-bd0f-12e9bb2b55cb None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:19.631101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674e9b4-49e6-4558-a2f8-4d761c50f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.631999 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e9b4-49e6-4558-a2f8-4d761c50f94f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.632370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e9b4-49e6-4558-a2f8-4d761c50f94f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.632727 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e9b4-49e6-4558-a2f8-4d761c50f94f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.645190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674e9b4-49e6-4558-a2f8-4d761c50f94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:19.647024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674e9b4-49e6-4558-a2f8-4d761c50f94f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-8674e9b4-49e6-4558-a2f8-4d761c50f94f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:54:19.685011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:19.686306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:19.687158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:54:19.687158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:54:19.687158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:54:19.687158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:19.690494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 15/31] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:19.693578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674e9b4-49e6-4558-a2f8-4d761c50f94f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:19.812525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e34340-207e-4c82-bd0f-12e9bb2b55cb None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.856520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56630c-971a-43a8-bf6f-4592f05b64d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.856717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674e9b4-49e6-4558-a2f8-4d761c50f94f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.857686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56630c-971a-43a8-bf6f-4592f05b64d8 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.858335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56630c-971a-43a8-bf6f-4592f05b64d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.859655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56630c-971a-43a8-bf6f-4592f05b64d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.860624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56630c-971a-43a8-bf6f-4592f05b64d8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:19.862814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56630c-971a-43a8-bf6f-4592f05b64d8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.877587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:19.899639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95290109-471a-442f-b35a-b499f16f12cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.900674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95290109-471a-442f-b35a-b499f16f12cc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.901104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95290109-471a-442f-b35a-b499f16f12cc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.901546 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95290109-471a-442f-b35a-b499f16f12cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.903141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95290109-471a-442f-b35a-b499f16f12cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:19.904813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95290109-471a-442f-b35a-b499f16f12cc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.911589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 16/32] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:19.912592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95290109-471a-442f-b35a-b499f16f12cc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:20.014785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 17/33] 10.222.0.49 () {60 vars in 1131 bytes} [Mon May 23 16:54:19 2022] POST /identity/v3/roles => generated 219 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:54:20.017035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e46dcf-6099-439c-85cb-56f5ff47b6ef None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:20.017494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e46dcf-6099-439c-85cb-56f5ff47b6ef None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:20.017959 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e46dcf-6099-439c-85cb-56f5ff47b6ef None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:20.020177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 18/34] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:20.021018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e46dcf-6099-439c-85cb-56f5ff47b6ef None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:20.041584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95290109-471a-442f-b35a-b499f16f12cc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:20.088070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e99d1-d1fa-435f-a738-fbc9c4a4dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:20.089154 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e99d1-d1fa-435f-a738-fbc9c4a4dd1f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:20.089651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e99d1-d1fa-435f-a738-fbc9c4a4dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:20.090342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e99d1-d1fa-435f-a738-fbc9c4a4dd1f None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:20.091397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e99d1-d1fa-435f-a738-fbc9c4a4dd1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:20.092117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e99d1-d1fa-435f-a738-fbc9c4a4dd1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:20.093798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e99d1-d1fa-435f-a738-fbc9c4a4dd1f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:20.104825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:20.116773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 17/35] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:20.118453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba7d6-0df3-4fef-aeba-4c9655ca01c9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:20.118968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba7d6-0df3-4fef-aeba-4c9655ca01c9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:20.119441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba7d6-0df3-4fef-aeba-4c9655ca01c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:20.140765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f05ba7d6-0df3-4fef-aeba-4c9655ca01c9 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:20.142319 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f05ba7d6-0df3-4fef-aeba-4c9655ca01c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:20.210404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:20.254301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e46dcf-6099-439c-85cb-56f5ff47b6ef None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:20.288203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 18/36] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:20.289135 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ba7d6-0df3-4fef-aeba-4c9655ca01c9 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:20.299586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e0079-ceb1-4645-862a-03fe2234dac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:20.300387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e0079-ceb1-4645-862a-03fe2234dac9 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:20.300677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e0079-ceb1-4645-862a-03fe2234dac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:20.300962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e0079-ceb1-4645-862a-03fe2234dac9 None admin] PATH_INFO: `/v3/domains/default/users/c22f03b3c05b411a8e1b74bbae3a8adc/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:20.305219 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e0079-ceb1-4645-862a-03fe2234dac9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c22f03b3c05b411a8e1b74bbae3a8adc, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:20.308972 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e0079-ceb1-4645-862a-03fe2234dac9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:20.328907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 19/37] 10.222.0.49 () {58 vars in 1361 bytes} [Mon May 23 16:54:20 2022] PUT /identity/v3/domains/default/users/c22f03b3c05b411a8e1b74bbae3a8adc/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:54:20.333380 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226ef24-a6dc-4b34-a340-5fc4254ecc75 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:20.333731 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226ef24-a6dc-4b34-a340-5fc4254ecc75 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:20.334022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226ef24-a6dc-4b34-a340-5fc4254ecc75 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:20.336190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 20/38] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:20.337367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226ef24-a6dc-4b34-a340-5fc4254ecc75 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:20.441519 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ba7d6-0df3-4fef-aeba-4c9655ca01c9 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:20.480110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:20.484647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08140267-e9c7-49f8-ac19-5ebf08c64de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:20.485570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08140267-e9c7-49f8-ac19-5ebf08c64de0 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:20.486002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08140267-e9c7-49f8-ac19-5ebf08c64de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:20.486536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08140267-e9c7-49f8-ac19-5ebf08c64de0 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:20.487762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08140267-e9c7-49f8-ac19-5ebf08c64de0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:20.489261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08140267-e9c7-49f8-ac19-5ebf08c64de0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:20.492687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226ef24-a6dc-4b34-a340-5fc4254ecc75 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:20.542351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37c628-50ee-4abe-8ed6-9f85618e9001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:20.543078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37c628-50ee-4abe-8ed6-9f85618e9001 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:20.543367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37c628-50ee-4abe-8ed6-9f85618e9001 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:20.543920 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37c628-50ee-4abe-8ed6-9f85618e9001 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:20.544681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37c628-50ee-4abe-8ed6-9f85618e9001 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:20.546039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37c628-50ee-4abe-8ed6-9f85618e9001 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:20.561040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 21/39] 10.222.0.49 () {60 vars in 1131 bytes} [Mon May 23 16:54:20 2022] POST /identity/v3/roles => generated 225 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:54:20.562057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe602d8a-1321-42a6-b408-8ec15b714e42 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:20.562349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe602d8a-1321-42a6-b408-8ec15b714e42 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:20.566827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe602d8a-1321-42a6-b408-8ec15b714e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:20.593679 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-fe602d8a-1321-42a6-b408-8ec15b714e42 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:20.595932 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fe602d8a-1321-42a6-b408-8ec15b714e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:20.627990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 19/40] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:54:20 2022] POST /identity/v3/projects => generated 301 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:54:20.629492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb9276-c5db-43fa-a3da-df083397d0d2 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:20.629792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb9276-c5db-43fa-a3da-df083397d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:20.630080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb9276-c5db-43fa-a3da-df083397d0d2 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:20.631748 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 20/41] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:20.637629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ede93-a686-4c36-b00f-9d51929c713f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:20.638043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ede93-a686-4c36-b00f-9d51929c713f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:20.638426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ede93-a686-4c36-b00f-9d51929c713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:20.659822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-941ede93-a686-4c36-b00f-9d51929c713f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:20.661606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-941ede93-a686-4c36-b00f-9d51929c713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:20.685999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 22/42] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:20.703454 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:20.724795 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe602d8a-1321-42a6-b408-8ec15b714e42 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:20.766515 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 21/43] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:20.790069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ede93-a686-4c36-b00f-9d51929c713f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:20.885153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:20.914862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe602d8a-1321-42a6-b408-8ec15b714e42 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:20.966766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf763b-3e67-4bea-9d93-e70759691ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:20.967460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf763b-3e67-4bea-9d93-e70759691ae3 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:20.967755 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf763b-3e67-4bea-9d93-e70759691ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:20.968040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf763b-3e67-4bea-9d93-e70759691ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:20.968806 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf763b-3e67-4bea-9d93-e70759691ae3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:20.969224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ede93-a686-4c36-b00f-9d51929c713f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:20.970244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf763b-3e67-4bea-9d93-e70759691ae3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:20.990188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1131 bytes} [Mon May 23 16:54:20 2022] POST /identity/v3/roles => generated 223 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:54:21.014232 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5394b-becb-4bee-b687-380a7d065cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:21.015099 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5394b-becb-4bee-b687-380a7d065cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:21.015386 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5394b-becb-4bee-b687-380a7d065cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:21.015773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5394b-becb-4bee-b687-380a7d065cf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:21.017163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5394b-becb-4bee-b687-380a7d065cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:21.019512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5394b-becb-4bee-b687-380a7d065cf1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:21.021370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 22/45] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:21.027218 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf763b-3e67-4bea-9d93-e70759691ae3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:21.142072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf763b-3e67-4bea-9d93-e70759691ae3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:21.179710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b4f41-4870-4b78-8f3c-12a12950e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:21.180383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b4f41-4870-4b78-8f3c-12a12950e276 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:21.180676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b4f41-4870-4b78-8f3c-12a12950e276 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:21.180955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b4f41-4870-4b78-8f3c-12a12950e276 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:21.181679 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b4f41-4870-4b78-8f3c-12a12950e276 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:21.183171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b4f41-4870-4b78-8f3c-12a12950e276 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:21.200362 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:21.216377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:54:21 2022] POST /identity/v3/projects => generated 312 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:54:22.624192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b750f-9fbb-4a6a-ad90-4415a7b34306 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:22.624709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b750f-9fbb-4a6a-ad90-4415a7b34306 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:22.624791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b750f-9fbb-4a6a-ad90-4415a7b34306 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:22.626128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 23/47] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:22.631612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2e5a7-3136-482d-bb19-b7fbbc827d86 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:22.632013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2e5a7-3136-482d-bb19-b7fbbc827d86 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:22.632305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2e5a7-3136-482d-bb19-b7fbbc827d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:22.649742 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6fd2e5a7-3136-482d-bb19-b7fbbc827d86 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:22.650949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6fd2e5a7-3136-482d-bb19-b7fbbc827d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:22.715286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 25/48] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:54:22.738678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b750f-9fbb-4a6a-ad90-4415a7b34306 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:22.765758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:22.841856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b750f-9fbb-4a6a-ad90-4415a7b34306 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:22.875535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ae3f3-de2c-45cf-ba4d-92ce2e6e45f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:22.876255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ae3f3-de2c-45cf-ba4d-92ce2e6e45f6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:22.876545 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ae3f3-de2c-45cf-ba4d-92ce2e6e45f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:22.876821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ae3f3-de2c-45cf-ba4d-92ce2e6e45f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:22.887727 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ae3f3-de2c-45cf-ba4d-92ce2e6e45f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c61ae3f3-de2c-45cf-ba4d-92ce2e6e45f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:22.895601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:22.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:22.897200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 24/49] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:54:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:22.902613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2e5a7-3136-482d-bb19-b7fbbc827d86 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:23.001395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2e5a7-3136-482d-bb19-b7fbbc827d86 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:23.027768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:23.036885 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ecde6-ac9a-482a-bd90-e25147cdada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:23.037558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ecde6-ac9a-482a-bd90-e25147cdada4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:23.037850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ecde6-ac9a-482a-bd90-e25147cdada4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:23.038133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ecde6-ac9a-482a-bd90-e25147cdada4 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:23.038928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ecde6-ac9a-482a-bd90-e25147cdada4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:23.039242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ecde6-ac9a-482a-bd90-e25147cdada4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:23.040619 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ecde6-ac9a-482a-bd90-e25147cdada4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:23.052041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 26/50] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:23.057515 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ae3f3-de2c-45cf-ba4d-92ce2e6e45f6 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:23.166629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:23.182680 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ae3f3-de2c-45cf-ba4d-92ce2e6e45f6 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:23.215292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38df01d-03be-44a1-84df-cb10218f65ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:23.216165 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38df01d-03be-44a1-84df-cb10218f65ca None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:23.216453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38df01d-03be-44a1-84df-cb10218f65ca None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:23.216730 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38df01d-03be-44a1-84df-cb10218f65ca None admin] PATH_INFO: `/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:23.217914 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38df01d-03be-44a1-84df-cb10218f65ca None admin] RBAC: Authorizing `identity:get_user(user_id=c22f03b3c05b411a8e1b74bbae3a8adc)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:23.219399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38df01d-03be-44a1-84df-cb10218f65ca None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:23.221684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 25/51] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:23 2022] GET /identity/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:23.226911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ecde6-ac9a-482a-bd90-e25147cdada4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:23.331271 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ecde6-ac9a-482a-bd90-e25147cdada4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:23.364853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd96d97-f493-4428-9d6d-a09087b054f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:23.365647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd96d97-f493-4428-9d6d-a09087b054f8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:23.365940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd96d97-f493-4428-9d6d-a09087b054f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:23.366222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd96d97-f493-4428-9d6d-a09087b054f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:23.367424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd96d97-f493-4428-9d6d-a09087b054f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:23.368855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd96d97-f493-4428-9d6d-a09087b054f8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:23.370529 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 27/52] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:23.376397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38df01d-03be-44a1-84df-cb10218f65ca None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:23.429358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec5455-89d3-4891-99bb-f440c623ebe4 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:23.429617 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec5455-89d3-4891-99bb-f440c623ebe4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:23.429847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec5455-89d3-4891-99bb-f440c623ebe4 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:23.431244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 28/53] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:23.436034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554e05b-f33a-46d1-a897-ef9b7a4de8f1 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:23.436327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554e05b-f33a-46d1-a897-ef9b7a4de8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:23.436609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554e05b-f33a-46d1-a897-ef9b7a4de8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:23.454049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c554e05b-f33a-46d1-a897-ef9b7a4de8f1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:23.455826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c554e05b-f33a-46d1-a897-ef9b7a4de8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:23.479945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38df01d-03be-44a1-84df-cb10218f65ca None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:23.518924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:23.522174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a3786-2b2e-4434-b4a0-d6e01afe31e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:23.522883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a3786-2b2e-4434-b4a0-d6e01afe31e1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:23.523174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a3786-2b2e-4434-b4a0-d6e01afe31e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:23.523453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a3786-2b2e-4434-b4a0-d6e01afe31e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:23.524295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a3786-2b2e-4434-b4a0-d6e01afe31e1 None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.domain.id=default, user.id=c22f03b3c05b411a8e1b74bbae3a8adc) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:23.524612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a3786-2b2e-4434-b4a0-d6e01afe31e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:23.526060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a3786-2b2e-4434-b4a0-d6e01afe31e1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:23.531934 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 26/54] 10.222.0.49 () {56 vars in 1322 bytes} [Mon May 23 16:54:23 2022] GET /identity/v3/role_assignments?user.id=c22f03b3c05b411a8e1b74bbae3a8adc&scope.domain.id=default&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:23.537482 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 29/55] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:54:23.560867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a3786-2b2e-4434-b4a0-d6e01afe31e1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:23.582305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:23.667272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a3786-2b2e-4434-b4a0-d6e01afe31e1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:23.703596 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1d9e3-86a5-453f-836c-0bab05807f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:23.704303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1d9e3-86a5-453f-836c-0bab05807f08 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:23.704588 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1d9e3-86a5-453f-836c-0bab05807f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:23.704874 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1d9e3-86a5-453f-836c-0bab05807f08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:23.706721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1d9e3-86a5-453f-836c-0bab05807f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:23.708234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1d9e3-86a5-453f-836c-0bab05807f08 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:23.709852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 27/56] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:23.715442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554e05b-f33a-46d1-a897-ef9b7a4de8f1 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:23.825935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554e05b-f33a-46d1-a897-ef9b7a4de8f1 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:23.859085 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fbb0c-8c48-4e2f-8644-7ceee4406cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:23.859744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fbb0c-8c48-4e2f-8644-7ceee4406cf6 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:23.860034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fbb0c-8c48-4e2f-8644-7ceee4406cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:23.860316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fbb0c-8c48-4e2f-8644-7ceee4406cf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:23.861031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fbb0c-8c48-4e2f-8644-7ceee4406cf6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:23.862860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fbb0c-8c48-4e2f-8644-7ceee4406cf6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:23.887853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 30/57] 10.222.0.49 () {60 vars in 1140 bytes} [Mon May 23 16:54:23 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:54:26.103040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4bdc-a22d-494f-8a05-abcd59807673 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:26.103566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4bdc-a22d-494f-8a05-abcd59807673 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:26.103656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4bdc-a22d-494f-8a05-abcd59807673 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:26.104968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 28/58] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:26.110020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26d322-450e-4971-b747-a04aab2a6de2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:26.110443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26d322-450e-4971-b747-a04aab2a6de2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:26.110626 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26d322-450e-4971-b747-a04aab2a6de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:26.127041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3d26d322-450e-4971-b747-a04aab2a6de2 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:26.128762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3d26d322-450e-4971-b747-a04aab2a6de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:26.157762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:26.195494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 31/59] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:26.220564 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d4bdc-a22d-494f-8a05-abcd59807673 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:26.303401 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:26.319040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d4bdc-a22d-494f-8a05-abcd59807673 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:26.351280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d21f6f-cc7e-4f36-8100-ca7b869e322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:26.352058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d21f6f-cc7e-4f36-8100-ca7b869e322c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:26.352349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d21f6f-cc7e-4f36-8100-ca7b869e322c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:26.352632 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d21f6f-cc7e-4f36-8100-ca7b869e322c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:26.353844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d21f6f-cc7e-4f36-8100-ca7b869e322c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:26.355260 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d21f6f-cc7e-4f36-8100-ca7b869e322c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:26.356832 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 29/60] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:26.362665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26d322-450e-4971-b747-a04aab2a6de2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:26.462866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26d322-450e-4971-b747-a04aab2a6de2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:26.496991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f56f0-4f8b-4bf1-af73-77ed48f325c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:26.497661 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f56f0-4f8b-4bf1-af73-77ed48f325c9 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:26.497950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f56f0-4f8b-4bf1-af73-77ed48f325c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:26.498229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f56f0-4f8b-4bf1-af73-77ed48f325c9 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:26.498979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f56f0-4f8b-4bf1-af73-77ed48f325c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:26.500422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f56f0-4f8b-4bf1-af73-77ed48f325c9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:26.525829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 32/61] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:54:26 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:54:29.698004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0da873-cd12-49b0-9af8-59f4c763f15f None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:29.699216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0da873-cd12-49b0-9af8-59f4c763f15f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:29.699644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0da873-cd12-49b0-9af8-59f4c763f15f None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:29.701226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 30/62] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:29.708654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9b70-5a8e-4bab-aa61-accbc15275bb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:29.709553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9b70-5a8e-4bab-aa61-accbc15275bb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:29.709974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9b70-5a8e-4bab-aa61-accbc15275bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:29.734428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b20f9b70-5a8e-4bab-aa61-accbc15275bb None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:29.735966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b20f9b70-5a8e-4bab-aa61-accbc15275bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:29.759716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:29.843656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 33/63] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:29.879877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0da873-cd12-49b0-9af8-59f4c763f15f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:29.913527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f335b-32f1-422a-80ee-da3809cbd328 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:29.914154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f335b-32f1-422a-80ee-da3809cbd328 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:29.915164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f335b-32f1-422a-80ee-da3809cbd328 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:29.916928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 34/64] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:29.922376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fedd4-a274-45ab-946a-92f8e2f5b600 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:29.922913 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fedd4-a274-45ab-946a-92f8e2f5b600 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:29.923753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fedd4-a274-45ab-946a-92f8e2f5b600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:29.955786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e44fedd4-a274-45ab-946a-92f8e2f5b600 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:29.957533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e44fedd4-a274-45ab-946a-92f8e2f5b600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:30.086986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 35/65] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:30.094174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0da873-cd12-49b0-9af8-59f4c763f15f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:30.112765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fedd4-a274-45ab-946a-92f8e2f5b600 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:30.191190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2247f7-1046-4597-9799-06fcc8b52a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:30.192016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2247f7-1046-4597-9799-06fcc8b52a17 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.192305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2247f7-1046-4597-9799-06fcc8b52a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.192646 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2247f7-1046-4597-9799-06fcc8b52a17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.213174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:30.223410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2247f7-1046-4597-9799-06fcc8b52a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-9c2247f7-1046-4597-9799-06fcc8b52a17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:30.234882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:30.235805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:30.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:30.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:30.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:30.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:30.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:30.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:30.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:30.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:30.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:30.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:30.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:30.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:30.240162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 31/66] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:30.241915 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f22eeb-d5bc-4d7e-8e4c-6fe8700d304d None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.242447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f22eeb-d5bc-4d7e-8e4c-6fe8700d304d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.242925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f22eeb-d5bc-4d7e-8e4c-6fe8700d304d None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.244385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 32/67] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:30.245761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f22eeb-d5bc-4d7e-8e4c-6fe8700d304d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:30.247501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fedd4-a274-45ab-946a-92f8e2f5b600 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:30.266661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:30.288882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8638fb-4b20-45bc-ab6a-83a3468b6419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:30.289696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8638fb-4b20-45bc-ab6a-83a3468b6419 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.289981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8638fb-4b20-45bc-ab6a-83a3468b6419 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.290378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8638fb-4b20-45bc-ab6a-83a3468b6419 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.304966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8638fb-4b20-45bc-ab6a-83a3468b6419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-2c8638fb-4b20-45bc-ab6a-83a3468b6419 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:30.314413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:30.315773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:54:30.316531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 36/68] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:54:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:54:30.317351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329fd1b-198c-4576-aa51-c7e30c7c7c99 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.317788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329fd1b-198c-4576-aa51-c7e30c7c7c99 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.318258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329fd1b-198c-4576-aa51-c7e30c7c7c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.337000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b329fd1b-198c-4576-aa51-c7e30c7c7c99 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:30.338569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b329fd1b-198c-4576-aa51-c7e30c7c7c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:30.382772 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f22eeb-d5bc-4d7e-8e4c-6fe8700d304d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:30.412150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 37/69] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:30.422257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aa799-054a-4a33-b4c1-88b500e87cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:30.422956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aa799-054a-4a33-b4c1-88b500e87cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.423235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329fd1b-198c-4576-aa51-c7e30c7c7c99 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:30.423332 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aa799-054a-4a33-b4c1-88b500e87cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.423511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aa799-054a-4a33-b4c1-88b500e87cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.425104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aa799-054a-4a33-b4c1-88b500e87cb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:30.425456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aa799-054a-4a33-b4c1-88b500e87cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:30.427505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aa799-054a-4a33-b4c1-88b500e87cb3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:30.440764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 33/70] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:30.440764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c9839-2531-4992-a51a-56343c7adf3e None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.440764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c9839-2531-4992-a51a-56343c7adf3e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.441016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c9839-2531-4992-a51a-56343c7adf3e None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.443318 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 34/71] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:30.444541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c9839-2531-4992-a51a-56343c7adf3e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:30.518850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:30.532229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:30.548186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329fd1b-198c-4576-aa51-c7e30c7c7c99 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:30.560148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c9839-2531-4992-a51a-56343c7adf3e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:30.590211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9791f-1e24-48f2-9bca-f6af5bab4c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:30.591016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9791f-1e24-48f2-9bca-f6af5bab4c87 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.591388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9791f-1e24-48f2-9bca-f6af5bab4c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.591679 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9791f-1e24-48f2-9bca-f6af5bab4c87 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.592439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9791f-1e24-48f2-9bca-f6af5bab4c87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:30.592756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9791f-1e24-48f2-9bca-f6af5bab4c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:30.594139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9791f-1e24-48f2-9bca-f6af5bab4c87 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:30.596992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14a69-9f7b-40dc-bb0d-ec9a7228bd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:30.597801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14a69-9f7b-40dc-bb0d-ec9a7228bd04 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.598088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14a69-9f7b-40dc-bb0d-ec9a7228bd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.598387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14a69-9f7b-40dc-bb0d-ec9a7228bd04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.608664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 38/72] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:30.608664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9791f-1e24-48f2-9bca-f6af5bab4c87 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:30.616154 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14a69-9f7b-40dc-bb0d-ec9a7228bd04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-42a14a69-9f7b-40dc-bb0d-ec9a7228bd04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:30.624493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:30.625342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:30.626147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 35/73] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:54:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:30.628413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d3f4-4dca-4ffa-8a30-cd0984e30ae6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.628700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d3f4-4dca-4ffa-8a30-cd0984e30ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.628981 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d3f4-4dca-4ffa-8a30-cd0984e30ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.648728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9739d3f4-4dca-4ffa-8a30-cd0984e30ae6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:30.649877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9739d3f4-4dca-4ffa-8a30-cd0984e30ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:30.714637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9791f-1e24-48f2-9bca-f6af5bab4c87 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:30.718786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 36/74] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:30.719636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739d3f4-4dca-4ffa-8a30-cd0984e30ae6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:30.748444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba3291-26e8-4736-9107-53cad512486b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:30.749322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba3291-26e8-4736-9107-53cad512486b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.749613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba3291-26e8-4736-9107-53cad512486b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.749886 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba3291-26e8-4736-9107-53cad512486b None admin] PATH_INFO: `/v3/users/0c86a729247645e9904a177f85de34a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.753146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:30.766527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba3291-26e8-4736-9107-53cad512486b None admin] RBAC: Authorizing `identity:get_user(user_id=0c86a729247645e9904a177f85de34a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:30.768632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba3291-26e8-4736-9107-53cad512486b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:30.774810 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 39/75] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:30 2022] GET /identity/v3/users/0c86a729247645e9904a177f85de34a2 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:30.774810 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba3291-26e8-4736-9107-53cad512486b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:30.794061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:30.829382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739d3f4-4dca-4ffa-8a30-cd0984e30ae6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:30.863426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77153308-8f5f-46e5-a9ac-2f4374ca65e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:30.864300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77153308-8f5f-46e5-a9ac-2f4374ca65e8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.864592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77153308-8f5f-46e5-a9ac-2f4374ca65e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.864871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77153308-8f5f-46e5-a9ac-2f4374ca65e8 None admin] PATH_INFO: `/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.866067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77153308-8f5f-46e5-a9ac-2f4374ca65e8 None admin] RBAC: Authorizing `identity:get_user(user_id=c22f03b3c05b411a8e1b74bbae3a8adc)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:30.867624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77153308-8f5f-46e5-a9ac-2f4374ca65e8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:30.869245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 37/76] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:30 2022] GET /identity/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:30.870422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208233a-780f-42eb-80c0-4bb1299d707a None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.870714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208233a-780f-42eb-80c0-4bb1299d707a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.871017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208233a-780f-42eb-80c0-4bb1299d707a None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.871783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba3291-26e8-4736-9107-53cad512486b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:30.872402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 38/77] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:30.876890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208233a-780f-42eb-80c0-4bb1299d707a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:30.906299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88b49f-1625-41a6-8e3b-a542169b3f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:30.907007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88b49f-1625-41a6-8e3b-a542169b3f7b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:30.907302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88b49f-1625-41a6-8e3b-a542169b3f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:30.907585 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88b49f-1625-41a6-8e3b-a542169b3f7b None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:30.908372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88b49f-1625-41a6-8e3b-a542169b3f7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:30.908689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88b49f-1625-41a6-8e3b-a542169b3f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:30.910073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88b49f-1625-41a6-8e3b-a542169b3f7b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:30.917956 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 40/78] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:54:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:30.918775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88b49f-1625-41a6-8e3b-a542169b3f7b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:30.974354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:30.982812 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208233a-780f-42eb-80c0-4bb1299d707a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:31.019012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbd942-6664-419e-a8a5-c567e394e9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:31.019406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88b49f-1625-41a6-8e3b-a542169b3f7b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:31.019806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbd942-6664-419e-a8a5-c567e394e9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:31.020097 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbd942-6664-419e-a8a5-c567e394e9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:31.020375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbd942-6664-419e-a8a5-c567e394e9e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:31.022227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:31.031973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbd942-6664-419e-a8a5-c567e394e9e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-88bbd942-6664-419e-a8a5-c567e394e9e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:31.039847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:31.040901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:31.041719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 39/79] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:31.042391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbd942-6664-419e-a8a5-c567e394e9e3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:31.056200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1cdb7-2b8f-4ab7-b017-d3d5e6e2459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:31.056939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1cdb7-2b8f-4ab7-b017-d3d5e6e2459b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:31.057230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1cdb7-2b8f-4ab7-b017-d3d5e6e2459b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:31.057514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1cdb7-2b8f-4ab7-b017-d3d5e6e2459b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:31.126108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1cdb7-2b8f-4ab7-b017-d3d5e6e2459b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:31.128300 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1cdb7-2b8f-4ab7-b017-d3d5e6e2459b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:31.139197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbd942-6664-419e-a8a5-c567e394e9e3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:31.171945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa7c42-f9be-49a1-8945-12d56eabbc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:31.172592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa7c42-f9be-49a1-8945-12d56eabbc12 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:31.172880 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa7c42-f9be-49a1-8945-12d56eabbc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:31.173170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa7c42-f9be-49a1-8945-12d56eabbc12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:31.181906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:31.226077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 41/80] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:31.227331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a2b22-69b5-45f7-a76a-4558407b1933 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:31.227625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a2b22-69b5-45f7-a76a-4558407b1933 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:31.227903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a2b22-69b5-45f7-a76a-4558407b1933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:31.242593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:31.243375 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-884a2b22-69b5-45f7-a76a-4558407b1933 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:31.244560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-884a2b22-69b5-45f7-a76a-4558407b1933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:31.250608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa7c42-f9be-49a1-8945-12d56eabbc12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:31.252572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa7c42-f9be-49a1-8945-12d56eabbc12 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:31.310505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 42/81] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:31.311264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a2b22-69b5-45f7-a76a-4558407b1933 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:31.357157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 40/82] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:31.357994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa7c42-f9be-49a1-8945-12d56eabbc12 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:31.394783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:31.410055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a2b22-69b5-45f7-a76a-4558407b1933 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:31.443679 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd69b6-17c5-43c3-95a6-7685c7e76893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:31.444551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd69b6-17c5-43c3-95a6-7685c7e76893 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:31.444870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd69b6-17c5-43c3-95a6-7685c7e76893 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:31.445152 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd69b6-17c5-43c3-95a6-7685c7e76893 None admin] PATH_INFO: `/v3/users/0c86a729247645e9904a177f85de34a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:31.446333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd69b6-17c5-43c3-95a6-7685c7e76893 None admin] RBAC: Authorizing `identity:get_user(user_id=0c86a729247645e9904a177f85de34a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:31.447803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd69b6-17c5-43c3-95a6-7685c7e76893 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:31.448421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:31.449692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 43/83] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:31 2022] GET /identity/v3/users/0c86a729247645e9904a177f85de34a2 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:31.450482 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd69b6-17c5-43c3-95a6-7685c7e76893 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:31.455829 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa7c42-f9be-49a1-8945-12d56eabbc12 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:31.491433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c5f21-4814-4980-9e81-881445426951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:31.492107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c5f21-4814-4980-9e81-881445426951 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:31.492395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c5f21-4814-4980-9e81-881445426951 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:31.492675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c5f21-4814-4980-9e81-881445426951 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:31.493429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c5f21-4814-4980-9e81-881445426951 None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:31.493740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c5f21-4814-4980-9e81-881445426951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:31.495142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c5f21-4814-4980-9e81-881445426951 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:31.503463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 41/84] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:31.504413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c5f21-4814-4980-9e81-881445426951 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:31.549658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd69b6-17c5-43c3-95a6-7685c7e76893 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:31.584035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728fba8-b619-49e8-9b84-6f66a02d2d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:31.584830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728fba8-b619-49e8-9b84-6f66a02d2d8f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:31.585119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728fba8-b619-49e8-9b84-6f66a02d2d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:31.585399 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728fba8-b619-49e8-9b84-6f66a02d2d8f None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:31.586619 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728fba8-b619-49e8-9b84-6f66a02d2d8f None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:31.588048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728fba8-b619-49e8-9b84-6f66a02d2d8f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:31.589794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 44/85] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:31 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:31.590560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728fba8-b619-49e8-9b84-6f66a02d2d8f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:31.606444 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c5f21-4814-4980-9e81-881445426951 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:31.616238 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:31.640824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dac5c4-8916-4b07-9981-ed484dd3c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:31.641615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dac5c4-8916-4b07-9981-ed484dd3c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:31.641903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dac5c4-8916-4b07-9981-ed484dd3c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:31.642190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dac5c4-8916-4b07-9981-ed484dd3c7b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:31.643612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dac5c4-8916-4b07-9981-ed484dd3c7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:31.645081 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dac5c4-8916-4b07-9981-ed484dd3c7b8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:31.646744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 42/86] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:31.647506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dac5c4-8916-4b07-9981-ed484dd3c7b8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:31.677495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:31.700701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728fba8-b619-49e8-9b84-6f66a02d2d8f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:31.734255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130f596-36e1-42ae-9536-ea6af69bc8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:31.735147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130f596-36e1-42ae-9536-ea6af69bc8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:31.735435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130f596-36e1-42ae-9536-ea6af69bc8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:31.735715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130f596-36e1-42ae-9536-ea6af69bc8c8 None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:31.737448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130f596-36e1-42ae-9536-ea6af69bc8c8 None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:31.738906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130f596-36e1-42ae-9536-ea6af69bc8c8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:31.740763 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 45/87] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:31 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:31.741405 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130f596-36e1-42ae-9536-ea6af69bc8c8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:31.751237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dac5c4-8916-4b07-9981-ed484dd3c7b8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:31.785721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d12e23-104b-4281-b8ee-bc510c0ea167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:31.786401 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d12e23-104b-4281-b8ee-bc510c0ea167 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:31.786695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d12e23-104b-4281-b8ee-bc510c0ea167 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:31.786972 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d12e23-104b-4281-b8ee-bc510c0ea167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:31.839745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:31.849919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130f596-36e1-42ae-9536-ea6af69bc8c8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:31.857578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d12e23-104b-4281-b8ee-bc510c0ea167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:31.859095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d12e23-104b-4281-b8ee-bc510c0ea167 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:31.883288 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:31.886331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115fa83-c311-4409-b224-d8af23b59003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:31.887242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115fa83-c311-4409-b224-d8af23b59003 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:31.887534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115fa83-c311-4409-b224-d8af23b59003 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:31.887811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115fa83-c311-4409-b224-d8af23b59003 None admin] PATH_INFO: `/v3/users/0c86a729247645e9904a177f85de34a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:31.888989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115fa83-c311-4409-b224-d8af23b59003 None admin] RBAC: Authorizing `identity:get_user(user_id=0c86a729247645e9904a177f85de34a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:31.890439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115fa83-c311-4409-b224-d8af23b59003 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:31.892052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 46/88] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:31 2022] GET /identity/v3/users/0c86a729247645e9904a177f85de34a2 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:31.896529 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115fa83-c311-4409-b224-d8af23b59003 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:31.958631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 43/89] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:31.959454 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d12e23-104b-4281-b8ee-bc510c0ea167 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:31.991684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115fa83-c311-4409-b224-d8af23b59003 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:32.025294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4893c7-d305-4993-b4a9-00a794f16df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:32.025951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4893c7-d305-4993-b4a9-00a794f16df4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:32.026241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4893c7-d305-4993-b4a9-00a794f16df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:32.026555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4893c7-d305-4993-b4a9-00a794f16df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:32.027393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4893c7-d305-4993-b4a9-00a794f16df4 None admin] RBAC: Adding query filter params (role.id=3027d01b9e8b469784a8db0de5f043bd, scope.project.id=18a4708787dc49b085266177f70c0577, user.id=0c86a729247645e9904a177f85de34a2) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:32.027713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4893c7-d305-4993-b4a9-00a794f16df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:32.029158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4893c7-d305-4993-b4a9-00a794f16df4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:32.037392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 47/90] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:31 2022] GET /identity/v3/role_assignments?user.id=0c86a729247645e9904a177f85de34a2&scope.project.id=18a4708787dc49b085266177f70c0577&role.id=3027d01b9e8b469784a8db0de5f043bd => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:32.037975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4893c7-d305-4993-b4a9-00a794f16df4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:32.061628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d12e23-104b-4281-b8ee-bc510c0ea167 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:32.090026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:32.091120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:32.104253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec021079-88cd-4792-9829-6ac82f3abf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:32.105060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec021079-88cd-4792-9829-6ac82f3abf69 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:32.105351 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec021079-88cd-4792-9829-6ac82f3abf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:32.105636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec021079-88cd-4792-9829-6ac82f3abf69 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:32.106410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec021079-88cd-4792-9829-6ac82f3abf69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:32.107903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec021079-88cd-4792-9829-6ac82f3abf69 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:32.150415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 44/91] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:54:31 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:54:32.150415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec021079-88cd-4792-9829-6ac82f3abf69 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:32.201601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4893c7-d305-4993-b4a9-00a794f16df4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:32.248744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605cb5c-f6f0-4d74-8e40-dadf09a497db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:32.249425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605cb5c-f6f0-4d74-8e40-dadf09a497db None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:32.249710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605cb5c-f6f0-4d74-8e40-dadf09a497db None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:32.249984 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605cb5c-f6f0-4d74-8e40-dadf09a497db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:32.250883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605cb5c-f6f0-4d74-8e40-dadf09a497db None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=18a4708787dc49b085266177f70c0577, user.id=c22f03b3c05b411a8e1b74bbae3a8adc) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:32.251239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605cb5c-f6f0-4d74-8e40-dadf09a497db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:32.252745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605cb5c-f6f0-4d74-8e40-dadf09a497db None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:32.259301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 48/92] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:32 2022] GET /identity/v3/role_assignments?user.id=c22f03b3c05b411a8e1b74bbae3a8adc&scope.project.id=18a4708787dc49b085266177f70c0577&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:32.267509 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605cb5c-f6f0-4d74-8e40-dadf09a497db None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:32.350587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec021079-88cd-4792-9829-6ac82f3abf69 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:32.404830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb25fe-d736-472d-854b-fc0793b22b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:32.405513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb25fe-d736-472d-854b-fc0793b22b36 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:32.405803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb25fe-d736-472d-854b-fc0793b22b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:32.406086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb25fe-d736-472d-854b-fc0793b22b36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:32.440866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:32.463064 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605cb5c-f6f0-4d74-8e40-dadf09a497db None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:32.489823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:32.513150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0385-1ede-4c56-9a5f-8e79ba8397b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:32.514024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0385-1ede-4c56-9a5f-8e79ba8397b1 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:32.514312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0385-1ede-4c56-9a5f-8e79ba8397b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:32.514619 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0385-1ede-4c56-9a5f-8e79ba8397b1 None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:32.516870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b0385-1ede-4c56-9a5f-8e79ba8397b1 None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:32.517264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b0385-1ede-4c56-9a5f-8e79ba8397b1 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:32.520696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 49/93] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:32 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:32.526161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0385-1ede-4c56-9a5f-8e79ba8397b1 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:32.535071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb25fe-d736-472d-854b-fc0793b22b36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:32.536578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb25fe-d736-472d-854b-fc0793b22b36 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:32.668128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 45/94] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:32.675011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0385-1ede-4c56-9a5f-8e79ba8397b1 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:32.675404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb25fe-d736-472d-854b-fc0793b22b36 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:32.737274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9271b9-471a-402a-8125-d8c8cb42a0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:32.737951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9271b9-471a-402a-8125-d8c8cb42a0de None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:32.738279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9271b9-471a-402a-8125-d8c8cb42a0de None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:32.739168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9271b9-471a-402a-8125-d8c8cb42a0de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:32.740035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9271b9-471a-402a-8125-d8c8cb42a0de None admin] RBAC: Adding query filter params (role.id=c4b17c7a2a644e91a1872f5fa53e6421, scope.project.id=18a4708787dc49b085266177f70c0577, user.id=0c86a729247645e9904a177f85de34a2) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:32.740355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9271b9-471a-402a-8125-d8c8cb42a0de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:32.742306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9271b9-471a-402a-8125-d8c8cb42a0de None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:32.749292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 50/95] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:32 2022] GET /identity/v3/role_assignments?user.id=0c86a729247645e9904a177f85de34a2&scope.project.id=18a4708787dc49b085266177f70c0577&role.id=c4b17c7a2a644e91a1872f5fa53e6421 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:32.798402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:32.830186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb25fe-d736-472d-854b-fc0793b22b36 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:32.874721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0127d4-9365-450d-8dca-4004c3bbeaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:32.875617 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0127d4-9365-450d-8dca-4004c3bbeaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:32.875898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0127d4-9365-450d-8dca-4004c3bbeaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:32.876182 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0127d4-9365-450d-8dca-4004c3bbeaf0 None admin] PATH_INFO: `/v3/projects/d24b82e885b44d6facd31358969d647c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:32.878087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0127d4-9365-450d-8dca-4004c3bbeaf0 None admin] RBAC: Authorizing `identity:get_project(project_id=d24b82e885b44d6facd31358969d647c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:32.879899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0127d4-9365-450d-8dca-4004c3bbeaf0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:32.882096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 46/96] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:32 2022] GET /identity/v3/projects/d24b82e885b44d6facd31358969d647c => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:32.891530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9271b9-471a-402a-8125-d8c8cb42a0de None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:32.922746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:33.023380 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9271b9-471a-402a-8125-d8c8cb42a0de None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:33.065818 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481e04-b666-4814-8a76-850ee878a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:33.066529 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481e04-b666-4814-8a76-850ee878a30f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:33.066825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481e04-b666-4814-8a76-850ee878a30f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:33.067114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481e04-b666-4814-8a76-850ee878a30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:33.067968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481e04-b666-4814-8a76-850ee878a30f None admin] RBAC: Adding query filter params (role.id=3027d01b9e8b469784a8db0de5f043bd, scope.project.id=d24b82e885b44d6facd31358969d647c, user.id=0c86a729247645e9904a177f85de34a2) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:33.068287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481e04-b666-4814-8a76-850ee878a30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:33.069736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481e04-b666-4814-8a76-850ee878a30f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:33.076163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 51/97] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:32 2022] GET /identity/v3/role_assignments?user.id=0c86a729247645e9904a177f85de34a2&scope.project.id=d24b82e885b44d6facd31358969d647c&role.id=3027d01b9e8b469784a8db0de5f043bd => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:35.414169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff4de-654a-4161-9d34-5f5da3014d0b None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:35.415144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff4de-654a-4161-9d34-5f5da3014d0b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:35.415591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff4de-654a-4161-9d34-5f5da3014d0b None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:35.417198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 47/98] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:35.423252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000f48f-cdab-4bc2-b196-f2c7b77cb5f1 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:35.424636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000f48f-cdab-4bc2-b196-f2c7b77cb5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:35.425085 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000f48f-cdab-4bc2-b196-f2c7b77cb5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:35.444328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b022091-23c0-4dab-95ab-73c5a5391174 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:35.444884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b022091-23c0-4dab-95ab-73c5a5391174 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:35.445319 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b022091-23c0-4dab-95ab-73c5a5391174 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:35.447690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 48/99] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:35.454520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67178ba3-a227-400f-a53f-69008b0001ae None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:35.455532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67178ba3-a227-400f-a53f-69008b0001ae None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:35.456257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67178ba3-a227-400f-a53f-69008b0001ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:35.457116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6000f48f-cdab-4bc2-b196-f2c7b77cb5f1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:35.458329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6000f48f-cdab-4bc2-b196-f2c7b77cb5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:35.482760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-67178ba3-a227-400f-a53f-69008b0001ae None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:35.484370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-67178ba3-a227-400f-a53f-69008b0001ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:35.552683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 52/100] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:35.583889 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 49/101] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:35.587061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000f48f-cdab-4bc2-b196-f2c7b77cb5f1 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:35.615341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:35.637263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67178ba3-a227-400f-a53f-69008b0001ae None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:35.727870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000f48f-cdab-4bc2-b196-f2c7b77cb5f1 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:35.762020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:35.768461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afa087-1ed1-4b91-a7fd-638d8cae74c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:35.769806 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afa087-1ed1-4b91-a7fd-638d8cae74c3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:35.770310 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afa087-1ed1-4b91-a7fd-638d8cae74c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:35.770844 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afa087-1ed1-4b91-a7fd-638d8cae74c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:35.789260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afa087-1ed1-4b91-a7fd-638d8cae74c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:35.795822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67178ba3-a227-400f-a53f-69008b0001ae None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-21afa087-1ed1-4b91-a7fd-638d8cae74c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:35.798794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:35.799951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:35.800756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:35.800756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:35.800756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:35.800756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:35.800756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:35.800756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:35.800756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:35.800756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:35.800756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:35.800756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:35.800756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:35.800756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:54:35.803830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 53/102] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:54:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:35.805549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf6b0b-0112-4b0e-95f1-5fa42b5ea0ea None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:35.806075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf6b0b-0112-4b0e-95f1-5fa42b5ea0ea None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:35.806616 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf6b0b-0112-4b0e-95f1-5fa42b5ea0ea None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:35.808174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 54/103] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:35.809510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899d0fa-d51f-4719-85d1-30a6f62b7356 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:35.810059 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899d0fa-d51f-4719-85d1-30a6f62b7356 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:35.810595 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899d0fa-d51f-4719-85d1-30a6f62b7356 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:35.812116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 55/104] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:35.813061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899d0fa-d51f-4719-85d1-30a6f62b7356 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:35.848645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d698d9-abbb-476a-9e42-b104b7a2a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:35.850114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d698d9-abbb-476a-9e42-b104b7a2a1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:35.850443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d698d9-abbb-476a-9e42-b104b7a2a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:35.850728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d698d9-abbb-476a-9e42-b104b7a2a1b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:35.865335 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d698d9-abbb-476a-9e42-b104b7a2a1b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-d7d698d9-abbb-476a-9e42-b104b7a2a1b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:35.875892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:35.877481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:35.878331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 50/105] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:35.879710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a0a33-87b4-4b97-be11-ed6d7fec20e6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:35.882635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a0a33-87b4-4b97-be11-ed6d7fec20e6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:35.882635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a0a33-87b4-4b97-be11-ed6d7fec20e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:35.905583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:35.906988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e28a0a33-87b4-4b97-be11-ed6d7fec20e6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:35.908344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e28a0a33-87b4-4b97-be11-ed6d7fec20e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:35.940397 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899d0fa-d51f-4719-85d1-30a6f62b7356 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:35.977621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9b3c8-12c7-4b86-8a61-435be37f30cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:35.978499 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b3c8-12c7-4b86-8a61-435be37f30cc None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:35.978804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b3c8-12c7-4b86-8a61-435be37f30cc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:35.979155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b3c8-12c7-4b86-8a61-435be37f30cc None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:35.979980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9b3c8-12c7-4b86-8a61-435be37f30cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:35.980540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9b3c8-12c7-4b86-8a61-435be37f30cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:35.981998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9b3c8-12c7-4b86-8a61-435be37f30cc None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:35.991312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 56/106] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:35.992678 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66315-623f-4e23-96c1-8ccf5514dd80 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:35.993040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66315-623f-4e23-96c1-8ccf5514dd80 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:35.993398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66315-623f-4e23-96c1-8ccf5514dd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:35.998325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 51/107] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:35.999143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a0a33-87b4-4b97-be11-ed6d7fec20e6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:36.026721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-22d66315-623f-4e23-96c1-8ccf5514dd80 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:36.028078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-22d66315-623f-4e23-96c1-8ccf5514dd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:36.089104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:36.116266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 57/108] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:36.117230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d66315-623f-4e23-96c1-8ccf5514dd80 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:36.149872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a0a33-87b4-4b97-be11-ed6d7fec20e6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:36.195487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:36.199293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c186db-b9c0-4a65-9ad8-f46d75a9d45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:36.199969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c186db-b9c0-4a65-9ad8-f46d75a9d45e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:36.200410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c186db-b9c0-4a65-9ad8-f46d75a9d45e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:36.200748 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c186db-b9c0-4a65-9ad8-f46d75a9d45e None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:36.202740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c186db-b9c0-4a65-9ad8-f46d75a9d45e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:36.203061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c186db-b9c0-4a65-9ad8-f46d75a9d45e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:36.204826 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c186db-b9c0-4a65-9ad8-f46d75a9d45e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:36.216430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 52/109] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:36.217317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c186db-b9c0-4a65-9ad8-f46d75a9d45e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:36.238923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d66315-623f-4e23-96c1-8ccf5514dd80 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:36.276241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1e1c4-d8e3-4bc6-bfe9-8c39291d9f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:36.277134 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1e1c4-d8e3-4bc6-bfe9-8c39291d9f65 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:36.277415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1e1c4-d8e3-4bc6-bfe9-8c39291d9f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:36.277687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1e1c4-d8e3-4bc6-bfe9-8c39291d9f65 None admin] PATH_INFO: `/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:36.278928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1e1c4-d8e3-4bc6-bfe9-8c39291d9f65 None admin] RBAC: Authorizing `identity:get_user(user_id=c22f03b3c05b411a8e1b74bbae3a8adc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:36.280393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1e1c4-d8e3-4bc6-bfe9-8c39291d9f65 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:36.282032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 58/110] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:36 2022] GET /identity/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:36.282814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1e1c4-d8e3-4bc6-bfe9-8c39291d9f65 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:36.334138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c186db-b9c0-4a65-9ad8-f46d75a9d45e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:36.365510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:36.372558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352f72c-f838-4015-a5b5-0158d59de6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:36.373729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352f72c-f838-4015-a5b5-0158d59de6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:36.374029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352f72c-f838-4015-a5b5-0158d59de6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:36.374305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352f72c-f838-4015-a5b5-0158d59de6c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:36.385258 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352f72c-f838-4015-a5b5-0158d59de6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:36.385403 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1e1c4-d8e3-4bc6-bfe9-8c39291d9f65 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-e352f72c-f838-4015-a5b5-0158d59de6c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:36.393798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:36.394902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:36.395821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 53/111] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:36.398717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c9e9a-57fb-45b5-97c8-0fd6b73134ac None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:36.399016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c9e9a-57fb-45b5-97c8-0fd6b73134ac None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:36.399300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c9e9a-57fb-45b5-97c8-0fd6b73134ac None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:36.400779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 54/112] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:36.404779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c9e9a-57fb-45b5-97c8-0fd6b73134ac None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:36.424990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:36.430963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2495942-b0fe-4714-9c4a-7e6817d66882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:36.431770 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2495942-b0fe-4714-9c4a-7e6817d66882 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:36.432052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2495942-b0fe-4714-9c4a-7e6817d66882 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:36.432332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2495942-b0fe-4714-9c4a-7e6817d66882 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:36.433528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2495942-b0fe-4714-9c4a-7e6817d66882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:36.435019 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2495942-b0fe-4714-9c4a-7e6817d66882 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:36.436633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 59/113] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:36.437393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2495942-b0fe-4714-9c4a-7e6817d66882 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:36.515453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c9e9a-57fb-45b5-97c8-0fd6b73134ac None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:36.538927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2495942-b0fe-4714-9c4a-7e6817d66882 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:36.549772 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b792e6b-1bc1-4a59-87a4-c4cf7c0551bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:36.550670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b792e6b-1bc1-4a59-87a4-c4cf7c0551bf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:36.550962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b792e6b-1bc1-4a59-87a4-c4cf7c0551bf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:36.551240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b792e6b-1bc1-4a59-87a4-c4cf7c0551bf None admin] PATH_INFO: `/v3/users/cef261d846ed44cf99cfccc8155f673d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:36.564922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b792e6b-1bc1-4a59-87a4-c4cf7c0551bf None admin] RBAC: Authorizing `identity:get_user(user_id=cef261d846ed44cf99cfccc8155f673d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:36.566642 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b792e6b-1bc1-4a59-87a4-c4cf7c0551bf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:36.568274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 55/114] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:36 2022] GET /identity/v3/users/cef261d846ed44cf99cfccc8155f673d => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:36.572497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceedf1-2003-48dc-a710-f856292f6c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:36.573362 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceedf1-2003-48dc-a710-f856292f6c2a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:36.573459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b792e6b-1bc1-4a59-87a4-c4cf7c0551bf None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:36.573658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceedf1-2003-48dc-a710-f856292f6c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:36.574188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceedf1-2003-48dc-a710-f856292f6c2a None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:36.575416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ceedf1-2003-48dc-a710-f856292f6c2a None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:36.576852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ceedf1-2003-48dc-a710-f856292f6c2a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:36.578577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 60/115] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:36 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:36.579711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf361ca-8811-49ad-a3ac-f674a02c5b52 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:36.580076 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf361ca-8811-49ad-a3ac-f674a02c5b52 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:36.580361 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf361ca-8811-49ad-a3ac-f674a02c5b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:36.597220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9cf361ca-8811-49ad-a3ac-f674a02c5b52 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:36.598448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9cf361ca-8811-49ad-a3ac-f674a02c5b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:36.622833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:36.661336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:36.667279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 61/116] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:36.668381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040acf6d-fa78-47a0-b99a-37a2df589874 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:36.668666 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040acf6d-fa78-47a0-b99a-37a2df589874 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:36.668945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040acf6d-fa78-47a0-b99a-37a2df589874 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:36.670464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 62/117] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:36.671153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040acf6d-fa78-47a0-b99a-37a2df589874 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:36.681079 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b792e6b-1bc1-4a59-87a4-c4cf7c0551bf None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:36.716057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670f271-73f4-41c7-9ea4-4d8df09dd646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:36.716956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670f271-73f4-41c7-9ea4-4d8df09dd646 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:36.717240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670f271-73f4-41c7-9ea4-4d8df09dd646 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:36.717520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670f271-73f4-41c7-9ea4-4d8df09dd646 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:36.718271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670f271-73f4-41c7-9ea4-4d8df09dd646 None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:36.718606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670f271-73f4-41c7-9ea4-4d8df09dd646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:36.719973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670f271-73f4-41c7-9ea4-4d8df09dd646 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:36.728310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 56/118] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:36.729022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670f271-73f4-41c7-9ea4-4d8df09dd646 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:36.778759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040acf6d-fa78-47a0-b99a-37a2df589874 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:36.814962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcc47f-3370-45b7-852f-307b1bb621cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:36.815626 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcc47f-3370-45b7-852f-307b1bb621cf None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:36.815914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcc47f-3370-45b7-852f-307b1bb621cf None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:36.816194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcc47f-3370-45b7-852f-307b1bb621cf None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:36.816956 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcc47f-3370-45b7-852f-307b1bb621cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:36.818435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcc47f-3370-45b7-852f-307b1bb621cf None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:36.830802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670f271-73f4-41c7-9ea4-4d8df09dd646 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:36.841278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:36.844081 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 63/119] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:54:36 2022] POST /identity/v3/projects => generated 302 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:54:36.845044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcc47f-3370-45b7-852f-307b1bb621cf None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:36.879637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730a0b2-3ac3-40e5-a5ca-4d3cecdd3ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:36.880317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730a0b2-3ac3-40e5-a5ca-4d3cecdd3ccb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:36.880611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730a0b2-3ac3-40e5-a5ca-4d3cecdd3ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:36.880891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730a0b2-3ac3-40e5-a5ca-4d3cecdd3ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:36.919559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:36.965006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730a0b2-3ac3-40e5-a5ca-4d3cecdd3ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:36.966968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730a0b2-3ac3-40e5-a5ca-4d3cecdd3ccb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:36.978808 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcc47f-3370-45b7-852f-307b1bb621cf None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:37.017305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab954e8-efbc-483f-b02d-c711d96f54cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:37.018406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab954e8-efbc-483f-b02d-c711d96f54cb None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:37.018700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab954e8-efbc-483f-b02d-c711d96f54cb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:37.018986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab954e8-efbc-483f-b02d-c711d96f54cb None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577/users/c22f03b3c05b411a8e1b74bbae3a8adc/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:37.020981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab954e8-efbc-483f-b02d-c711d96f54cb None admin] RBAC: Authorizing `identity:create_grant(project_id=18a4708787dc49b085266177f70c0577, user_id=c22f03b3c05b411a8e1b74bbae3a8adc, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:37.022445 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab954e8-efbc-483f-b02d-c711d96f54cb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:37.036770 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 64/120] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:54:36 2022] PUT /identity/v3/projects/18a4708787dc49b085266177f70c0577/users/c22f03b3c05b411a8e1b74bbae3a8adc/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:54:37.037955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b3c4-7e77-4771-bfc3-d8c17479d74e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:37.038313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b3c4-7e77-4771-bfc3-d8c17479d74e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:37.038637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b3c4-7e77-4771-bfc3-d8c17479d74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:37.058200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8f34b3c4-7e77-4771-bfc3-d8c17479d74e None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:37.059498 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8f34b3c4-7e77-4771-bfc3-d8c17479d74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:37.091942 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 57/121] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:37.092927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730a0b2-3ac3-40e5-a5ca-4d3cecdd3ccb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:37.106817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:37.168536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 65/122] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:37.169236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34b3c4-7e77-4771-bfc3-d8c17479d74e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:37.228422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730a0b2-3ac3-40e5-a5ca-4d3cecdd3ccb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:37.232756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:37.275859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82dc41-b726-4e4b-a22f-1d614f03e2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:37.276716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82dc41-b726-4e4b-a22f-1d614f03e2da None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:37.277553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82dc41-b726-4e4b-a22f-1d614f03e2da None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:37.277841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82dc41-b726-4e4b-a22f-1d614f03e2da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:37.293471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82dc41-b726-4e4b-a22f-1d614f03e2da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:37.304172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34b3c4-7e77-4771-bfc3-d8c17479d74e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-af82dc41-b726-4e4b-a22f-1d614f03e2da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:37.304697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:37.305638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:37.306471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 58/123] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:37.308478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82dc41-b726-4e4b-a22f-1d614f03e2da None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:37.344180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4128-5782-428e-bdaa-49fe5afe3307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:37.345193 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4128-5782-428e-bdaa-49fe5afe3307 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:37.346009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4128-5782-428e-bdaa-49fe5afe3307 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:37.346622 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4128-5782-428e-bdaa-49fe5afe3307 None admin] PATH_INFO: `/v3/users/0c86a729247645e9904a177f85de34a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:37.347921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e4128-5782-428e-bdaa-49fe5afe3307 None admin] RBAC: Authorizing `identity:get_user(user_id=0c86a729247645e9904a177f85de34a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:37.349460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e4128-5782-428e-bdaa-49fe5afe3307 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:37.351336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 66/124] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:37 2022] GET /identity/v3/users/0c86a729247645e9904a177f85de34a2 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:37.351925 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4128-5782-428e-bdaa-49fe5afe3307 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:37.399414 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:37.444234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82dc41-b726-4e4b-a22f-1d614f03e2da None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:37.461262 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4128-5782-428e-bdaa-49fe5afe3307 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:37.472119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:37.495527 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf0b9e-b841-48a0-921a-51477409223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:37.497311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf0b9e-b841-48a0-921a-51477409223f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:37.498056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf0b9e-b841-48a0-921a-51477409223f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:37.498583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf0b9e-b841-48a0-921a-51477409223f None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:37.499993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf0b9e-b841-48a0-921a-51477409223f None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:37.501588 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf0b9e-b841-48a0-921a-51477409223f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:37.502945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178b35d-5709-44a1-83ea-211df6f46e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:37.503951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178b35d-5709-44a1-83ea-211df6f46e2b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:37.509226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 59/125] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:37 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:37.509226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf0b9e-b841-48a0-921a-51477409223f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:37.510045 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178b35d-5709-44a1-83ea-211df6f46e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:37.510600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178b35d-5709-44a1-83ea-211df6f46e2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:37.522743 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178b35d-5709-44a1-83ea-211df6f46e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-4178b35d-5709-44a1-83ea-211df6f46e2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:37.531203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:37.532090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 67/126] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:54:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:37.533645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178b35d-5709-44a1-83ea-211df6f46e2b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:37.618327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf0b9e-b841-48a0-921a-51477409223f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:37.658221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4d490-29ee-49be-9abc-bbae8e0ca18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:37.659074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4d490-29ee-49be-9abc-bbae8e0ca18a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:37.659372 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4d490-29ee-49be-9abc-bbae8e0ca18a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:37.659656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4d490-29ee-49be-9abc-bbae8e0ca18a None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:37.660422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4d490-29ee-49be-9abc-bbae8e0ca18a None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:37.660737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4d490-29ee-49be-9abc-bbae8e0ca18a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:37.661128 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178b35d-5709-44a1-83ea-211df6f46e2b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:37.662117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4d490-29ee-49be-9abc-bbae8e0ca18a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:37.667783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:37.672360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 60/127] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:37.674678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4d490-29ee-49be-9abc-bbae8e0ca18a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:37.702375 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da47b4-53b9-4246-924e-63d7d3537bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:37.703316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da47b4-53b9-4246-924e-63d7d3537bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:37.703603 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da47b4-53b9-4246-924e-63d7d3537bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:37.703929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da47b4-53b9-4246-924e-63d7d3537bb2 None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:37.706012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da47b4-53b9-4246-924e-63d7d3537bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:37.707644 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da47b4-53b9-4246-924e-63d7d3537bb2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:37.709397 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 68/128] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:37 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:37.710201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da47b4-53b9-4246-924e-63d7d3537bb2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:37.747088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:37.796045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4d490-29ee-49be-9abc-bbae8e0ca18a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:37.816608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da47b4-53b9-4246-924e-63d7d3537bb2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:37.836245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ead67-ef5f-4240-a1f8-c4f0e34f5bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:37.837167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ead67-ef5f-4240-a1f8-c4f0e34f5bcf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:37.837657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ead67-ef5f-4240-a1f8-c4f0e34f5bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:37.838114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ead67-ef5f-4240-a1f8-c4f0e34f5bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:37.839142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ead67-ef5f-4240-a1f8-c4f0e34f5bcf None admin] RBAC: Adding query filter params (role.id=ccb4819e599749909ff92aedeeb810fd, scope.project.id=18a4708787dc49b085266177f70c0577, user.id=cef261d846ed44cf99cfccc8155f673d) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:37.839608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ead67-ef5f-4240-a1f8-c4f0e34f5bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:37.841396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ead67-ef5f-4240-a1f8-c4f0e34f5bcf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:37.847994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 61/129] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:37 2022] GET /identity/v3/role_assignments?user.id=cef261d846ed44cf99cfccc8155f673d&scope.project.id=18a4708787dc49b085266177f70c0577&role.id=ccb4819e599749909ff92aedeeb810fd => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:37.849113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ead67-ef5f-4240-a1f8-c4f0e34f5bcf None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:37.860862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087893b-6e17-45df-a4d9-e2f3a4b6b940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:37.862427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087893b-6e17-45df-a4d9-e2f3a4b6b940 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:37.862752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087893b-6e17-45df-a4d9-e2f3a4b6b940 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:37.863030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087893b-6e17-45df-a4d9-e2f3a4b6b940 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:37.863926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087893b-6e17-45df-a4d9-e2f3a4b6b940 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:37.864108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087893b-6e17-45df-a4d9-e2f3a4b6b940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:37.865687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087893b-6e17-45df-a4d9-e2f3a4b6b940 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:37.883078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 69/130] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:54:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:37.883658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087893b-6e17-45df-a4d9-e2f3a4b6b940 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:37.950076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:38.037422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ead67-ef5f-4240-a1f8-c4f0e34f5bcf None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:38.096595 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:38.104071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087893b-6e17-45df-a4d9-e2f3a4b6b940 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:38.112570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c83a05-3eac-4026-be2d-a2aef76d60ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:38.113811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c83a05-3eac-4026-be2d-a2aef76d60ed None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:38.114805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c83a05-3eac-4026-be2d-a2aef76d60ed None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:38.115291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c83a05-3eac-4026-be2d-a2aef76d60ed None admin] PATH_INFO: `/v3/users/0c86a729247645e9904a177f85de34a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:38.117222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c83a05-3eac-4026-be2d-a2aef76d60ed None admin] RBAC: Authorizing `identity:get_user(user_id=0c86a729247645e9904a177f85de34a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:38.118912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c83a05-3eac-4026-be2d-a2aef76d60ed None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:38.120778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 62/131] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:37 2022] GET /identity/v3/users/0c86a729247645e9904a177f85de34a2 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:38.121757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c83a05-3eac-4026-be2d-a2aef76d60ed None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:38.211290 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5911a-c614-4acf-a29b-a30cffa1f7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:38.212150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5911a-c614-4acf-a29b-a30cffa1f7ff None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:38.212445 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5911a-c614-4acf-a29b-a30cffa1f7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:38.212733 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5911a-c614-4acf-a29b-a30cffa1f7ff None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577/users/0c86a729247645e9904a177f85de34a2/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:38.215204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5911a-c614-4acf-a29b-a30cffa1f7ff None admin] RBAC: Authorizing `identity:create_grant(project_id=18a4708787dc49b085266177f70c0577, user_id=0c86a729247645e9904a177f85de34a2, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:38.216702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5911a-c614-4acf-a29b-a30cffa1f7ff None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:38.234221 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 70/132] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:54:37 2022] PUT /identity/v3/projects/18a4708787dc49b085266177f70c0577/users/0c86a729247645e9904a177f85de34a2/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:54:38.239289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5911a-c614-4acf-a29b-a30cffa1f7ff None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:38.259453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c83a05-3eac-4026-be2d-a2aef76d60ed None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:38.298460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:38.305453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bfe69-d3ac-401a-a4b2-b1ff96f9374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:38.306846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bfe69-d3ac-401a-a4b2-b1ff96f9374d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:38.307338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bfe69-d3ac-401a-a4b2-b1ff96f9374d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:38.307824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bfe69-d3ac-401a-a4b2-b1ff96f9374d None admin] PATH_INFO: `/v3/users/0c86a729247645e9904a177f85de34a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:38.309281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bfe69-d3ac-401a-a4b2-b1ff96f9374d None admin] RBAC: Authorizing `identity:get_user(user_id=0c86a729247645e9904a177f85de34a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:38.310991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bfe69-d3ac-401a-a4b2-b1ff96f9374d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:38.312931 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 63/133] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:38 2022] GET /identity/v3/users/0c86a729247645e9904a177f85de34a2 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:38.323599 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bfe69-d3ac-401a-a4b2-b1ff96f9374d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:38.450056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5911a-c614-4acf-a29b-a30cffa1f7ff None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:38.540187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bfe69-d3ac-401a-a4b2-b1ff96f9374d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:38.555088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e83d22-61c1-4e32-b536-475d2a935c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:38.555984 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e83d22-61c1-4e32-b536-475d2a935c09 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:38.556279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e83d22-61c1-4e32-b536-475d2a935c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:38.556570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e83d22-61c1-4e32-b536-475d2a935c09 None admin] PATH_INFO: `/v3/projects/d24b82e885b44d6facd31358969d647c` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:38.557914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e83d22-61c1-4e32-b536-475d2a935c09 None admin] RBAC: Authorizing `identity:get_project(project_id=d24b82e885b44d6facd31358969d647c)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:38.559457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e83d22-61c1-4e32-b536-475d2a935c09 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:38.561098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 71/134] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:38 2022] GET /identity/v3/projects/d24b82e885b44d6facd31358969d647c => generated 312 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:38.567945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e83d22-61c1-4e32-b536-475d2a935c09 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:38.582481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729a932-66fb-42a6-970f-0d8d85efa84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:38.583687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729a932-66fb-42a6-970f-0d8d85efa84b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:38.584173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729a932-66fb-42a6-970f-0d8d85efa84b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:38.584639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729a932-66fb-42a6-970f-0d8d85efa84b None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:38.586111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729a932-66fb-42a6-970f-0d8d85efa84b None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:38.587802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729a932-66fb-42a6-970f-0d8d85efa84b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:38.589768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 64/135] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:38 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:38.597813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729a932-66fb-42a6-970f-0d8d85efa84b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:38.614228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:38.730991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:38.780821 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e83d22-61c1-4e32-b536-475d2a935c09 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:38.826486 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729a932-66fb-42a6-970f-0d8d85efa84b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:38.887118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc090-62f2-4c16-8dc7-16aa42a61ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:38.888054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc090-62f2-4c16-8dc7-16aa42a61ae4 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:38.888350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc090-62f2-4c16-8dc7-16aa42a61ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:38.888661 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc090-62f2-4c16-8dc7-16aa42a61ae4 None admin] PATH_INFO: `/v3/projects/d24b82e885b44d6facd31358969d647c/users/0c86a729247645e9904a177f85de34a2/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:38.895233 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc090-62f2-4c16-8dc7-16aa42a61ae4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d24b82e885b44d6facd31358969d647c, user_id=0c86a729247645e9904a177f85de34a2, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:38.896718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc090-62f2-4c16-8dc7-16aa42a61ae4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:38.926698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 72/136] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:54:38 2022] PUT /identity/v3/projects/d24b82e885b44d6facd31358969d647c/users/0c86a729247645e9904a177f85de34a2/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:54:38.928843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898828-f28b-4c54-99ef-28bbd3ace62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:38.929777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898828-f28b-4c54-99ef-28bbd3ace62e None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:38.930067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898828-f28b-4c54-99ef-28bbd3ace62e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:38.930353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898828-f28b-4c54-99ef-28bbd3ace62e None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577/users/0c86a729247645e9904a177f85de34a2/roles/c4b17c7a2a644e91a1872f5fa53e6421` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:38.936601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38898828-f28b-4c54-99ef-28bbd3ace62e None admin] RBAC: Authorizing `identity:create_grant(project_id=18a4708787dc49b085266177f70c0577, user_id=0c86a729247645e9904a177f85de34a2, role_id=c4b17c7a2a644e91a1872f5fa53e6421)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:38.938160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38898828-f28b-4c54-99ef-28bbd3ace62e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:38.976871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 65/137] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:54:38 2022] PUT /identity/v3/projects/18a4708787dc49b085266177f70c0577/users/0c86a729247645e9904a177f85de34a2/roles/c4b17c7a2a644e91a1872f5fa53e6421 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:54:39.716518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95688900-e843-4571-9d75-46adce8c448b None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:39.717053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95688900-e843-4571-9d75-46adce8c448b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:39.717154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95688900-e843-4571-9d75-46adce8c448b None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:39.718485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 73/138] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:39.729738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81b5ff-fed7-406f-b708-c7fc150a2ab7 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:39.730052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81b5ff-fed7-406f-b708-c7fc150a2ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:39.730325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81b5ff-fed7-406f-b708-c7fc150a2ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:39.755606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ee81b5ff-fed7-406f-b708-c7fc150a2ab7 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:39.756857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ee81b5ff-fed7-406f-b708-c7fc150a2ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:39.851778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 66/139] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:39.896240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95688900-e843-4571-9d75-46adce8c448b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:40.034762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:40.060549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95688900-e843-4571-9d75-46adce8c448b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:40.076918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd20bc-5ab2-4354-8786-9495d58c0224 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:40.077209 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd20bc-5ab2-4354-8786-9495d58c0224 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:40.077484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd20bc-5ab2-4354-8786-9495d58c0224 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:40.079044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 67/140] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:40.086924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620ccc-b103-4b0d-b6a6-87b069f46aa1 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:40.087205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620ccc-b103-4b0d-b6a6-87b069f46aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:40.087486 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620ccc-b103-4b0d-b6a6-87b069f46aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:40.118804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5d620ccc-b103-4b0d-b6a6-87b069f46aa1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:40.119994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5d620ccc-b103-4b0d-b6a6-87b069f46aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:40.130132 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe082d-eb35-45b3-990c-81ff24c5ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:40.130963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe082d-eb35-45b3-990c-81ff24c5ee03 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:40.131251 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe082d-eb35-45b3-990c-81ff24c5ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:40.131542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe082d-eb35-45b3-990c-81ff24c5ee03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:40.153520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe082d-eb35-45b3-990c-81ff24c5ee03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-aabe082d-eb35-45b3-990c-81ff24c5ee03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:40.166385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:40.167282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:54:40.168066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 74/141] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:54:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:40.170561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe082d-eb35-45b3-990c-81ff24c5ee03 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:40.225513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:40.249575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 68/142] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:40.296635 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe082d-eb35-45b3-990c-81ff24c5ee03 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:40.340859 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398fc1e-98a5-4747-9b97-c6deca364a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:40.341816 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398fc1e-98a5-4747-9b97-c6deca364a72 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:40.342436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398fc1e-98a5-4747-9b97-c6deca364a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:40.342853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398fc1e-98a5-4747-9b97-c6deca364a72 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:40.343770 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398fc1e-98a5-4747-9b97-c6deca364a72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:40.344216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398fc1e-98a5-4747-9b97-c6deca364a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:40.346310 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398fc1e-98a5-4747-9b97-c6deca364a72 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:40.360644 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 75/143] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:40.367026 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620ccc-b103-4b0d-b6a6-87b069f46aa1 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:40.367183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398fc1e-98a5-4747-9b97-c6deca364a72 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:40.382837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:40.481325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398fc1e-98a5-4747-9b97-c6deca364a72 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:40.519546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e0166-f2eb-4099-b4d5-9fdb1812aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:40.520472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e0166-f2eb-4099-b4d5-9fdb1812aa1a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:40.520759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e0166-f2eb-4099-b4d5-9fdb1812aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:40.521034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e0166-f2eb-4099-b4d5-9fdb1812aa1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:40.522213 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e0166-f2eb-4099-b4d5-9fdb1812aa1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:40.523783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e0166-f2eb-4099-b4d5-9fdb1812aa1a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:40.525712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 76/144] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:40.530908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e0166-f2eb-4099-b4d5-9fdb1812aa1a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:40.559892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620ccc-b103-4b0d-b6a6-87b069f46aa1 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:40.616333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:40.632494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785ad67-eeb0-4817-a7d6-4edd4927455e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:40.633686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ad67-eeb0-4817-a7d6-4edd4927455e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:40.634130 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ad67-eeb0-4817-a7d6-4edd4927455e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:40.634593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ad67-eeb0-4817-a7d6-4edd4927455e None admin] PATH_INFO: `/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:40.636150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785ad67-eeb0-4817-a7d6-4edd4927455e None admin] RBAC: Authorizing `identity:get_user(user_id=c22f03b3c05b411a8e1b74bbae3a8adc)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:40.637915 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785ad67-eeb0-4817-a7d6-4edd4927455e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:40.640176 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 69/145] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:40 2022] GET /identity/v3/users/c22f03b3c05b411a8e1b74bbae3a8adc => generated 247 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:40.641404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e0166-f2eb-4099-b4d5-9fdb1812aa1a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:40.651853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785ad67-eeb0-4817-a7d6-4edd4927455e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:40.683911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25218cd4-f3ae-418c-ac29-675abb8e10ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:40.684588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25218cd4-f3ae-418c-ac29-675abb8e10ce None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:40.684928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25218cd4-f3ae-418c-ac29-675abb8e10ce None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:40.685205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25218cd4-f3ae-418c-ac29-675abb8e10ce None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:40.685969 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25218cd4-f3ae-418c-ac29-675abb8e10ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:40.687637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25218cd4-f3ae-418c-ac29-675abb8e10ce None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:40.717461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 77/146] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:54:40 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:54:40.751956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:40.763075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccd2f4-c694-41cc-aa17-926b042c32d8 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:40.763386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccd2f4-c694-41cc-aa17-926b042c32d8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:40.763696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccd2f4-c694-41cc-aa17-926b042c32d8 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:40.765591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 78/147] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:54:40.785961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11dde5-990f-4409-b665-7be6ac947a78 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:40.786286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11dde5-990f-4409-b665-7be6ac947a78 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:40.786566 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11dde5-990f-4409-b665-7be6ac947a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:40.818154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ee11dde5-990f-4409-b665-7be6ac947a78 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:40.820705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ee11dde5-990f-4409-b665-7be6ac947a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:40.851646 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785ad67-eeb0-4817-a7d6-4edd4927455e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:40.917216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0270b-fc3b-4b06-92e8-f9d6407ac268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:40.917894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0270b-fc3b-4b06-92e8-f9d6407ac268 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:40.918181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0270b-fc3b-4b06-92e8-f9d6407ac268 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:40.918498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0270b-fc3b-4b06-92e8-f9d6407ac268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:40.971156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 79/148] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:40.996843 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11dde5-990f-4409-b665-7be6ac947a78 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:41.041756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0270b-fc3b-4b06-92e8-f9d6407ac268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:41.043270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0270b-fc3b-4b06-92e8-f9d6407ac268 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:41.115410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:41.129059 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:41.167078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 70/149] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:41.175495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0270b-fc3b-4b06-92e8-f9d6407ac268 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:41.232429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11dde5-990f-4409-b665-7be6ac947a78 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:41.284457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0270b-fc3b-4b06-92e8-f9d6407ac268 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:41.302469 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8910e-aeed-43fd-87cc-ec22788b32c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:41.303377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8910e-aeed-43fd-87cc-ec22788b32c3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:41.303667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8910e-aeed-43fd-87cc-ec22788b32c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:41.303946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8910e-aeed-43fd-87cc-ec22788b32c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:41.320011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c490-dade-4d9f-bbfb-0843fcd04698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:41.321052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c490-dade-4d9f-bbfb-0843fcd04698 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:41.321377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c490-dade-4d9f-bbfb-0843fcd04698 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:41.321680 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c490-dade-4d9f-bbfb-0843fcd04698 None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:41.323124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8c490-dade-4d9f-bbfb-0843fcd04698 None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:41.324837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8c490-dade-4d9f-bbfb-0843fcd04698 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:41.326969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 71/150] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:41 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:41.333617 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c490-dade-4d9f-bbfb-0843fcd04698 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:41.338396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8910e-aeed-43fd-87cc-ec22788b32c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-3bc8910e-aeed-43fd-87cc-ec22788b32c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:41.351286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:41.352229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:54:41.352986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 80/151] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:54:41.359170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8910e-aeed-43fd-87cc-ec22788b32c3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:41.361891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:41.528172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c490-dade-4d9f-bbfb-0843fcd04698 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:41.577499 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8910e-aeed-43fd-87cc-ec22788b32c3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:41.595014 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10f917-0fec-4d90-b363-d6291f72b234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:41.596302 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10f917-0fec-4d90-b363-d6291f72b234 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:41.596623 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10f917-0fec-4d90-b363-d6291f72b234 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:41.596933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10f917-0fec-4d90-b363-d6291f72b234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:41.597807 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10f917-0fec-4d90-b363-d6291f72b234 None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=18a4708787dc49b085266177f70c0577, user.id=c22f03b3c05b411a8e1b74bbae3a8adc) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:41.598135 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10f917-0fec-4d90-b363-d6291f72b234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:41.599767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10f917-0fec-4d90-b363-d6291f72b234 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:41.606569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 72/152] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:41 2022] GET /identity/v3/role_assignments?user.id=c22f03b3c05b411a8e1b74bbae3a8adc&scope.project.id=18a4708787dc49b085266177f70c0577&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:41.628541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:41.645274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eece6-c222-4c80-b299-fca9e0dc8c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:41.645960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eece6-c222-4c80-b299-fca9e0dc8c42 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:41.646247 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eece6-c222-4c80-b299-fca9e0dc8c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:41.646611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eece6-c222-4c80-b299-fca9e0dc8c42 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:41.647374 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1eece6-c222-4c80-b299-fca9e0dc8c42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:41.647684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1eece6-c222-4c80-b299-fca9e0dc8c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:41.649076 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1eece6-c222-4c80-b299-fca9e0dc8c42 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:41.662810 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 81/153] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:41.668849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10f917-0fec-4d90-b363-d6291f72b234 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:41.690954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc8a78-4f11-42b6-a551-b87770709ba5 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:41.691255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc8a78-4f11-42b6-a551-b87770709ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:41.691523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc8a78-4f11-42b6-a551-b87770709ba5 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:41.693695 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 82/154] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:41.699698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e75bc9-93b1-40bb-bb87-3420560d905b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:41.699981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e75bc9-93b1-40bb-bb87-3420560d905b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:41.700264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e75bc9-93b1-40bb-bb87-3420560d905b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:41.727192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e3e75bc9-93b1-40bb-bb87-3420560d905b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:41.728424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e3e75bc9-93b1-40bb-bb87-3420560d905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:41.855940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 83/155] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:54:41.901142 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e75bc9-93b1-40bb-bb87-3420560d905b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:41.905354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:41.921887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10f917-0fec-4d90-b363-d6291f72b234 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:41.989234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c0aff-e05b-4f38-bad0-498b24710968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:41.990552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c0aff-e05b-4f38-bad0-498b24710968 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:41.991078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c0aff-e05b-4f38-bad0-498b24710968 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:41.991592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c0aff-e05b-4f38-bad0-498b24710968 None admin] PATH_INFO: `/v3/users/cef261d846ed44cf99cfccc8155f673d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:41.994707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c0aff-e05b-4f38-bad0-498b24710968 None admin] RBAC: Authorizing `identity:get_user(user_id=cef261d846ed44cf99cfccc8155f673d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:41.996426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c0aff-e05b-4f38-bad0-498b24710968 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:41.999294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 73/156] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:41 2022] GET /identity/v3/users/cef261d846ed44cf99cfccc8155f673d => generated 289 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:42.029486 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c0aff-e05b-4f38-bad0-498b24710968 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:42.084740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e75bc9-93b1-40bb-bb87-3420560d905b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:42.117596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:42.153608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d0476-3323-4067-b768-cf927c2a477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:42.154445 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d0476-3323-4067-b768-cf927c2a477f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:42.154915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d0476-3323-4067-b768-cf927c2a477f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:42.155495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d0476-3323-4067-b768-cf927c2a477f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:42.170601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d0476-3323-4067-b768-cf927c2a477f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-977d0476-3323-4067-b768-cf927c2a477f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:42.180021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:42.181191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:42.182157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:42.182157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:42.182157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:42.182157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:42.182157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:42.182157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:42.182157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:42.182157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:42.182157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:42.182157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:42.182157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:42.182157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:54:42.184791 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 84/157] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:54:42.193781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d0476-3323-4067-b768-cf927c2a477f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:42.244808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c0aff-e05b-4f38-bad0-498b24710968 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:42.324867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8abc50-c5c1-48d2-b35b-eedbe5765996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:42.325741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8abc50-c5c1-48d2-b35b-eedbe5765996 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:42.326186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8abc50-c5c1-48d2-b35b-eedbe5765996 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:42.326622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8abc50-c5c1-48d2-b35b-eedbe5765996 None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:42.331124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8abc50-c5c1-48d2-b35b-eedbe5765996 None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:42.332781 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8abc50-c5c1-48d2-b35b-eedbe5765996 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:42.334821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 74/158] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:42 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:42.340430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8abc50-c5c1-48d2-b35b-eedbe5765996 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:42.343292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d0476-3323-4067-b768-cf927c2a477f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:42.386777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:42.439177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9130a-2c97-4fc1-b257-a1ae70a1eec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:42.440245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9130a-2c97-4fc1-b257-a1ae70a1eec7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:42.440752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9130a-2c97-4fc1-b257-a1ae70a1eec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:42.441185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9130a-2c97-4fc1-b257-a1ae70a1eec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:42.442099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9130a-2c97-4fc1-b257-a1ae70a1eec7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:42.442579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9130a-2c97-4fc1-b257-a1ae70a1eec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:42.444089 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9130a-2c97-4fc1-b257-a1ae70a1eec7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:42.464309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 85/159] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:42.469726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9130a-2c97-4fc1-b257-a1ae70a1eec7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:42.509700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8abc50-c5c1-48d2-b35b-eedbe5765996 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:42.528438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:42.564017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953453f-eb0c-46e6-95db-98bb173398bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:42.565748 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953453f-eb0c-46e6-95db-98bb173398bf None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:42.566187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953453f-eb0c-46e6-95db-98bb173398bf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:42.566642 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953453f-eb0c-46e6-95db-98bb173398bf None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577/users/cef261d846ed44cf99cfccc8155f673d/roles/ccb4819e599749909ff92aedeeb810fd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:42.570139 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953453f-eb0c-46e6-95db-98bb173398bf None admin] RBAC: Authorizing `identity:create_grant(project_id=18a4708787dc49b085266177f70c0577, user_id=cef261d846ed44cf99cfccc8155f673d, role_id=ccb4819e599749909ff92aedeeb810fd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:42.572077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953453f-eb0c-46e6-95db-98bb173398bf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:42.605610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 75/160] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:54:42 2022] PUT /identity/v3/projects/18a4708787dc49b085266177f70c0577/users/cef261d846ed44cf99cfccc8155f673d/roles/ccb4819e599749909ff92aedeeb810fd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:54:42.609754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8043af-b107-4df2-8eee-f812322952a6 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:42.610504 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8043af-b107-4df2-8eee-f812322952a6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:42.611114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8043af-b107-4df2-8eee-f812322952a6 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:42.612870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 76/161] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:42.615257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9130a-2c97-4fc1-b257-a1ae70a1eec7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:42.620250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572d75-4809-46f3-a48c-0a05c4a179ec None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:42.620949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572d75-4809-46f3-a48c-0a05c4a179ec None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:42.621466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572d75-4809-46f3-a48c-0a05c4a179ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:42.659705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ab572d75-4809-46f3-a48c-0a05c4a179ec None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:42.661291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ab572d75-4809-46f3-a48c-0a05c4a179ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:42.680085 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49872d-96a5-4209-a954-e1703c93830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:42.680993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49872d-96a5-4209-a954-e1703c93830d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:42.681276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49872d-96a5-4209-a954-e1703c93830d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:42.681552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49872d-96a5-4209-a954-e1703c93830d None admin] PATH_INFO: `/v3/users/0c86a729247645e9904a177f85de34a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:42.690406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49872d-96a5-4209-a954-e1703c93830d None admin] RBAC: Authorizing `identity:get_user(user_id=0c86a729247645e9904a177f85de34a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:42.690406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49872d-96a5-4209-a954-e1703c93830d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:42.691426 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 86/162] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:42 2022] GET /identity/v3/users/0c86a729247645e9904a177f85de34a2 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:42.703747 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49872d-96a5-4209-a954-e1703c93830d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:42.812258 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 77/163] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:42.855930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49872d-96a5-4209-a954-e1703c93830d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:42.859227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:42.870862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572d75-4809-46f3-a48c-0a05c4a179ec None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:42.896068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6f6b8-fda3-4559-bddc-e482725520ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:42.896068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6f6b8-fda3-4559-bddc-e482725520ca None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:42.896068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6f6b8-fda3-4559-bddc-e482725520ca None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:42.896068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6f6b8-fda3-4559-bddc-e482725520ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:42.897785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:42.982843 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6f6b8-fda3-4559-bddc-e482725520ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:42.984564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6f6b8-fda3-4559-bddc-e482725520ca None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:43.032600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572d75-4809-46f3-a48c-0a05c4a179ec None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:43.093497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 87/164] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:43.095213 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde67a-523e-489b-8b30-eab014ff785e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:43.095747 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde67a-523e-489b-8b30-eab014ff785e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:43.096221 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde67a-523e-489b-8b30-eab014ff785e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:43.097775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 88/165] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:43.098860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afde67a-523e-489b-8b30-eab014ff785e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:43.102844 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:43.127728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e39ee1-3904-46f3-b561-a1730f1aa9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:43.128464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e39ee1-3904-46f3-b561-a1730f1aa9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:43.128915 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e39ee1-3904-46f3-b561-a1730f1aa9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:43.129333 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e39ee1-3904-46f3-b561-a1730f1aa9e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:43.154693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e39ee1-3904-46f3-b561-a1730f1aa9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-14e39ee1-3904-46f3-b561-a1730f1aa9e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:43.163773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:43.164864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:43.166072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:43.166072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:43.166072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:43.166072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:43.166072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:43.166072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:43.166072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:43.166072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:43.166072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:43.166072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:43.166072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:43.166072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:43.168756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 78/166] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:54:43.170861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76949d-7e1a-4f8d-b49d-ca341f25bb7c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:43.171342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76949d-7e1a-4f8d-b49d-ca341f25bb7c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:43.171766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76949d-7e1a-4f8d-b49d-ca341f25bb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:43.194938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ec76949d-7e1a-4f8d-b49d-ca341f25bb7c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:43.196432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ec76949d-7e1a-4f8d-b49d-ca341f25bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:43.256245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afde67a-523e-489b-8b30-eab014ff785e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:43.312947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5969ce8-6fd2-41f3-8c17-4a7f68da4512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:43.313824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969ce8-6fd2-41f3-8c17-4a7f68da4512 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:43.314663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969ce8-6fd2-41f3-8c17-4a7f68da4512 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:43.315755 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969ce8-6fd2-41f3-8c17-4a7f68da4512 None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:43.319123 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5969ce8-6fd2-41f3-8c17-4a7f68da4512 None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:43.320657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5969ce8-6fd2-41f3-8c17-4a7f68da4512 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:43.322421 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 89/167] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:43 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:43.323200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5969ce8-6fd2-41f3-8c17-4a7f68da4512 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:43.328789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 79/168] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:43.330190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76949d-7e1a-4f8d-b49d-ca341f25bb7c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:43.350749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:43.401343 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:43.472245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5969ce8-6fd2-41f3-8c17-4a7f68da4512 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:43.540438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9d8ce-61ad-416d-8b9c-b91b769149c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:43.541118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d8ce-61ad-416d-8b9c-b91b769149c5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:43.541404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d8ce-61ad-416d-8b9c-b91b769149c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:43.541686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d8ce-61ad-416d-8b9c-b91b769149c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:43.542462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9d8ce-61ad-416d-8b9c-b91b769149c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:43.542775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9d8ce-61ad-416d-8b9c-b91b769149c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:43.544150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9d8ce-61ad-416d-8b9c-b91b769149c5 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:43.548159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76949d-7e1a-4f8d-b49d-ca341f25bb7c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:43.564769 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 90/169] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:43.565408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9d8ce-61ad-416d-8b9c-b91b769149c5 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:43.617531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444e99b-612c-4d57-9226-0ca3d5c3436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:43.618197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444e99b-612c-4d57-9226-0ca3d5c3436a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:43.618508 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444e99b-612c-4d57-9226-0ca3d5c3436a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:43.618786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444e99b-612c-4d57-9226-0ca3d5c3436a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:43.619803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444e99b-612c-4d57-9226-0ca3d5c3436a None admin] RBAC: Adding query filter params (role.id=3027d01b9e8b469784a8db0de5f043bd, scope.project.id=18a4708787dc49b085266177f70c0577, user.id=0c86a729247645e9904a177f85de34a2) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:43.620127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444e99b-612c-4d57-9226-0ca3d5c3436a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:43.621639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444e99b-612c-4d57-9226-0ca3d5c3436a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:43.633791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 80/170] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:43 2022] GET /identity/v3/role_assignments?user.id=0c86a729247645e9904a177f85de34a2&scope.project.id=18a4708787dc49b085266177f70c0577&role.id=3027d01b9e8b469784a8db0de5f043bd => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:43.634744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444e99b-612c-4d57-9226-0ca3d5c3436a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:43.742666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:43.805670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444e99b-612c-4d57-9226-0ca3d5c3436a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:43.871406 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606f0f8-9b2e-43e3-bb6e-eb06fae5ee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:43.872920 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f0f8-9b2e-43e3-bb6e-eb06fae5ee3e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:43.873222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f0f8-9b2e-43e3-bb6e-eb06fae5ee3e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:43.873503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f0f8-9b2e-43e3-bb6e-eb06fae5ee3e None admin] PATH_INFO: `/v3/users/0c86a729247645e9904a177f85de34a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:43.879379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606f0f8-9b2e-43e3-bb6e-eb06fae5ee3e None admin] RBAC: Authorizing `identity:get_user(user_id=0c86a729247645e9904a177f85de34a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:43.881322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606f0f8-9b2e-43e3-bb6e-eb06fae5ee3e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:43.883397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 81/171] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:43 2022] GET /identity/v3/users/0c86a729247645e9904a177f85de34a2 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:43.895390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606f0f8-9b2e-43e3-bb6e-eb06fae5ee3e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:43.901417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9d8ce-61ad-416d-8b9c-b91b769149c5 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:43.994903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4bd9b-3d9c-44f4-b14c-cdb77da058f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:43.995775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4bd9b-3d9c-44f4-b14c-cdb77da058f0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:43.996073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4bd9b-3d9c-44f4-b14c-cdb77da058f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:43.996355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4bd9b-3d9c-44f4-b14c-cdb77da058f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.001420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:44.018998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4bd9b-3d9c-44f4-b14c-cdb77da058f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-19a4bd9b-3d9c-44f4-b14c-cdb77da058f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:44.031422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:44.032392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:54:44.034430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 91/172] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:54:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 469 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:44.039742 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4bd9b-3d9c-44f4-b14c-cdb77da058f0 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:44.040538 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606f0f8-9b2e-43e3-bb6e-eb06fae5ee3e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:44.104041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f52f6-bcfd-447e-b80d-71466be4f894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:44.105171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f52f6-bcfd-447e-b80d-71466be4f894 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.105657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f52f6-bcfd-447e-b80d-71466be4f894 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.106151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f52f6-bcfd-447e-b80d-71466be4f894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.114156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:44.234204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f52f6-bcfd-447e-b80d-71466be4f894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:44.235773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f52f6-bcfd-447e-b80d-71466be4f894 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:44.259334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4bd9b-3d9c-44f4-b14c-cdb77da058f0 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:44.329712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e33c91-d783-4095-a9e6-618a086537a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:44.330712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e33c91-d783-4095-a9e6-618a086537a3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.331001 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e33c91-d783-4095-a9e6-618a086537a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.331281 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e33c91-d783-4095-a9e6-618a086537a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.332044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e33c91-d783-4095-a9e6-618a086537a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:44.332354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e33c91-d783-4095-a9e6-618a086537a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:44.333757 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e33c91-d783-4095-a9e6-618a086537a3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:44.354654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 92/173] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:54:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:44.360449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e33c91-d783-4095-a9e6-618a086537a3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:44.439707 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:44.453140 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 82/174] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 16:54:44.459593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f52f6-bcfd-447e-b80d-71466be4f894 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:44.495894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e33c91-d783-4095-a9e6-618a086537a3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:44.533431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b009f0-80b9-4f11-866b-2e299b041b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:44.534235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b009f0-80b9-4f11-866b-2e299b041b47 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.534692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b009f0-80b9-4f11-866b-2e299b041b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.534976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b009f0-80b9-4f11-866b-2e299b041b47 None admin] PATH_INFO: `/v3/users/0c86a729247645e9904a177f85de34a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.536262 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b009f0-80b9-4f11-866b-2e299b041b47 None admin] RBAC: Authorizing `identity:get_user(user_id=0c86a729247645e9904a177f85de34a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:44.537853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b009f0-80b9-4f11-866b-2e299b041b47 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:44.539577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 93/175] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:44 2022] GET /identity/v3/users/0c86a729247645e9904a177f85de34a2 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:44.540812 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:44.545451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b009f0-80b9-4f11-866b-2e299b041b47 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:44.656423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b009f0-80b9-4f11-866b-2e299b041b47 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:44.671462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f52f6-bcfd-447e-b80d-71466be4f894 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:44.681998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:44.694317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771b727-3ccf-4656-a482-191631ab229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:44.695310 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771b727-3ccf-4656-a482-191631ab229b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.695914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771b727-3ccf-4656-a482-191631ab229b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.696401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771b727-3ccf-4656-a482-191631ab229b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.750446 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2532853-b1dd-415c-9734-251270c4faf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:44.751309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2532853-b1dd-415c-9734-251270c4faf5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.752114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2532853-b1dd-415c-9734-251270c4faf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.752390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2532853-b1dd-415c-9734-251270c4faf5 None admin] PATH_INFO: `/v3/projects/d24b82e885b44d6facd31358969d647c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.753776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2532853-b1dd-415c-9734-251270c4faf5 None admin] RBAC: Authorizing `identity:get_project(project_id=d24b82e885b44d6facd31358969d647c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:44.755061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2532853-b1dd-415c-9734-251270c4faf5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:44.758531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 83/176] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:44 2022] GET /identity/v3/projects/d24b82e885b44d6facd31358969d647c => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:44.768441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2532853-b1dd-415c-9734-251270c4faf5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:44.772012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771b727-3ccf-4656-a482-191631ab229b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:44.773703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771b727-3ccf-4656-a482-191631ab229b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:44.890546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 94/177] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 16:54:44.899920 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771b727-3ccf-4656-a482-191631ab229b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:44.963432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:45.029855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2532853-b1dd-415c-9734-251270c4faf5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:45.035456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:45.135095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82de12-8c50-432c-9584-f1928d99aeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:45.135873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82de12-8c50-432c-9584-f1928d99aeba None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.136061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82de12-8c50-432c-9584-f1928d99aeba None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.136341 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82de12-8c50-432c-9584-f1928d99aeba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.137200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82de12-8c50-432c-9584-f1928d99aeba None admin] RBAC: Adding query filter params (role.id=3027d01b9e8b469784a8db0de5f043bd, scope.project.id=d24b82e885b44d6facd31358969d647c, user.id=0c86a729247645e9904a177f85de34a2) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:45.137519 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82de12-8c50-432c-9584-f1928d99aeba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:45.139001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82de12-8c50-432c-9584-f1928d99aeba None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:45.149525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 84/178] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:44 2022] GET /identity/v3/role_assignments?user.id=0c86a729247645e9904a177f85de34a2&scope.project.id=d24b82e885b44d6facd31358969d647c&role.id=3027d01b9e8b469784a8db0de5f043bd => generated 608 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:45.152630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771b727-3ccf-4656-a482-191631ab229b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:45.162217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94480c-55cf-47fc-8ad8-d6ccd67af38f None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.162424 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94480c-55cf-47fc-8ad8-d6ccd67af38f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.163268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94480c-55cf-47fc-8ad8-d6ccd67af38f None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.164277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 85/179] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:54:45.170831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8e6db-9ac2-4bc2-a651-cecda711aa6d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.170979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8e6db-9ac2-4bc2-a651-cecda711aa6d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.171246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8e6db-9ac2-4bc2-a651-cecda711aa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.219574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-58e8e6db-9ac2-4bc2-a651-cecda711aa6d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:45.220900 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-58e8e6db-9ac2-4bc2-a651-cecda711aa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:45.247735 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42261116-1cbc-45f0-9769-d70184aa587e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:45.248630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42261116-1cbc-45f0-9769-d70184aa587e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.248924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42261116-1cbc-45f0-9769-d70184aa587e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.249202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42261116-1cbc-45f0-9769-d70184aa587e None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.251169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42261116-1cbc-45f0-9769-d70184aa587e None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:45.252770 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42261116-1cbc-45f0-9769-d70184aa587e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:45.254676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 95/180] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:44 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:45.262145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42261116-1cbc-45f0-9769-d70184aa587e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:45.350452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 86/181] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:54:45.351671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b1c06-21ad-4c32-83ed-6242fda9ac4f None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.351968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b1c06-21ad-4c32-83ed-6242fda9ac4f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.352253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b1c06-21ad-4c32-83ed-6242fda9ac4f None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.353660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 87/182] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:45.359822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1625486-0b2f-4609-ae6f-1b09bf752c7c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.360337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1625486-0b2f-4609-ae6f-1b09bf752c7c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.361328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1625486-0b2f-4609-ae6f-1b09bf752c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.382156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f1625486-0b2f-4609-ae6f-1b09bf752c7c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:45.383863 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f1625486-0b2f-4609-ae6f-1b09bf752c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:45.462664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:45.474527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42261116-1cbc-45f0-9769-d70184aa587e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:45.481244 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 88/183] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:54:45.486785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1625486-0b2f-4609-ae6f-1b09bf752c7c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:45.534719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4827e-8d30-4ef1-8d4c-f9f51b0fd440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:45.536598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4827e-8d30-4ef1-8d4c-f9f51b0fd440 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.536598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4827e-8d30-4ef1-8d4c-f9f51b0fd440 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.536598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4827e-8d30-4ef1-8d4c-f9f51b0fd440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.536860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4827e-8d30-4ef1-8d4c-f9f51b0fd440 None admin] RBAC: Adding query filter params (role.id=c4b17c7a2a644e91a1872f5fa53e6421, scope.project.id=18a4708787dc49b085266177f70c0577, user.id=0c86a729247645e9904a177f85de34a2) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:45.537071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4827e-8d30-4ef1-8d4c-f9f51b0fd440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:45.538495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4827e-8d30-4ef1-8d4c-f9f51b0fd440 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:45.541292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:45.545534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 96/184] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:45 2022] GET /identity/v3/role_assignments?user.id=0c86a729247645e9904a177f85de34a2&scope.project.id=18a4708787dc49b085266177f70c0577&role.id=c4b17c7a2a644e91a1872f5fa53e6421 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:45.546329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4827e-8d30-4ef1-8d4c-f9f51b0fd440 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:45.642927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1625486-0b2f-4609-ae6f-1b09bf752c7c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:45.691994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4827e-8d30-4ef1-8d4c-f9f51b0fd440 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:45.693764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb43a61-2fd7-49f7-83c2-a1ab1b1b3c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:45.695006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb43a61-2fd7-49f7-83c2-a1ab1b1b3c50 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.695291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb43a61-2fd7-49f7-83c2-a1ab1b1b3c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.695564 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb43a61-2fd7-49f7-83c2-a1ab1b1b3c50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.712548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb43a61-2fd7-49f7-83c2-a1ab1b1b3c50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6cb43a61-2fd7-49f7-83c2-a1ab1b1b3c50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:45.721353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:45.722313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:45.723138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:45.723138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:45.723138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:45.723138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:45.723138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:45.723138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:45.723138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:45.723138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:45.723138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:45.723138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:45.723138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:45.723138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:45.725977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 89/185] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:54:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:45.727711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f3aa2-8357-496d-903b-7c08e2d9f10d None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.728207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f3aa2-8357-496d-903b-7c08e2d9f10d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.728694 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f3aa2-8357-496d-903b-7c08e2d9f10d None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.730299 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 90/186] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:45.731285 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f3aa2-8357-496d-903b-7c08e2d9f10d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:45.741074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07ecc5-95f3-4a24-90eb-1afe18973b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:45.741903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07ecc5-95f3-4a24-90eb-1afe18973b9f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.742186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07ecc5-95f3-4a24-90eb-1afe18973b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.742491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07ecc5-95f3-4a24-90eb-1afe18973b9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.744498 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07ecc5-95f3-4a24-90eb-1afe18973b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:45.745990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07ecc5-95f3-4a24-90eb-1afe18973b9f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:45.748742 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 97/187] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:45.751374 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df5c4b-f1a1-4f9e-9786-90eada26a235 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.752805 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df5c4b-f1a1-4f9e-9786-90eada26a235 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.753667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df5c4b-f1a1-4f9e-9786-90eada26a235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.777564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-19df5c4b-f1a1-4f9e-9786-90eada26a235 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:45.779177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-19df5c4b-f1a1-4f9e-9786-90eada26a235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:45.801077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:45.866678 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 98/188] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:45.867332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df5c4b-f1a1-4f9e-9786-90eada26a235 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:45.867467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:45.880744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f3aa2-8357-496d-903b-7c08e2d9f10d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:45.927268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45248ee-2f4a-4f4f-875d-b0170a8eaf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:45.927918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45248ee-2f4a-4f4f-875d-b0170a8eaf35 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.928207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45248ee-2f4a-4f4f-875d-b0170a8eaf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.928485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45248ee-2f4a-4f4f-875d-b0170a8eaf35 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.929247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45248ee-2f4a-4f4f-875d-b0170a8eaf35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:45.929559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45248ee-2f4a-4f4f-875d-b0170a8eaf35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:45.931565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45248ee-2f4a-4f4f-875d-b0170a8eaf35 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:45.941771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 91/189] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:45.946960 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45248ee-2f4a-4f4f-875d-b0170a8eaf35 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:45.988230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df5c4b-f1a1-4f9e-9786-90eada26a235 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:46.026843 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01693d-3f0b-4223-b6fa-8d36a6294177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:46.027630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01693d-3f0b-4223-b6fa-8d36a6294177 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:46.027918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01693d-3f0b-4223-b6fa-8d36a6294177 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:46.028188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01693d-3f0b-4223-b6fa-8d36a6294177 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:46.028898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01693d-3f0b-4223-b6fa-8d36a6294177 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:46.030315 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01693d-3f0b-4223-b6fa-8d36a6294177 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:46.051137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45248ee-2f4a-4f4f-875d-b0170a8eaf35 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:46.052042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 99/190] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:54:45 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:54:46.052880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01693d-3f0b-4223-b6fa-8d36a6294177 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:46.068248 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:46.117372 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac84e1e-d987-4492-8afc-07d58fddc06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:46.119473 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac84e1e-d987-4492-8afc-07d58fddc06b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:46.120174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac84e1e-d987-4492-8afc-07d58fddc06b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:46.121254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac84e1e-d987-4492-8afc-07d58fddc06b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:46.143655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac84e1e-d987-4492-8afc-07d58fddc06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-4ac84e1e-d987-4492-8afc-07d58fddc06b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:46.156764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:46.158864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:46.159674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:46.159674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:46.159674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:46.159674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:46.159674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:46.159674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:46.159674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:46.159674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:46.159674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:46.159674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:46.159674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:54:46.159674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:46.162103 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 92/191] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:54:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:46.167621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac84e1e-d987-4492-8afc-07d58fddc06b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:46.186492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:46.206702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01693d-3f0b-4223-b6fa-8d36a6294177 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:46.248104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f256363-5263-4be6-b6a2-04ab1aa8df0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:46.249455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f256363-5263-4be6-b6a2-04ab1aa8df0d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:46.250018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f256363-5263-4be6-b6a2-04ab1aa8df0d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:46.250611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f256363-5263-4be6-b6a2-04ab1aa8df0d None admin] PATH_INFO: `/v3/users/b3d3ca92577b4a29b53e0d4fedacc8b6` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:46.266544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f256363-5263-4be6-b6a2-04ab1aa8df0d None admin] RBAC: Authorizing `identity:get_user(user_id=b3d3ca92577b4a29b53e0d4fedacc8b6)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:46.268578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f256363-5263-4be6-b6a2-04ab1aa8df0d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:46.270538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 100/192] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:46 2022] GET /identity/v3/users/b3d3ca92577b4a29b53e0d4fedacc8b6 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:46.275740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f256363-5263-4be6-b6a2-04ab1aa8df0d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:46.298496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac84e1e-d987-4492-8afc-07d58fddc06b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:46.343630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f2353-d1ea-4db6-81dd-657674c39a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:46.344306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f2353-d1ea-4db6-81dd-657674c39a08 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:46.344596 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f2353-d1ea-4db6-81dd-657674c39a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:46.344877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f2353-d1ea-4db6-81dd-657674c39a08 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:46.346805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f2353-d1ea-4db6-81dd-657674c39a08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:46.347124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f2353-d1ea-4db6-81dd-657674c39a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:46.348509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f2353-d1ea-4db6-81dd-657674c39a08 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:46.358338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 93/193] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:54:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:46.359718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01c101-42db-48db-bad7-52f1a8a4561b None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:46.360020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01c101-42db-48db-bad7-52f1a8a4561b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:46.360299 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01c101-42db-48db-bad7-52f1a8a4561b None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:46.362236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 94/194] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:46.368546 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65ca1-8ac5-4b84-b2f7-f2c4eb7cb63f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:46.368841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65ca1-8ac5-4b84-b2f7-f2c4eb7cb63f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:46.369121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65ca1-8ac5-4b84-b2f7-f2c4eb7cb63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:46.370818 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:46.388051 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d4e65ca1-8ac5-4b84-b2f7-f2c4eb7cb63f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:46.389461 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d4e65ca1-8ac5-4b84-b2f7-f2c4eb7cb63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:46.420294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f256363-5263-4be6-b6a2-04ab1aa8df0d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:46.461863 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111eb15-182f-44aa-94bc-8f44b6c3ef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:46.462478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111eb15-182f-44aa-94bc-8f44b6c3ef7b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:46.462746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111eb15-182f-44aa-94bc-8f44b6c3ef7b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:46.463025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111eb15-182f-44aa-94bc-8f44b6c3ef7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:46.474213 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 95/195] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:46.475671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e65ca1-8ac5-4b84-b2f7-f2c4eb7cb63f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:46.478290 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:46.548012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111eb15-182f-44aa-94bc-8f44b6c3ef7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:46.549783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111eb15-182f-44aa-94bc-8f44b6c3ef7b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:46.581032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e65ca1-8ac5-4b84-b2f7-f2c4eb7cb63f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:46.617931 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d5268-c092-45d1-bba7-48c11e323987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:46.618948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d5268-c092-45d1-bba7-48c11e323987 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:46.619389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d5268-c092-45d1-bba7-48c11e323987 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:46.619605 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:46.619874 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d5268-c092-45d1-bba7-48c11e323987 None admin] PATH_INFO: `/v3/users/b3d3ca92577b4a29b53e0d4fedacc8b6` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:46.621727 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d5268-c092-45d1-bba7-48c11e323987 None admin] RBAC: Authorizing `identity:get_user(user_id=b3d3ca92577b4a29b53e0d4fedacc8b6)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:46.623372 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d5268-c092-45d1-bba7-48c11e323987 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:46.625332 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 96/196] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:46 2022] GET /identity/v3/users/b3d3ca92577b4a29b53e0d4fedacc8b6 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:46.626083 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d5268-c092-45d1-bba7-48c11e323987 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:46.662627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 101/197] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 16:54:46.664003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111eb15-182f-44aa-94bc-8f44b6c3ef7b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:46.710821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:46.740427 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d5268-c092-45d1-bba7-48c11e323987 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:46.772539 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111eb15-182f-44aa-94bc-8f44b6c3ef7b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:46.797289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf1c9e-6054-4d16-8c60-9b37c1f0d79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:46.797289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf1c9e-6054-4d16-8c60-9b37c1f0d79a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:46.797289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf1c9e-6054-4d16-8c60-9b37c1f0d79a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:46.797289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf1c9e-6054-4d16-8c60-9b37c1f0d79a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:46.810502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac855985-1dd3-4e64-8fcf-34096247b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:46.810681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf1c9e-6054-4d16-8c60-9b37c1f0d79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:46.811307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac855985-1dd3-4e64-8fcf-34096247b377 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:46.811662 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac855985-1dd3-4e64-8fcf-34096247b377 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:46.812019 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac855985-1dd3-4e64-8fcf-34096247b377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-d5bf1c9e-6054-4d16-8c60-9b37c1f0d79a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:46.820162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:46.821236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:46.822112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 97/198] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:46.827357 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf1c9e-6054-4d16-8c60-9b37c1f0d79a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:46.861510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:46.901544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac855985-1dd3-4e64-8fcf-34096247b377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:46.903270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac855985-1dd3-4e64-8fcf-34096247b377 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:46.930758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf1c9e-6054-4d16-8c60-9b37c1f0d79a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:46.966041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8fcff-a29a-416a-bbcb-dd4a659a45c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:46.966908 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8fcff-a29a-416a-bbcb-dd4a659a45c7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:46.967256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8fcff-a29a-416a-bbcb-dd4a659a45c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:46.967600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8fcff-a29a-416a-bbcb-dd4a659a45c7 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:46.968930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8fcff-a29a-416a-bbcb-dd4a659a45c7 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:46.971121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8fcff-a29a-416a-bbcb-dd4a659a45c7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:46.972855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 98/199] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:46 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:46.973799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8fcff-a29a-416a-bbcb-dd4a659a45c7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:46.986906 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:47.015660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 102/200] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:47.017168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac855985-1dd3-4e64-8fcf-34096247b377 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:47.091510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:47.112473 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8fcff-a29a-416a-bbcb-dd4a659a45c7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:47.128838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac855985-1dd3-4e64-8fcf-34096247b377 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:47.155320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f6dec-f3f9-4296-834a-69f53485fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:47.156009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6dec-f3f9-4296-834a-69f53485fc86 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:47.156275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6dec-f3f9-4296-834a-69f53485fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:47.156555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6dec-f3f9-4296-834a-69f53485fc86 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:47.157468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f6dec-f3f9-4296-834a-69f53485fc86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:47.158637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f6dec-f3f9-4296-834a-69f53485fc86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:47.160641 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f6dec-f3f9-4296-834a-69f53485fc86 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:47.166932 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cf40c-246a-4ac4-825d-369e83bfe120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:47.167860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cf40c-246a-4ac4-825d-369e83bfe120 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:47.168417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cf40c-246a-4ac4-825d-369e83bfe120 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:47.168909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cf40c-246a-4ac4-825d-369e83bfe120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:47.169732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 99/201] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:47.170317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cf40c-246a-4ac4-825d-369e83bfe120 None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b, user.id=b3d3ca92577b4a29b53e0d4fedacc8b6) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:47.170645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f6dec-f3f9-4296-834a-69f53485fc86 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:47.171227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cf40c-246a-4ac4-825d-369e83bfe120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:47.172852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cf40c-246a-4ac4-825d-369e83bfe120 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:47.180484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 103/202] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:47 2022] GET /identity/v3/role_assignments?user.id=b3d3ca92577b4a29b53e0d4fedacc8b6&scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:47.181609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cf40c-246a-4ac4-825d-369e83bfe120 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:47.242321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:47.289859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f6dec-f3f9-4296-834a-69f53485fc86 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:47.297458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cf40c-246a-4ac4-825d-369e83bfe120 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:47.328022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e386d8a-a43e-4a6a-8133-f064e7f0df44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:47.329129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e386d8a-a43e-4a6a-8133-f064e7f0df44 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:47.329584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e386d8a-a43e-4a6a-8133-f064e7f0df44 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:47.330606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e386d8a-a43e-4a6a-8133-f064e7f0df44 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:47.332113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e386d8a-a43e-4a6a-8133-f064e7f0df44 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:47.332500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:47.334052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e386d8a-a43e-4a6a-8133-f064e7f0df44 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:47.336080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 100/203] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:47 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:47.340893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c119e-6133-4115-a899-8ef5a19bf597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:47.340893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c119e-6133-4115-a899-8ef5a19bf597 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:47.340893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c119e-6133-4115-a899-8ef5a19bf597 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:47.342280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e386d8a-a43e-4a6a-8133-f064e7f0df44 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:47.342424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c119e-6133-4115-a899-8ef5a19bf597 None admin] PATH_INFO: `/v3/users/cef261d846ed44cf99cfccc8155f673d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:47.344093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c119e-6133-4115-a899-8ef5a19bf597 None admin] RBAC: Authorizing `identity:get_user(user_id=cef261d846ed44cf99cfccc8155f673d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:47.345867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c119e-6133-4115-a899-8ef5a19bf597 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:47.348161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 104/204] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:47 2022] GET /identity/v3/users/cef261d846ed44cf99cfccc8155f673d => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:47.355558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c119e-6133-4115-a899-8ef5a19bf597 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:47.470079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c119e-6133-4115-a899-8ef5a19bf597 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:47.506794 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e386d8a-a43e-4a6a-8133-f064e7f0df44 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:47.507832 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c6cc4-6424-4af7-a59c-48b067260413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:47.508508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c6cc4-6424-4af7-a59c-48b067260413 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:47.508799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c6cc4-6424-4af7-a59c-48b067260413 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:47.509079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c6cc4-6424-4af7-a59c-48b067260413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:47.562587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:47.583380 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:47.586224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c6cc4-6424-4af7-a59c-48b067260413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:47.588268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cd713-29d5-4b2f-a64c-94be6b96171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:47.588403 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c6cc4-6424-4af7-a59c-48b067260413 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:47.589291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cd713-29d5-4b2f-a64c-94be6b96171f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:47.589582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cd713-29d5-4b2f-a64c-94be6b96171f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:47.589855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cd713-29d5-4b2f-a64c-94be6b96171f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:47.591299 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cd713-29d5-4b2f-a64c-94be6b96171f None admin] RBAC: Adding query filter params (role.id=c4b17c7a2a644e91a1872f5fa53e6421, scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b, user.id=b3d3ca92577b4a29b53e0d4fedacc8b6) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:47.591714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cd713-29d5-4b2f-a64c-94be6b96171f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:47.593204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cd713-29d5-4b2f-a64c-94be6b96171f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:47.607018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 101/205] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:47 2022] GET /identity/v3/role_assignments?user.id=b3d3ca92577b4a29b53e0d4fedacc8b6&scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b&role.id=c4b17c7a2a644e91a1872f5fa53e6421 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:47.698973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 105/206] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:47.704709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cd713-29d5-4b2f-a64c-94be6b96171f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:47.831901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cd713-29d5-4b2f-a64c-94be6b96171f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:47.884107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e5550-7e0d-4f75-b94a-568ddf023a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:47.885360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e5550-7e0d-4f75-b94a-568ddf023a6c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:47.885848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e5550-7e0d-4f75-b94a-568ddf023a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:47.886325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e5550-7e0d-4f75-b94a-568ddf023a6c None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:47.887765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e5550-7e0d-4f75-b94a-568ddf023a6c None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:47.889424 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e5550-7e0d-4f75-b94a-568ddf023a6c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:47.891445 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 102/207] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:47 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:47.897275 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c6cc4-6424-4af7-a59c-48b067260413 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:48.014222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:48.018917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c6cc4-6424-4af7-a59c-48b067260413 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:48.057455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f138a0-ab9a-4248-94b4-6e7d4e75236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:48.058123 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f138a0-ab9a-4248-94b4-6e7d4e75236a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:48.058433 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f138a0-ab9a-4248-94b4-6e7d4e75236a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:48.058719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f138a0-ab9a-4248-94b4-6e7d4e75236a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:48.059557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f138a0-ab9a-4248-94b4-6e7d4e75236a None admin] RBAC: Adding query filter params (role.id=ccb4819e599749909ff92aedeeb810fd, scope.project.id=18a4708787dc49b085266177f70c0577, user.id=cef261d846ed44cf99cfccc8155f673d) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:48.059875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f138a0-ab9a-4248-94b4-6e7d4e75236a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:48.061318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f138a0-ab9a-4248-94b4-6e7d4e75236a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:48.068266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 106/208] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:47 2022] GET /identity/v3/role_assignments?user.id=cef261d846ed44cf99cfccc8155f673d&scope.project.id=18a4708787dc49b085266177f70c0577&role.id=ccb4819e599749909ff92aedeeb810fd => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:48.691002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14165-1895-476a-958b-facd2e6ab0cf None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:48.691893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14165-1895-476a-958b-facd2e6ab0cf None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:48.692357 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14165-1895-476a-958b-facd2e6ab0cf None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:48.694013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 103/209] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:48.700871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022d8ab-3a35-4c43-92d5-c09963684428 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:48.701517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022d8ab-3a35-4c43-92d5-c09963684428 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:48.701996 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022d8ab-3a35-4c43-92d5-c09963684428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:48.721065 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6022d8ab-3a35-4c43-92d5-c09963684428 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:48.722631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6022d8ab-3a35-4c43-92d5-c09963684428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:48.798405 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 107/210] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:48.823294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14165-1895-476a-958b-facd2e6ab0cf None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:48.889444 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:48.904728 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66f22f-4019-4c2d-a8f4-3bc5487c2a26 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:48.905039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66f22f-4019-4c2d-a8f4-3bc5487c2a26 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:48.905301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66f22f-4019-4c2d-a8f4-3bc5487c2a26 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:48.906877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 108/211] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:54:48.912662 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06003dea-d5d2-45eb-b8e2-2d7bbe84514b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:48.912954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06003dea-d5d2-45eb-b8e2-2d7bbe84514b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:48.913238 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06003dea-d5d2-45eb-b8e2-2d7bbe84514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:48.933894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-06003dea-d5d2-45eb-b8e2-2d7bbe84514b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:48.935401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-06003dea-d5d2-45eb-b8e2-2d7bbe84514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:48.945494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14165-1895-476a-958b-facd2e6ab0cf None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:48.990948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6815135-bd6a-4ae0-90df-52eaf9eac2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:48.992750 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6815135-bd6a-4ae0-90df-52eaf9eac2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:48.993271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6815135-bd6a-4ae0-90df-52eaf9eac2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:48.993731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6815135-bd6a-4ae0-90df-52eaf9eac2d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:49.008065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6815135-bd6a-4ae0-90df-52eaf9eac2d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-b6815135-bd6a-4ae0-90df-52eaf9eac2d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:49.018005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:49.018970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:49.019788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 104/212] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:49.023919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 109/213] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:54:49.025079 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6815135-bd6a-4ae0-90df-52eaf9eac2d2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:49.053488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06003dea-d5d2-45eb-b8e2-2d7bbe84514b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:49.080851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:49.142793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6815135-bd6a-4ae0-90df-52eaf9eac2d2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:49.162783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:49.179408 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9feab-a649-4c1e-903f-8fd1b351db43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:49.180241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9feab-a649-4c1e-903f-8fd1b351db43 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:49.180462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06003dea-d5d2-45eb-b8e2-2d7bbe84514b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:49.180724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9feab-a649-4c1e-903f-8fd1b351db43 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:49.181103 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9feab-a649-4c1e-903f-8fd1b351db43 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:49.181963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9feab-a649-4c1e-903f-8fd1b351db43 None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:49.182387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9feab-a649-4c1e-903f-8fd1b351db43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:49.184239 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9feab-a649-4c1e-903f-8fd1b351db43 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:49.192976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 105/214] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:49.198596 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9feab-a649-4c1e-903f-8fd1b351db43 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:49.223855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defffb6d-15e0-442c-9fa0-45d45b457336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:49.224989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defffb6d-15e0-442c-9fa0-45d45b457336 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:49.225575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defffb6d-15e0-442c-9fa0-45d45b457336 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:49.226026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defffb6d-15e0-442c-9fa0-45d45b457336 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:49.227950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defffb6d-15e0-442c-9fa0-45d45b457336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:49.230019 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defffb6d-15e0-442c-9fa0-45d45b457336 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:49.232578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 110/215] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:49.238645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defffb6d-15e0-442c-9fa0-45d45b457336 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:49.323409 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9feab-a649-4c1e-903f-8fd1b351db43 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:49.348002 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:49.360165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defffb6d-15e0-442c-9fa0-45d45b457336 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:49.365830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b34b3a-480a-466e-a50c-d4109301ba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:49.366891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b34b3a-480a-466e-a50c-d4109301ba1f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:49.367281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b34b3a-480a-466e-a50c-d4109301ba1f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:49.367663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b34b3a-480a-466e-a50c-d4109301ba1f None admin] PATH_INFO: `/v3/users/4c84fb182e5a4af0977db1833ec58f6f` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:49.383885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b34b3a-480a-466e-a50c-d4109301ba1f None admin] RBAC: Authorizing `identity:get_user(user_id=4c84fb182e5a4af0977db1833ec58f6f)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:49.385488 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b34b3a-480a-466e-a50c-d4109301ba1f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:49.392069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 106/216] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:49 2022] GET /identity/v3/users/4c84fb182e5a4af0977db1833ec58f6f => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:49.394239 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b34b3a-480a-466e-a50c-d4109301ba1f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:49.402611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3032b6-77a3-4d42-9787-99689929f3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:49.403498 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3032b6-77a3-4d42-9787-99689929f3e1 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:49.404349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3032b6-77a3-4d42-9787-99689929f3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:49.404794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3032b6-77a3-4d42-9787-99689929f3e1 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:49.405646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3032b6-77a3-4d42-9787-99689929f3e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:49.408009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3032b6-77a3-4d42-9787-99689929f3e1 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:49.442457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 111/217] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:54:49 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:54:49.457874 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:49.524021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b34b3a-480a-466e-a50c-d4109301ba1f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:49.561418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530b079-fb1f-4e79-b06f-3654e1f0a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:49.562084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530b079-fb1f-4e79-b06f-3654e1f0a48d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:49.562387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530b079-fb1f-4e79-b06f-3654e1f0a48d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:49.562676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530b079-fb1f-4e79-b06f-3654e1f0a48d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:49.646418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530b079-fb1f-4e79-b06f-3654e1f0a48d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:49.646418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530b079-fb1f-4e79-b06f-3654e1f0a48d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:49.692908 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:49.756060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 107/218] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:49.761704 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3032b6-77a3-4d42-9787-99689929f3e1 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:49.841074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab11200-d003-46bf-9259-d357c232d7b3 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:49.841369 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab11200-d003-46bf-9259-d357c232d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:49.841719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab11200-d003-46bf-9259-d357c232d7b3 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:49.843992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 108/219] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:54:49.850220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed53c05-bda9-47ee-913a-712521161202 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:49.850676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed53c05-bda9-47ee-913a-712521161202 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:49.851056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed53c05-bda9-47ee-913a-712521161202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:49.878168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6ed53c05-bda9-47ee-913a-712521161202 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:49.879405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6ed53c05-bda9-47ee-913a-712521161202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:49.887341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3032b6-77a3-4d42-9787-99689929f3e1 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:49.931591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ad50e-a8ea-4663-a58b-104b776151e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:49.932959 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ad50e-a8ea-4663-a58b-104b776151e2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:49.933874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ad50e-a8ea-4663-a58b-104b776151e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:49.934304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ad50e-a8ea-4663-a58b-104b776151e2 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:49.935824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ad50e-a8ea-4663-a58b-104b776151e2 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:49.937612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ad50e-a8ea-4663-a58b-104b776151e2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:49.940289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 112/220] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:49 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:49.947471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ad50e-a8ea-4663-a58b-104b776151e2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:49.963372 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 109/221] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:49.973131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:49.997698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed53c05-bda9-47ee-913a-712521161202 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:50.071821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:50.072509 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ad50e-a8ea-4663-a58b-104b776151e2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:50.105549 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed53c05-bda9-47ee-913a-712521161202 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:50.110455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916069ac-5c39-4e18-81a3-ebc4d2fc1b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:50.112036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916069ac-5c39-4e18-81a3-ebc4d2fc1b31 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:50.112492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916069ac-5c39-4e18-81a3-ebc4d2fc1b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:50.112914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916069ac-5c39-4e18-81a3-ebc4d2fc1b31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:50.113926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916069ac-5c39-4e18-81a3-ebc4d2fc1b31 None admin] RBAC: Adding query filter params (role.id=3027d01b9e8b469784a8db0de5f043bd, scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b, user.id=4c84fb182e5a4af0977db1833ec58f6f) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:50.114417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916069ac-5c39-4e18-81a3-ebc4d2fc1b31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:50.116024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916069ac-5c39-4e18-81a3-ebc4d2fc1b31 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:50.122416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 113/222] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:49 2022] GET /identity/v3/role_assignments?user.id=4c84fb182e5a4af0977db1833ec58f6f&scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b&role.id=3027d01b9e8b469784a8db0de5f043bd => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:50.147407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282e43b-7a48-43f5-9b17-f81498b0ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:50.148387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282e43b-7a48-43f5-9b17-f81498b0ac4b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:50.148796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282e43b-7a48-43f5-9b17-f81498b0ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:50.149172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282e43b-7a48-43f5-9b17-f81498b0ac4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:50.163169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282e43b-7a48-43f5-9b17-f81498b0ac4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:50.168151 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7cf8-0e81-468a-8a32-9c6ac537a47b None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:50.168479 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7cf8-0e81-468a-8a32-9c6ac537a47b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:50.168788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7cf8-0e81-468a-8a32-9c6ac537a47b None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:50.170455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 114/223] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-d282e43b-7a48-43f5-9b17-f81498b0ac4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:50.171314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:50.172194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:50.173337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 110/224] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:54:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:50.179469 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a7cf8-0e81-468a-8a32-9c6ac537a47b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:50.184191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25232482-8de8-4d34-9a7a-4cf1ad6f04a6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:50.184826 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25232482-8de8-4d34-9a7a-4cf1ad6f04a6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:50.185309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25232482-8de8-4d34-9a7a-4cf1ad6f04a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:50.217656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-25232482-8de8-4d34-9a7a-4cf1ad6f04a6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:50.219509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-25232482-8de8-4d34-9a7a-4cf1ad6f04a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:50.314615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 111/225] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:50.332791 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:50.346522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25232482-8de8-4d34-9a7a-4cf1ad6f04a6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:50.369187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a7cf8-0e81-468a-8a32-9c6ac537a47b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:50.412042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301fbe6-14f0-4dbc-8b7c-8a2f816d52be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:50.412894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301fbe6-14f0-4dbc-8b7c-8a2f816d52be None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:50.413183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301fbe6-14f0-4dbc-8b7c-8a2f816d52be None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:50.413461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301fbe6-14f0-4dbc-8b7c-8a2f816d52be None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:50.414219 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301fbe6-14f0-4dbc-8b7c-8a2f816d52be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:50.414590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301fbe6-14f0-4dbc-8b7c-8a2f816d52be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:50.416283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301fbe6-14f0-4dbc-8b7c-8a2f816d52be None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:50.427193 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 115/226] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:50.435341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301fbe6-14f0-4dbc-8b7c-8a2f816d52be None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:50.456770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:50.535771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25232482-8de8-4d34-9a7a-4cf1ad6f04a6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:50.575534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301fbe6-14f0-4dbc-8b7c-8a2f816d52be None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:50.616356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c701cb6-f0ef-4ec9-831a-96add9592725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:50.616568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a5873-fc67-4347-a954-2300720d4999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:50.617173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c701cb6-f0ef-4ec9-831a-96add9592725 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:50.617457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c701cb6-f0ef-4ec9-831a-96add9592725 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:50.617736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c701cb6-f0ef-4ec9-831a-96add9592725 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:50.618477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a5873-fc67-4347-a954-2300720d4999 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:50.618977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a5873-fc67-4347-a954-2300720d4999 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:50.619448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a5873-fc67-4347-a954-2300720d4999 None admin] PATH_INFO: `/v3/users/b3d3ca92577b4a29b53e0d4fedacc8b6` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:50.620872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a5873-fc67-4347-a954-2300720d4999 None admin] RBAC: Authorizing `identity:get_user(user_id=b3d3ca92577b4a29b53e0d4fedacc8b6)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:50.622626 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a5873-fc67-4347-a954-2300720d4999 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:50.625070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 116/227] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:50 2022] GET /identity/v3/users/b3d3ca92577b4a29b53e0d4fedacc8b6 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:50.631058 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a5873-fc67-4347-a954-2300720d4999 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:50.646699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:50.654055 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c701cb6-f0ef-4ec9-831a-96add9592725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-9c701cb6-f0ef-4ec9-831a-96add9592725 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:50.668841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:50.669765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:50.670585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:50.670585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:50.670585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:50.670585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:50.670585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:50.670585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:50.670585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:50.670585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:50.670585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:50.670585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:50.670585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:54:50.670585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:50.672233 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 112/228] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:54:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:54:50.680152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c701cb6-f0ef-4ec9-831a-96add9592725 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:50.824260 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c701cb6-f0ef-4ec9-831a-96add9592725 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:50.826037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a5873-fc67-4347-a954-2300720d4999 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:50.855737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:50.872848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290d342-0c18-47fa-809a-cb8f48741623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:50.873450 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290d342-0c18-47fa-809a-cb8f48741623 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:50.873737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290d342-0c18-47fa-809a-cb8f48741623 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:50.874016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290d342-0c18-47fa-809a-cb8f48741623 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:50.874795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290d342-0c18-47fa-809a-cb8f48741623 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:50.875109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290d342-0c18-47fa-809a-cb8f48741623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:50.877127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290d342-0c18-47fa-809a-cb8f48741623 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:50.882484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58862eb-3acb-47ee-9fb5-4bb226e686a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:50.884122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58862eb-3acb-47ee-9fb5-4bb226e686a8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:50.884854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58862eb-3acb-47ee-9fb5-4bb226e686a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:50.885328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58862eb-3acb-47ee-9fb5-4bb226e686a8 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:50.886752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58862eb-3acb-47ee-9fb5-4bb226e686a8 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:50.886878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 113/229] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:54:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:50.888499 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58862eb-3acb-47ee-9fb5-4bb226e686a8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:50.890439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 117/230] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:50 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:50.893101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290d342-0c18-47fa-809a-cb8f48741623 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:50.897254 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58862eb-3acb-47ee-9fb5-4bb226e686a8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:50.992386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:51.013868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58862eb-3acb-47ee-9fb5-4bb226e686a8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:51.053630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a249f7-4595-4935-8322-29d3eac2e854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:51.054950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a249f7-4595-4935-8322-29d3eac2e854 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:51.055463 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a249f7-4595-4935-8322-29d3eac2e854 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:51.055950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a249f7-4595-4935-8322-29d3eac2e854 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b/users/b3d3ca92577b4a29b53e0d4fedacc8b6/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:51.058354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a249f7-4595-4935-8322-29d3eac2e854 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cbc0a559a674cb78cba6f09b7f95a3b, user_id=b3d3ca92577b4a29b53e0d4fedacc8b6, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:51.060038 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a249f7-4595-4935-8322-29d3eac2e854 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:51.086387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290d342-0c18-47fa-809a-cb8f48741623 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:51.097882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 118/231] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:54:50 2022] PUT /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b/users/b3d3ca92577b4a29b53e0d4fedacc8b6/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:54:51.121061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc064f5-9201-4f47-9308-1c58c648bc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:51.122025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc064f5-9201-4f47-9308-1c58c648bc59 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:51.122313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc064f5-9201-4f47-9308-1c58c648bc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:51.122617 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc064f5-9201-4f47-9308-1c58c648bc59 None admin] PATH_INFO: `/v3/users/b3d3ca92577b4a29b53e0d4fedacc8b6` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:51.123985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc064f5-9201-4f47-9308-1c58c648bc59 None admin] RBAC: Authorizing `identity:get_user(user_id=b3d3ca92577b4a29b53e0d4fedacc8b6)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:51.125461 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc064f5-9201-4f47-9308-1c58c648bc59 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:51.127744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 114/232] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:50 2022] GET /identity/v3/users/b3d3ca92577b4a29b53e0d4fedacc8b6 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:51.133131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a249f7-4595-4935-8322-29d3eac2e854 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:51.293202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a249f7-4595-4935-8322-29d3eac2e854 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:51.342726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedadef-3101-4bdf-bb70-43c82297113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:51.343611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedadef-3101-4bdf-bb70-43c82297113a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:51.343896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedadef-3101-4bdf-bb70-43c82297113a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:51.344172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedadef-3101-4bdf-bb70-43c82297113a None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:51.351295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedadef-3101-4bdf-bb70-43c82297113a None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:51.352767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedadef-3101-4bdf-bb70-43c82297113a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:51.354872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 119/233] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:51 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:51.360672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc064f5-9201-4f47-9308-1c58c648bc59 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:51.422441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:51.476765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc064f5-9201-4f47-9308-1c58c648bc59 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:51.512425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53c8d7-5088-497b-97b1-9338d30f0fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:51.513325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53c8d7-5088-497b-97b1-9338d30f0fce None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:51.513672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53c8d7-5088-497b-97b1-9338d30f0fce None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:51.513953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53c8d7-5088-497b-97b1-9338d30f0fce None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b/users/b3d3ca92577b4a29b53e0d4fedacc8b6/roles/c4b17c7a2a644e91a1872f5fa53e6421` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:51.516272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53c8d7-5088-497b-97b1-9338d30f0fce None admin] RBAC: Authorizing `identity:create_grant(project_id=3cbc0a559a674cb78cba6f09b7f95a3b, user_id=b3d3ca92577b4a29b53e0d4fedacc8b6, role_id=c4b17c7a2a644e91a1872f5fa53e6421)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:51.518577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53c8d7-5088-497b-97b1-9338d30f0fce None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:51.544734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 115/234] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:54:51 2022] PUT /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b/users/b3d3ca92577b4a29b53e0d4fedacc8b6/roles/c4b17c7a2a644e91a1872f5fa53e6421 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:54:52.386550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4f02-3b0e-4738-ada2-c8063d3c01e7 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:52.387079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4f02-3b0e-4738-ada2-c8063d3c01e7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:52.387154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4f02-3b0e-4738-ada2-c8063d3c01e7 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:52.388512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 120/235] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:52.399177 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988b1a3-2f8d-4473-aacb-719819287751 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:52.399693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988b1a3-2f8d-4473-aacb-719819287751 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:52.399768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988b1a3-2f8d-4473-aacb-719819287751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:52.425626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f988b1a3-2f8d-4473-aacb-719819287751 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:52.426875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f988b1a3-2f8d-4473-aacb-719819287751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:52.514966 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 116/236] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:52.567108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f4f02-3b0e-4738-ada2-c8063d3c01e7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:52.582340 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:52.629184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6007fc-6ded-4400-8a37-96d1542dddc6 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:52.629572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6007fc-6ded-4400-8a37-96d1542dddc6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:52.629850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6007fc-6ded-4400-8a37-96d1542dddc6 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:52.631541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 117/237] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:54:52.637278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b610e8f-b923-4a3b-bb20-4ebf9169ed97 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:52.637484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b610e8f-b923-4a3b-bb20-4ebf9169ed97 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:52.637746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b610e8f-b923-4a3b-bb20-4ebf9169ed97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:52.660240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4b610e8f-b923-4a3b-bb20-4ebf9169ed97 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:52.661419 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4b610e8f-b923-4a3b-bb20-4ebf9169ed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:52.730544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:52.745045 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f4f02-3b0e-4738-ada2-c8063d3c01e7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:52.799390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 118/238] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:54:52.799620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebdf26-dff4-467e-a138-7dc44e4b4641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:52.801328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebdf26-dff4-467e-a138-7dc44e4b4641 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:52.801328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebdf26-dff4-467e-a138-7dc44e4b4641 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:52.801328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebdf26-dff4-467e-a138-7dc44e4b4641 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:52.832387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebdf26-dff4-467e-a138-7dc44e4b4641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-ddebdf26-dff4-467e-a138-7dc44e4b4641 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:52.840188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:52.841074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:54:52.841884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 121/239] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:52.848705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebdf26-dff4-467e-a138-7dc44e4b4641 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:52.848840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b610e8f-b923-4a3b-bb20-4ebf9169ed97 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:52.983101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b610e8f-b923-4a3b-bb20-4ebf9169ed97 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:52.993000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:53.019575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8df50-ce9a-461c-925b-bccd8c0d5975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:53.020463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8df50-ce9a-461c-925b-bccd8c0d5975 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.020745 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8df50-ce9a-461c-925b-bccd8c0d5975 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.021016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8df50-ce9a-461c-925b-bccd8c0d5975 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:53.022184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8df50-ce9a-461c-925b-bccd8c0d5975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:53.023873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8df50-ce9a-461c-925b-bccd8c0d5975 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:53.025773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 119/240] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:53.031384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8df50-ce9a-461c-925b-bccd8c0d5975 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:53.052563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebdf26-dff4-467e-a138-7dc44e4b4641 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:53.074706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:53.089495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c06195-91ab-446b-a79b-5db842e7080c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:53.090174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06195-91ab-446b-a79b-5db842e7080c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.090668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06195-91ab-446b-a79b-5db842e7080c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.091296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06195-91ab-446b-a79b-5db842e7080c None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:53.092555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c06195-91ab-446b-a79b-5db842e7080c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:53.092871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c06195-91ab-446b-a79b-5db842e7080c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:53.094339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c06195-91ab-446b-a79b-5db842e7080c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:53.104468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 122/241] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:53.105921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f683d-76f4-41fc-817d-dd6383fe5ba5 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.106240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f683d-76f4-41fc-817d-dd6383fe5ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.106639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f683d-76f4-41fc-817d-dd6383fe5ba5 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:53.107889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 123/242] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:53.113042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f683d-76f4-41fc-817d-dd6383fe5ba5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:53.139811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8df50-ce9a-461c-925b-bccd8c0d5975 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:53.179184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe24e5-8b30-42cb-af66-94df7fdff0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:53.179957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe24e5-8b30-42cb-af66-94df7fdff0da None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.180247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe24e5-8b30-42cb-af66-94df7fdff0da None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.180523 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe24e5-8b30-42cb-af66-94df7fdff0da None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:53.181238 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe24e5-8b30-42cb-af66-94df7fdff0da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:53.182918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe24e5-8b30-42cb-af66-94df7fdff0da None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:53.207260 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 120/243] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:54:53 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:54:53.215924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4239-08d1-49bc-a960-5731f98fa2cb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.216213 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4239-08d1-49bc-a960-5731f98fa2cb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.216539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4239-08d1-49bc-a960-5731f98fa2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:53.225485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f683d-76f4-41fc-817d-dd6383fe5ba5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:53.247765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3eee4239-08d1-49bc-a960-5731f98fa2cb None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:53.248991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3eee4239-08d1-49bc-a960-5731f98fa2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:53.261108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:53.264578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5478a-f1f1-4a1d-90a4-40fa2fc6386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:53.265559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5478a-f1f1-4a1d-90a4-40fa2fc6386c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.265920 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5478a-f1f1-4a1d-90a4-40fa2fc6386c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.266268 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5478a-f1f1-4a1d-90a4-40fa2fc6386c None admin] PATH_INFO: `/v3/users/b96f579f1412440a8d75c031bc43b705` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:53.282352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5478a-f1f1-4a1d-90a4-40fa2fc6386c None admin] RBAC: Authorizing `identity:get_user(user_id=b96f579f1412440a8d75c031bc43b705)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:53.284556 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5478a-f1f1-4a1d-90a4-40fa2fc6386c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:53.286459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 124/244] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:53 2022] GET /identity/v3/users/b96f579f1412440a8d75c031bc43b705 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:53.296163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5478a-f1f1-4a1d-90a4-40fa2fc6386c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:53.390400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 121/245] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:53.417217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee4239-08d1-49bc-a960-5731f98fa2cb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:53.445589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:53.498344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5478a-f1f1-4a1d-90a4-40fa2fc6386c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:53.538225 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56373fa2-daf9-4910-a2a9-be8575c23d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:53.539294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56373fa2-daf9-4910-a2a9-be8575c23d1b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.539810 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56373fa2-daf9-4910-a2a9-be8575c23d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.540288 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56373fa2-daf9-4910-a2a9-be8575c23d1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:53.546347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee4239-08d1-49bc-a960-5731f98fa2cb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:53.584079 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca264c-7c8c-4d10-8a41-e34a0aace565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:53.584880 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca264c-7c8c-4d10-8a41-e34a0aace565 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.585210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca264c-7c8c-4d10-8a41-e34a0aace565 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.585491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca264c-7c8c-4d10-8a41-e34a0aace565 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:53.599536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca264c-7c8c-4d10-8a41-e34a0aace565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:53.610434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-bdca264c-7c8c-4d10-8a41-e34a0aace565 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:53.611150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:53.612123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:53.612910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 122/246] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:54:53.615373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca264c-7c8c-4d10-8a41-e34a0aace565 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:53.630394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56373fa2-daf9-4910-a2a9-be8575c23d1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:53.633302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56373fa2-daf9-4910-a2a9-be8575c23d1b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:53.717611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:53.738721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca264c-7c8c-4d10-8a41-e34a0aace565 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:53.770078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 125/247] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 16:54:53.778449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56373fa2-daf9-4910-a2a9-be8575c23d1b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:53.792783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3359a-9951-4cae-8c94-a2bda8dafd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:53.793702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3359a-9951-4cae-8c94-a2bda8dafd70 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.794130 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3359a-9951-4cae-8c94-a2bda8dafd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.794694 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3359a-9951-4cae-8c94-a2bda8dafd70 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:53.796153 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3359a-9951-4cae-8c94-a2bda8dafd70 None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:53.796614 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3359a-9951-4cae-8c94-a2bda8dafd70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:53.798891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3359a-9951-4cae-8c94-a2bda8dafd70 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:53.811116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 123/248] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:53.816413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3359a-9951-4cae-8c94-a2bda8dafd70 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:53.900685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:53.919442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56373fa2-daf9-4910-a2a9-be8575c23d1b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:53.946702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3359a-9951-4cae-8c94-a2bda8dafd70 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:53.959430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d9dde-8ede-49fd-bb43-72a2378f9317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:53.960408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d9dde-8ede-49fd-bb43-72a2378f9317 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.960695 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d9dde-8ede-49fd-bb43-72a2378f9317 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.960970 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d9dde-8ede-49fd-bb43-72a2378f9317 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:53.962212 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d9dde-8ede-49fd-bb43-72a2378f9317 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:53.963952 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d9dde-8ede-49fd-bb43-72a2378f9317 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:53.966748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 126/249] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:53 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:53.968386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46fef2-5aa7-4584-8c74-ef780ad7c0fd None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.968677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46fef2-5aa7-4584-8c74-ef780ad7c0fd None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.969218 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46fef2-5aa7-4584-8c74-ef780ad7c0fd None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:53.970582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 127/250] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:53.976288 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46fef2-5aa7-4584-8c74-ef780ad7c0fd None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:53.989084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437d5f3-e9d3-4ddb-a386-e5557a002878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:53.990386 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437d5f3-e9d3-4ddb-a386-e5557a002878 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.990873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437d5f3-e9d3-4ddb-a386-e5557a002878 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.991472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437d5f3-e9d3-4ddb-a386-e5557a002878 None admin] PATH_INFO: `/v3/users/4c84fb182e5a4af0977db1833ec58f6f` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:53.993017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437d5f3-e9d3-4ddb-a386-e5557a002878 None admin] RBAC: Authorizing `identity:get_user(user_id=4c84fb182e5a4af0977db1833ec58f6f)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:53.994694 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437d5f3-e9d3-4ddb-a386-e5557a002878 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:53.997078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 124/251] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:53 2022] GET /identity/v3/users/4c84fb182e5a4af0977db1833ec58f6f => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:53.998444 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dad03b-08d2-4ecf-a002-d5af65465e7c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:53.998930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dad03b-08d2-4ecf-a002-d5af65465e7c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:53.999468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dad03b-08d2-4ecf-a002-d5af65465e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:54.026631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f6dad03b-08d2-4ecf-a002-d5af65465e7c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:54.028227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f6dad03b-08d2-4ecf-a002-d5af65465e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:54.043998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:54.107853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46fef2-5aa7-4584-8c74-ef780ad7c0fd None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:54.111578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 125/252] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:54.112845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dad03b-08d2-4ecf-a002-d5af65465e7c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:54.171708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cdc73-eff0-43f5-9bd1-647b4a20a6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:54.172500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cdc73-eff0-43f5-9bd1-647b4a20a6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:54.173553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cdc73-eff0-43f5-9bd1-647b4a20a6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:54.173553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cdc73-eff0-43f5-9bd1-647b4a20a6c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:54.175135 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cdc73-eff0-43f5-9bd1-647b4a20a6c3 None admin] RBAC: Adding query filter params (role.id=ccb4819e599749909ff92aedeeb810fd, scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b, user.id=b96f579f1412440a8d75c031bc43b705) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:54.175599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cdc73-eff0-43f5-9bd1-647b4a20a6c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:54.177246 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cdc73-eff0-43f5-9bd1-647b4a20a6c3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:54.184164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 128/253] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:53 2022] GET /identity/v3/role_assignments?user.id=b96f579f1412440a8d75c031bc43b705&scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b&role.id=ccb4819e599749909ff92aedeeb810fd => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:54.185180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cdc73-eff0-43f5-9bd1-647b4a20a6c3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:54.208657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:54.259505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dad03b-08d2-4ecf-a002-d5af65465e7c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:54.312584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab908db0-a2a7-4bb3-9575-2beb8e737725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:54.314577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab908db0-a2a7-4bb3-9575-2beb8e737725 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:54.315355 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab908db0-a2a7-4bb3-9575-2beb8e737725 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:54.316185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab908db0-a2a7-4bb3-9575-2beb8e737725 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:54.318063 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab908db0-a2a7-4bb3-9575-2beb8e737725 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:54.319887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab908db0-a2a7-4bb3-9575-2beb8e737725 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:54.322815 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 126/254] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:54 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:54.331194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab908db0-a2a7-4bb3-9575-2beb8e737725 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:54.362818 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:54.400920 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cdc73-eff0-43f5-9bd1-647b4a20a6c3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:54.503234 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa583db-13c0-4155-84b9-8d23b9957ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:54.504041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa583db-13c0-4155-84b9-8d23b9957ebd None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:54.504325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa583db-13c0-4155-84b9-8d23b9957ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:54.504596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa583db-13c0-4155-84b9-8d23b9957ebd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:54.540436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa583db-13c0-4155-84b9-8d23b9957ebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-2fa583db-13c0-4155-84b9-8d23b9957ebd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:54.551639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:54.552604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:54.553927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:54.553927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:54.553927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:54.553927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:54.553927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:54.553927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:54.553927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:54.553927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:54.553927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:54.553927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:54.553927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:54:54.553927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:54:54.559749 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 129/255] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:54:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:54.567207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab908db0-a2a7-4bb3-9575-2beb8e737725 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:54.574481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa583db-13c0-4155-84b9-8d23b9957ebd None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:54.653871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f03f8f-c321-4ab8-9205-5b9b4e8f61d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:54.656548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03f8f-c321-4ab8-9205-5b9b4e8f61d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:54.657313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03f8f-c321-4ab8-9205-5b9b4e8f61d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:54.658019 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03f8f-c321-4ab8-9205-5b9b4e8f61d4 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b/users/4c84fb182e5a4af0977db1833ec58f6f/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:54.660514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f03f8f-c321-4ab8-9205-5b9b4e8f61d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cbc0a559a674cb78cba6f09b7f95a3b, user_id=4c84fb182e5a4af0977db1833ec58f6f, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:54.663379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f03f8f-c321-4ab8-9205-5b9b4e8f61d4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:54.693760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 127/256] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:54:54 2022] PUT /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b/users/4c84fb182e5a4af0977db1833ec58f6f/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:54:54.725746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2090d-60ef-4746-b077-e01b0a1b5334 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:54.726474 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2090d-60ef-4746-b077-e01b0a1b5334 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:54.726983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2090d-60ef-4746-b077-e01b0a1b5334 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:54.728711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 128/257] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:54.743496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1648cc0-5ec0-4536-b5e6-d538ec505556 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:54.744102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1648cc0-5ec0-4536-b5e6-d538ec505556 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:54.744803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1648cc0-5ec0-4536-b5e6-d538ec505556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:54.790422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d1648cc0-5ec0-4536-b5e6-d538ec505556 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:54.793663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d1648cc0-5ec0-4536-b5e6-d538ec505556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:54.794717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:54.865344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa583db-13c0-4155-84b9-8d23b9957ebd None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:54.971189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6602c-c107-4f58-97b6-8bc1c60b6f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:54.971987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6602c-c107-4f58-97b6-8bc1c60b6f00 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:54.972287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6602c-c107-4f58-97b6-8bc1c60b6f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:54.972570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6602c-c107-4f58-97b6-8bc1c60b6f00 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:54.973355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6602c-c107-4f58-97b6-8bc1c60b6f00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:54.973670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6602c-c107-4f58-97b6-8bc1c60b6f00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:54.975139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6602c-c107-4f58-97b6-8bc1c60b6f00 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:54.979416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 129/258] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:54.992449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 130/259] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:54.998397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1648cc0-5ec0-4536-b5e6-d538ec505556 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:55.004795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:55.027777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6602c-c107-4f58-97b6-8bc1c60b6f00 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:55.196421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1648cc0-5ec0-4536-b5e6-d538ec505556 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:55.209089 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6602c-c107-4f58-97b6-8bc1c60b6f00 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:55.270784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3f95-2628-4ade-b344-c61af48e1280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:55.271937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3f95-2628-4ade-b344-c61af48e1280 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:55.272429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3f95-2628-4ade-b344-c61af48e1280 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:55.272877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3f95-2628-4ade-b344-c61af48e1280 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:55.287592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:55.292087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c2fc1-4db5-48b8-9e2d-ffa9ec7d0d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:55.292999 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c2fc1-4db5-48b8-9e2d-ffa9ec7d0d35 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:55.293295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c2fc1-4db5-48b8-9e2d-ffa9ec7d0d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:55.293617 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c2fc1-4db5-48b8-9e2d-ffa9ec7d0d35 None admin] PATH_INFO: `/v3/users/b3d3ca92577b4a29b53e0d4fedacc8b6` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:55.294061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c3f95-2628-4ade-b344-c61af48e1280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:55.299405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c2fc1-4db5-48b8-9e2d-ffa9ec7d0d35 None admin] RBAC: Authorizing `identity:get_user(user_id=b3d3ca92577b4a29b53e0d4fedacc8b6)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:55.300882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c2fc1-4db5-48b8-9e2d-ffa9ec7d0d35 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:55.307057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 130/260] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:54 2022] GET /identity/v3/users/b3d3ca92577b4a29b53e0d4fedacc8b6 => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:55.308219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c2fc1-4db5-48b8-9e2d-ffa9ec7d0d35 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-1c8c3f95-2628-4ade-b344-c61af48e1280 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:55.309419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:55.310289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:55.311464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:55.311464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:55.311464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:55.311464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:55.311464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:55.311464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:55.311464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:55.311464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:55.311464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:55.311464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:55.311464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:54:55.311464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:54:55.313562 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 131/261] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:54:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:54:55.319793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3f95-2628-4ade-b344-c61af48e1280 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:55.495674 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3f95-2628-4ade-b344-c61af48e1280 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:55.504564 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:55.556740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19160517-9fbd-4cac-a858-088babdf13df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:55.558520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19160517-9fbd-4cac-a858-088babdf13df None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:55.559053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19160517-9fbd-4cac-a858-088babdf13df None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:55.559477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19160517-9fbd-4cac-a858-088babdf13df None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:55.560374 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19160517-9fbd-4cac-a858-088babdf13df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:55.560827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19160517-9fbd-4cac-a858-088babdf13df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:55.562342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19160517-9fbd-4cac-a858-088babdf13df None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:55.568135 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c2fc1-4db5-48b8-9e2d-ffa9ec7d0d35 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:55.580309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 132/262] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:54:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:55.585411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19160517-9fbd-4cac-a858-088babdf13df None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:55.625223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9e77d-4505-428b-86c6-678a0982f9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:55.626156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9e77d-4505-428b-86c6-678a0982f9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:55.626755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9e77d-4505-428b-86c6-678a0982f9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:55.628430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9e77d-4505-428b-86c6-678a0982f9a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:55.682681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:55.730948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19160517-9fbd-4cac-a858-088babdf13df None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:55.778707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9e77d-4505-428b-86c6-678a0982f9a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:55.780512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9e77d-4505-428b-86c6-678a0982f9a1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:55.823998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417a7fe-a80c-4cc3-b1f6-fde55982dddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:55.825145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417a7fe-a80c-4cc3-b1f6-fde55982dddf None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:55.825425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417a7fe-a80c-4cc3-b1f6-fde55982dddf None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:55.825698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417a7fe-a80c-4cc3-b1f6-fde55982dddf None admin] PATH_INFO: `/v3/users/b3d3ca92577b4a29b53e0d4fedacc8b6` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:55.826919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417a7fe-a80c-4cc3-b1f6-fde55982dddf None admin] RBAC: Authorizing `identity:get_user(user_id=b3d3ca92577b4a29b53e0d4fedacc8b6)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:55.828345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417a7fe-a80c-4cc3-b1f6-fde55982dddf None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:55.838726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 133/263] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:55 2022] GET /identity/v3/users/b3d3ca92577b4a29b53e0d4fedacc8b6 => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:55.839622 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417a7fe-a80c-4cc3-b1f6-fde55982dddf None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:55.853924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:55.894889 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 131/264] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:55.904192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9e77d-4505-428b-86c6-678a0982f9a1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:56.020882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9e77d-4505-428b-86c6-678a0982f9a1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:56.024120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417a7fe-a80c-4cc3-b1f6-fde55982dddf None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:56.070962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:56.083977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39693d5-91d6-4368-9646-603fd3a06964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:56.084647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39693d5-91d6-4368-9646-603fd3a06964 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:56.084933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39693d5-91d6-4368-9646-603fd3a06964 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:56.085210 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39693d5-91d6-4368-9646-603fd3a06964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:56.124568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec874243-21d2-470d-972b-acf84525f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:56.125505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec874243-21d2-470d-972b-acf84525f91e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:56.125793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec874243-21d2-470d-972b-acf84525f91e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:56.126083 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec874243-21d2-470d-972b-acf84525f91e None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:56.135133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec874243-21d2-470d-972b-acf84525f91e None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:56.136634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec874243-21d2-470d-972b-acf84525f91e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:56.138763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 132/265] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:55 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:56.144208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec874243-21d2-470d-972b-acf84525f91e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:56.230741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:56.247401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39693d5-91d6-4368-9646-603fd3a06964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:56.249161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39693d5-91d6-4368-9646-603fd3a06964 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:56.374323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec874243-21d2-470d-972b-acf84525f91e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:56.463077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32933219-8180-40de-a665-04454ccdc7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:56.463751 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32933219-8180-40de-a665-04454ccdc7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:56.464039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32933219-8180-40de-a665-04454ccdc7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:56.464322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32933219-8180-40de-a665-04454ccdc7c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:56.465195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32933219-8180-40de-a665-04454ccdc7c4 None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b, user.id=b3d3ca92577b4a29b53e0d4fedacc8b6) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:56.465494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32933219-8180-40de-a665-04454ccdc7c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:56.466987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32933219-8180-40de-a665-04454ccdc7c4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:56.481108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 133/266] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:56 2022] GET /identity/v3/role_assignments?user.id=b3d3ca92577b4a29b53e0d4fedacc8b6&scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:56.504367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 134/267] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:56.509620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32933219-8180-40de-a665-04454ccdc7c4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:56.686101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32933219-8180-40de-a665-04454ccdc7c4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:56.689345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:56.734342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad52f8-8f27-49b8-b85d-3abf82a72a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:56.736372 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad52f8-8f27-49b8-b85d-3abf82a72a2d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:56.736930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad52f8-8f27-49b8-b85d-3abf82a72a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:56.737450 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad52f8-8f27-49b8-b85d-3abf82a72a2d None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:56.743138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad52f8-8f27-49b8-b85d-3abf82a72a2d None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:56.744805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad52f8-8f27-49b8-b85d-3abf82a72a2d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:56.747104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 134/268] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:56 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:56.752936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39693d5-91d6-4368-9646-603fd3a06964 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:56.808099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:56.889450 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa483d81-5ac3-4bc6-888f-7ddb03a7694a None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:56.889775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa483d81-5ac3-4bc6-888f-7ddb03a7694a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:56.890019 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa483d81-5ac3-4bc6-888f-7ddb03a7694a None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:56.891819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 135/269] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:56.897692 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77260a6-2970-4259-9497-0036bf7b7779 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:56.897977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77260a6-2970-4259-9497-0036bf7b7779 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:56.898265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77260a6-2970-4259-9497-0036bf7b7779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:56.914230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39693d5-91d6-4368-9646-603fd3a06964 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:56.941050 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f77260a6-2970-4259-9497-0036bf7b7779 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:56.942170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f77260a6-2970-4259-9497-0036bf7b7779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:57.016062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bd04e-e217-4610-bd25-343b0e5c735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:57.016915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bd04e-e217-4610-bd25-343b0e5c735e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:57.017694 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bd04e-e217-4610-bd25-343b0e5c735e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:57.017984 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bd04e-e217-4610-bd25-343b0e5c735e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:57.018882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bd04e-e217-4610-bd25-343b0e5c735e None admin] RBAC: Adding query filter params (role.id=c4b17c7a2a644e91a1872f5fa53e6421, scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b, user.id=b3d3ca92577b4a29b53e0d4fedacc8b6) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:57.019202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bd04e-e217-4610-bd25-343b0e5c735e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:57.020689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bd04e-e217-4610-bd25-343b0e5c735e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:57.035164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 135/270] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:56 2022] GET /identity/v3/role_assignments?user.id=b3d3ca92577b4a29b53e0d4fedacc8b6&scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b&role.id=c4b17c7a2a644e91a1872f5fa53e6421 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:57.097529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 136/271] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:54:57.134158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bd04e-e217-4610-bd25-343b0e5c735e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:57.250180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:57.257559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bd04e-e217-4610-bd25-343b0e5c735e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:57.296469 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff42d-b3df-488b-beb0-a022db8f6dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:57.297292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff42d-b3df-488b-beb0-a022db8f6dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:57.297574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff42d-b3df-488b-beb0-a022db8f6dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:57.297852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff42d-b3df-488b-beb0-a022db8f6dd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:57.310312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ff42d-b3df-488b-beb0-a022db8f6dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-ee7ff42d-b3df-488b-beb0-a022db8f6dd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:57.318446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:57.319370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:54:57.320150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 136/272] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:57.325774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77260a6-2970-4259-9497-0036bf7b7779 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:57.421614 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dccdb-34c1-4b76-9c4a-09319528128e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:57.421934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dccdb-34c1-4b76-9c4a-09319528128e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:57.422180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dccdb-34c1-4b76-9c4a-09319528128e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:57.424127 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 137/273] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:57.432358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db24025-3bac-4435-b308-6c45ee1b0d01 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:57.432358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db24025-3bac-4435-b308-6c45ee1b0d01 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:57.432358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db24025-3bac-4435-b308-6c45ee1b0d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:57.443009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:57.447766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77260a6-2970-4259-9497-0036bf7b7779 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:57.453613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5db24025-3bac-4435-b308-6c45ee1b0d01 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:57.456070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5db24025-3bac-4435-b308-6c45ee1b0d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:57.485974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317c099-5b2d-4d1d-83ad-66de9fcc4a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:57.486683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317c099-5b2d-4d1d-83ad-66de9fcc4a51 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:57.486967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317c099-5b2d-4d1d-83ad-66de9fcc4a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:57.487328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317c099-5b2d-4d1d-83ad-66de9fcc4a51 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:57.488025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317c099-5b2d-4d1d-83ad-66de9fcc4a51 None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:57.488293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317c099-5b2d-4d1d-83ad-66de9fcc4a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:57.489652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317c099-5b2d-4d1d-83ad-66de9fcc4a51 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:57.503560 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 137/274] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:57.504829 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a764cb1-cd94-4294-b82d-6a21d517b1a4 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:57.505123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a764cb1-cd94-4294-b82d-6a21d517b1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:57.505407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a764cb1-cd94-4294-b82d-6a21d517b1a4 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:57.507276 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 138/275] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:57.508000 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a764cb1-cd94-4294-b82d-6a21d517b1a4 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:57.541149 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 138/276] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:57.542796 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16d7e9-e684-4926-92cf-284760e9b8fd None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:57.543108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16d7e9-e684-4926-92cf-284760e9b8fd None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:57.543386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16d7e9-e684-4926-92cf-284760e9b8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:57.559583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5c16d7e9-e684-4926-92cf-284760e9b8fd None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:57.560750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5c16d7e9-e684-4926-92cf-284760e9b8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:57.638388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 139/277] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:54:57.638388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16d7e9-e684-4926-92cf-284760e9b8fd None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:57.643786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a764cb1-cd94-4294-b82d-6a21d517b1a4 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:57.648631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:57.687902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70deec-9f22-438a-a449-6f3685599a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:57.689432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70deec-9f22-438a-a449-6f3685599a96 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:57.689820 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70deec-9f22-438a-a449-6f3685599a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:57.689989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70deec-9f22-438a-a449-6f3685599a96 None admin] PATH_INFO: `/v3/users/5ec35091425740f3aa7f3b544b6dad20` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:57.703542 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70deec-9f22-438a-a449-6f3685599a96 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec35091425740f3aa7f3b544b6dad20)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:57.705391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70deec-9f22-438a-a449-6f3685599a96 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:57.711638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 139/278] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:57 2022] GET /identity/v3/users/5ec35091425740f3aa7f3b544b6dad20 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:57.711638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70deec-9f22-438a-a449-6f3685599a96 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:57.732385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:57.751689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16d7e9-e684-4926-92cf-284760e9b8fd None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:57.797487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea90a-f190-420b-a2d6-f9bee3aaa597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:57.798550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea90a-f190-420b-a2d6-f9bee3aaa597 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:57.798896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea90a-f190-420b-a2d6-f9bee3aaa597 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:57.799178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea90a-f190-420b-a2d6-f9bee3aaa597 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:57.800364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddea90a-f190-420b-a2d6-f9bee3aaa597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:57.802035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddea90a-f190-420b-a2d6-f9bee3aaa597 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:57.803687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 140/279] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:54:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:57.804568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea90a-f190-420b-a2d6-f9bee3aaa597 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:57.825452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70deec-9f22-438a-a449-6f3685599a96 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:57.861268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26674f2-22a7-46b2-adf3-86a2c90d3805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:57.862270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26674f2-22a7-46b2-adf3-86a2c90d3805 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:57.862584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26674f2-22a7-46b2-adf3-86a2c90d3805 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:57.862858 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26674f2-22a7-46b2-adf3-86a2c90d3805 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:57.876349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26674f2-22a7-46b2-adf3-86a2c90d3805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-f26674f2-22a7-46b2-adf3-86a2c90d3805 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:57.884327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:57.885248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:57.886057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:57.886057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:57.886057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:57.886057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:57.886057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:57.886057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:57.886057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:57.886057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:57.886057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:57.886057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:57.886057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:54:57.886057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:57.890272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 140/280] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:57.891120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26674f2-22a7-46b2-adf3-86a2c90d3805 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:57.897041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:57.919884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea90a-f190-420b-a2d6-f9bee3aaa597 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:57.955300 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c007f-f129-4ec4-9da7-70ad5a342682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:57.955964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c007f-f129-4ec4-9da7-70ad5a342682 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:57.956256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c007f-f129-4ec4-9da7-70ad5a342682 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:57.956537 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c007f-f129-4ec4-9da7-70ad5a342682 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:57.957366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c007f-f129-4ec4-9da7-70ad5a342682 None admin] RBAC: Adding query filter params (role.id=3027d01b9e8b469784a8db0de5f043bd, user.id=5ec35091425740f3aa7f3b544b6dad20, scope.system=all) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:57.957683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c007f-f129-4ec4-9da7-70ad5a342682 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:57.959136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c007f-f129-4ec4-9da7-70ad5a342682 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:57.964034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 141/281] 10.222.0.49 () {56 vars in 1308 bytes} [Mon May 23 16:54:57 2022] GET /identity/v3/role_assignments?user.id=5ec35091425740f3aa7f3b544b6dad20&scope.system=all&role.id=3027d01b9e8b469784a8db0de5f043bd => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:57.964812 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c007f-f129-4ec4-9da7-70ad5a342682 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:57.977955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:58.002986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26674f2-22a7-46b2-adf3-86a2c90d3805 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:58.041630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340937a-73c7-44dc-b306-be566b4c82e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:58.042239 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340937a-73c7-44dc-b306-be566b4c82e0 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:58.042553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340937a-73c7-44dc-b306-be566b4c82e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:58.042834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340937a-73c7-44dc-b306-be566b4c82e0 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:58.043567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340937a-73c7-44dc-b306-be566b4c82e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:58.045050 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340937a-73c7-44dc-b306-be566b4c82e0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:58.067628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 141/282] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:54:57 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:54:58.069066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a19b-6d2c-4dd6-8f74-0b869202f663 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:58.069362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a19b-6d2c-4dd6-8f74-0b869202f663 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:58.069640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a19b-6d2c-4dd6-8f74-0b869202f663 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:58.074431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 142/283] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:58.077117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89952a-a9c3-433d-9797-47b17a6a78dc None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:58.077413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89952a-a9c3-433d-9797-47b17a6a78dc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:58.077700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89952a-a9c3-433d-9797-47b17a6a78dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:58.097024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ec89952a-a9c3-433d-9797-47b17a6a78dc None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:58.098313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ec89952a-a9c3-433d-9797-47b17a6a78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:58.105980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c007f-f129-4ec4-9da7-70ad5a342682 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:58.150698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706732b-365c-468a-b981-f6e6ba0cde80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:58.151738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706732b-365c-468a-b981-f6e6ba0cde80 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:58.152958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706732b-365c-468a-b981-f6e6ba0cde80 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:58.153493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706732b-365c-468a-b981-f6e6ba0cde80 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:58.154557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706732b-365c-468a-b981-f6e6ba0cde80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:58.155085 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706732b-365c-468a-b981-f6e6ba0cde80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:58.158218 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706732b-365c-468a-b981-f6e6ba0cde80 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:58.169243 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 142/284] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:58.175206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706732b-365c-468a-b981-f6e6ba0cde80 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:58.194505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:58.206387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 143/285] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:54:58.230863 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89952a-a9c3-433d-9797-47b17a6a78dc None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:58.308027 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:58.310825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706732b-365c-468a-b981-f6e6ba0cde80 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:58.355853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89952a-a9c3-433d-9797-47b17a6a78dc None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:58.360084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee18f41-2fed-48ab-9501-f0369f8389ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:58.361155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee18f41-2fed-48ab-9501-f0369f8389ee None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:58.361560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee18f41-2fed-48ab-9501-f0369f8389ee None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:58.361938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee18f41-2fed-48ab-9501-f0369f8389ee None admin] PATH_INFO: `/v3/users/b96f579f1412440a8d75c031bc43b705` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:58.363357 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee18f41-2fed-48ab-9501-f0369f8389ee None admin] RBAC: Authorizing `identity:get_user(user_id=b96f579f1412440a8d75c031bc43b705)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:58.365014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee18f41-2fed-48ab-9501-f0369f8389ee None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:58.367118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 143/286] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:58 2022] GET /identity/v3/users/b96f579f1412440a8d75c031bc43b705 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:58.372513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee18f41-2fed-48ab-9501-f0369f8389ee None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:58.402122 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763848dd-ebd4-4df1-b82f-85a32d1aeae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:58.402989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763848dd-ebd4-4df1-b82f-85a32d1aeae2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:58.403273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763848dd-ebd4-4df1-b82f-85a32d1aeae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:58.403547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763848dd-ebd4-4df1-b82f-85a32d1aeae2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:58.417976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763848dd-ebd4-4df1-b82f-85a32d1aeae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-763848dd-ebd4-4df1-b82f-85a32d1aeae2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:54:58.426562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:54:58.427482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:54:58.428273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 144/287] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:54:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:54:58.433673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763848dd-ebd4-4df1-b82f-85a32d1aeae2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:58.484705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:58.522087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee18f41-2fed-48ab-9501-f0369f8389ee None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:58.555855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763848dd-ebd4-4df1-b82f-85a32d1aeae2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:58.561992 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4f029-0428-4c4d-a735-a27d2b844cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:58.562982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4f029-0428-4c4d-a735-a27d2b844cfa None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:58.563370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4f029-0428-4c4d-a735-a27d2b844cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:58.564264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4f029-0428-4c4d-a735-a27d2b844cfa None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:58.566192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4f029-0428-4c4d-a735-a27d2b844cfa None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:58.567745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4f029-0428-4c4d-a735-a27d2b844cfa None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:58.571006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 144/288] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:58 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:58.582013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4f029-0428-4c4d-a735-a27d2b844cfa None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:58.592558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:58.603400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ae6c1-e85d-4065-8167-e2d3e7bf7956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:58.604124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ae6c1-e85d-4065-8167-e2d3e7bf7956 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:58.604407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ae6c1-e85d-4065-8167-e2d3e7bf7956 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:58.604731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ae6c1-e85d-4065-8167-e2d3e7bf7956 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:58.605486 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ae6c1-e85d-4065-8167-e2d3e7bf7956 None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:58.605791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ae6c1-e85d-4065-8167-e2d3e7bf7956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:58.607265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ae6c1-e85d-4065-8167-e2d3e7bf7956 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:58.617882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 145/289] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:54:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:54:58.627371 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ae6c1-e85d-4065-8167-e2d3e7bf7956 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:58.782705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4f029-0428-4c4d-a735-a27d2b844cfa None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:58.816445 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ae6c1-e85d-4065-8167-e2d3e7bf7956 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:58.819643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1dd45-542a-487c-99d3-7499b1f78037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:58.820550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1dd45-542a-487c-99d3-7499b1f78037 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:58.820838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1dd45-542a-487c-99d3-7499b1f78037 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:58.821120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1dd45-542a-487c-99d3-7499b1f78037 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b/users/b96f579f1412440a8d75c031bc43b705/roles/ccb4819e599749909ff92aedeeb810fd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:58.823155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1dd45-542a-487c-99d3-7499b1f78037 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cbc0a559a674cb78cba6f09b7f95a3b, user_id=b96f579f1412440a8d75c031bc43b705, role_id=ccb4819e599749909ff92aedeeb810fd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:58.824860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1dd45-542a-487c-99d3-7499b1f78037 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:58.861891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 145/290] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:54:58 2022] PUT /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b/users/b96f579f1412440a8d75c031bc43b705/roles/ccb4819e599749909ff92aedeeb810fd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:54:58.874134 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f387f5d-8fa1-4015-be37-d5b4acd88a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:58.875088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f387f5d-8fa1-4015-be37-d5b4acd88a86 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:58.875377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f387f5d-8fa1-4015-be37-d5b4acd88a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:58.875659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f387f5d-8fa1-4015-be37-d5b4acd88a86 None admin] PATH_INFO: `/v3/users/4c84fb182e5a4af0977db1833ec58f6f` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:58.878895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f387f5d-8fa1-4015-be37-d5b4acd88a86 None admin] RBAC: Authorizing `identity:get_user(user_id=4c84fb182e5a4af0977db1833ec58f6f)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:58.880468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f387f5d-8fa1-4015-be37-d5b4acd88a86 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:58.882795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 146/291] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:54:58 2022] GET /identity/v3/users/4c84fb182e5a4af0977db1833ec58f6f => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:58.892577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1dd45-542a-487c-99d3-7499b1f78037 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:58.902714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:59.057849 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1dd45-542a-487c-99d3-7499b1f78037 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:59.112055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37a008-4ca0-4653-b37b-e2c416a6a7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:59.112732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37a008-4ca0-4653-b37b-e2c416a6a7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:59.113022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37a008-4ca0-4653-b37b-e2c416a6a7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:59.113304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37a008-4ca0-4653-b37b-e2c416a6a7d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:59.198055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37a008-4ca0-4653-b37b-e2c416a6a7d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:59.199846 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37a008-4ca0-4653-b37b-e2c416a6a7d8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:59.203196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:59.327362 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 146/292] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:54:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:54:59.333120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f387f5d-8fa1-4015-be37-d5b4acd88a86 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:59.430302 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:59.495184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f387f5d-8fa1-4015-be37-d5b4acd88a86 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:59.544380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22dfef-5a19-4dfc-96ff-325e74cefd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:59.545250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22dfef-5a19-4dfc-96ff-325e74cefd9e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:59.545535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22dfef-5a19-4dfc-96ff-325e74cefd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:59.545811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22dfef-5a19-4dfc-96ff-325e74cefd9e None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:59.547041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22dfef-5a19-4dfc-96ff-325e74cefd9e None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:59.549030 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22dfef-5a19-4dfc-96ff-325e74cefd9e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:59.551720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 147/293] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:54:59 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:59.556703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37a008-4ca0-4653-b37b-e2c416a6a7d8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:59.702812 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37a008-4ca0-4653-b37b-e2c416a6a7d8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:59.707405 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:59.755699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd58e4-c1b3-4125-a907-0cfe38ac5a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:59.756424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd58e4-c1b3-4125-a907-0cfe38ac5a97 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:59.756718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd58e4-c1b3-4125-a907-0cfe38ac5a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:59.756998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd58e4-c1b3-4125-a907-0cfe38ac5a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:59.757851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd58e4-c1b3-4125-a907-0cfe38ac5a97 None admin] RBAC: Adding query filter params (role.id=3027d01b9e8b469784a8db0de5f043bd, scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b, user.id=4c84fb182e5a4af0977db1833ec58f6f) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:59.758170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd58e4-c1b3-4125-a907-0cfe38ac5a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:59.759631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd58e4-c1b3-4125-a907-0cfe38ac5a97 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:59.771766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 147/294] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:54:59 2022] GET /identity/v3/role_assignments?user.id=4c84fb182e5a4af0977db1833ec58f6f&scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b&role.id=3027d01b9e8b469784a8db0de5f043bd => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:00.530467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecf735-b907-4614-92ec-9e0ba68cbc95 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:00.530992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecf735-b907-4614-92ec-9e0ba68cbc95 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:00.531075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecf735-b907-4614-92ec-9e0ba68cbc95 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:00.533258 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 148/295] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:00.538494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd613-1331-486e-8d25-59a7d3dbd024 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:00.538906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd613-1331-486e-8d25-59a7d3dbd024 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:00.539108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd613-1331-486e-8d25-59a7d3dbd024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:00.559356 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b1efd613-1331-486e-8d25-59a7d3dbd024 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:00.560612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b1efd613-1331-486e-8d25-59a7d3dbd024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:00.637488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 148/296] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:00.659864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecf735-b907-4614-92ec-9e0ba68cbc95 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:00.773579 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecf735-b907-4614-92ec-9e0ba68cbc95 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:00.802994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:00.816075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b563b9f-0982-47ac-9f7e-eeaa2f0e72e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:00.816910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b563b9f-0982-47ac-9f7e-eeaa2f0e72e0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:00.817368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b563b9f-0982-47ac-9f7e-eeaa2f0e72e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:00.817658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b563b9f-0982-47ac-9f7e-eeaa2f0e72e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:00.831364 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b563b9f-0982-47ac-9f7e-eeaa2f0e72e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6b563b9f-0982-47ac-9f7e-eeaa2f0e72e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:00.839077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:00.839944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:00.840737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 149/297] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:00.846909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd613-1331-486e-8d25-59a7d3dbd024 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:00.949872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:00.956059 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd613-1331-486e-8d25-59a7d3dbd024 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:00.958292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed5ce6-03cf-4c2b-8aa4-f3a50ebc2faf None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:00.958603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed5ce6-03cf-4c2b-8aa4-f3a50ebc2faf None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:00.958938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed5ce6-03cf-4c2b-8aa4-f3a50ebc2faf None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:00.960447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 150/298] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:00.965562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c3972-b258-4647-8c39-7feba2940641 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:00.966112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c3972-b258-4647-8c39-7feba2940641 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:00.966633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c3972-b258-4647-8c39-7feba2940641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:00.987699 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0c4c3972-b258-4647-8c39-7feba2940641 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:00.989913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0c4c3972-b258-4647-8c39-7feba2940641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:01.002167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4298d-8b85-472d-aa2b-3425e53f5552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:01.002882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4298d-8b85-472d-aa2b-3425e53f5552 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.003171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4298d-8b85-472d-aa2b-3425e53f5552 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.003718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4298d-8b85-472d-aa2b-3425e53f5552 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.004478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4298d-8b85-472d-aa2b-3425e53f5552 None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:01.004787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4298d-8b85-472d-aa2b-3425e53f5552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:01.006353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4298d-8b85-472d-aa2b-3425e53f5552 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:01.019459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 149/299] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:55:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:01.026000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4298d-8b85-472d-aa2b-3425e53f5552 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:01.070483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 151/300] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:55:01.070483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b24af2-9767-4fd5-9136-5db185e33239 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.070483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b24af2-9767-4fd5-9136-5db185e33239 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.070483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b24af2-9767-4fd5-9136-5db185e33239 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.070483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 152/301] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:01.075784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cde81-ca2e-448f-b812-b256d42044a5 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.076079 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cde81-ca2e-448f-b812-b256d42044a5 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.076361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cde81-ca2e-448f-b812-b256d42044a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.093195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-da7cde81-ca2e-448f-b812-b256d42044a5 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:01.094409 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-da7cde81-ca2e-448f-b812-b256d42044a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:01.145335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4298d-8b85-472d-aa2b-3425e53f5552 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:01.165198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 153/302] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:55:01.165848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cde81-ca2e-448f-b812-b256d42044a5 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:01.192608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e4390-c34a-4d75-ae58-c62b5c7d80db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:01.193490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e4390-c34a-4d75-ae58-c62b5c7d80db None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.193837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e4390-c34a-4d75-ae58-c62b5c7d80db None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.194120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e4390-c34a-4d75-ae58-c62b5c7d80db None admin] PATH_INFO: `/v3/users/5ec35091425740f3aa7f3b544b6dad20` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.195374 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e4390-c34a-4d75-ae58-c62b5c7d80db None admin] RBAC: Authorizing `identity:get_user(user_id=5ec35091425740f3aa7f3b544b6dad20)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:01.196803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e4390-c34a-4d75-ae58-c62b5c7d80db None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:01.198456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 150/303] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:55:01 2022] GET /identity/v3/users/5ec35091425740f3aa7f3b544b6dad20 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:01.199645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e4390-c34a-4d75-ae58-c62b5c7d80db None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:01.222590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:01.231688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:01.291494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cde81-ca2e-448f-b812-b256d42044a5 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:01.313048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e4390-c34a-4d75-ae58-c62b5c7d80db None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:01.330838 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991429a9-b69b-4e8f-b417-518975707734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:01.331567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991429a9-b69b-4e8f-b417-518975707734 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.331856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991429a9-b69b-4e8f-b417-518975707734 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.332133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991429a9-b69b-4e8f-b417-518975707734 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.333298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991429a9-b69b-4e8f-b417-518975707734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:01.334862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991429a9-b69b-4e8f-b417-518975707734 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:01.341060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 154/304] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:01.341060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991429a9-b69b-4e8f-b417-518975707734 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:01.354287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6fd2c-a569-46b5-978c-8b44fc538cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:01.355114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6fd2c-a569-46b5-978c-8b44fc538cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.355401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6fd2c-a569-46b5-978c-8b44fc538cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.355676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6fd2c-a569-46b5-978c-8b44fc538cb8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.366332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6fd2c-a569-46b5-978c-8b44fc538cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-dcc6fd2c-a569-46b5-978c-8b44fc538cb8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:01.374097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:01.375005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:01.375794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 151/305] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:01.376983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6fd2c-a569-46b5-978c-8b44fc538cb8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:01.449312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991429a9-b69b-4e8f-b417-518975707734 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:01.463210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:01.470318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:01.482515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6fd2c-a569-46b5-978c-8b44fc538cb8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:01.487267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac240f-cbe3-4014-8789-1b99b849de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:01.488351 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac240f-cbe3-4014-8789-1b99b849de63 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.488751 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac240f-cbe3-4014-8789-1b99b849de63 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.489166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac240f-cbe3-4014-8789-1b99b849de63 None admin] PATH_INFO: `/v3/system/users/5ec35091425740f3aa7f3b544b6dad20/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.491404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac240f-cbe3-4014-8789-1b99b849de63 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5ec35091425740f3aa7f3b544b6dad20, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:01.492796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac240f-cbe3-4014-8789-1b99b849de63 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:01.502175 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 155/306] 10.222.0.49 () {58 vars in 1334 bytes} [Mon May 23 16:55:01 2022] PUT /identity/v3/system/users/5ec35091425740f3aa7f3b544b6dad20/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:01.507509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac240f-cbe3-4014-8789-1b99b849de63 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:01.520990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977d3a7-8c1b-4d0c-bf12-ee24aec7de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:01.521687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977d3a7-8c1b-4d0c-bf12-ee24aec7de42 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.521974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977d3a7-8c1b-4d0c-bf12-ee24aec7de42 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.522253 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977d3a7-8c1b-4d0c-bf12-ee24aec7de42 None admin] PATH_INFO: `/v3/groups` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.523031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977d3a7-8c1b-4d0c-bf12-ee24aec7de42 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:01.524540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977d3a7-8c1b-4d0c-bf12-ee24aec7de42 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:01.542353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 152/307] 10.222.0.49 () {60 vars in 1134 bytes} [Mon May 23 16:55:01 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:01.543914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6b100-dc7c-4cc8-a87f-3fe8e27e0023 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.544253 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6b100-dc7c-4cc8-a87f-3fe8e27e0023 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.544540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6b100-dc7c-4cc8-a87f-3fe8e27e0023 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.546163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 153/308] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:01.553149 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ffda4-e697-42c0-a677-6788ba3dd3f4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.553465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ffda4-e697-42c0-a677-6788ba3dd3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.553721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ffda4-e697-42c0-a677-6788ba3dd3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.575540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f98ffda4-e697-42c0-a677-6788ba3dd3f4 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:01.576685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f98ffda4-e697-42c0-a677-6788ba3dd3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:01.644982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac240f-cbe3-4014-8789-1b99b849de63 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:01.682391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 154/309] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:01.697428 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818591d5-7a76-4491-be79-26937f9ca363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:01.698128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818591d5-7a76-4491-be79-26937f9ca363 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.698461 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818591d5-7a76-4491-be79-26937f9ca363 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.698746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818591d5-7a76-4491-be79-26937f9ca363 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.699777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818591d5-7a76-4491-be79-26937f9ca363 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:01.700268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818591d5-7a76-4491-be79-26937f9ca363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:01.702385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818591d5-7a76-4491-be79-26937f9ca363 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:01.703663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ffda4-e697-42c0-a677-6788ba3dd3f4 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:01.716240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 156/310] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:55:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:01.721962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818591d5-7a76-4491-be79-26937f9ca363 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:01.776112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:01.802790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:01.832164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ffda4-e697-42c0-a677-6788ba3dd3f4 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:01.863109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818591d5-7a76-4491-be79-26937f9ca363 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:01.876689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4614f-5cd4-4855-9b2c-a8f60ccd5155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:01.877723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4614f-5cd4-4855-9b2c-a8f60ccd5155 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.878326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4614f-5cd4-4855-9b2c-a8f60ccd5155 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.878777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4614f-5cd4-4855-9b2c-a8f60ccd5155 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.892497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4614f-5cd4-4855-9b2c-a8f60ccd5155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:01.900842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95ce5f-8b8b-4355-994a-aa9285e610cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:01.901772 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95ce5f-8b8b-4355-994a-aa9285e610cd None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:01.902151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95ce5f-8b8b-4355-994a-aa9285e610cd None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:01.902580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95ce5f-8b8b-4355-994a-aa9285e610cd None admin] PATH_INFO: `/v3/users/7a20e22fb5054c2d9cdac45c9369d6b7` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-fef4614f-5cd4-4855-9b2c-a8f60ccd5155 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:01.903670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:01.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:01.905724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:01.905724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:01.905724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:01.905724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:01.905724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:01.905724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:01.905724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:01.905724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:01.905724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:01.905724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:01.905724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:55:01.905724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:01.908283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 155/311] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:01.914201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4614f-5cd4-4855-9b2c-a8f60ccd5155 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:01.920863 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95ce5f-8b8b-4355-994a-aa9285e610cd None admin] RBAC: Authorizing `identity:get_user(user_id=7a20e22fb5054c2d9cdac45c9369d6b7)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:01.922594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95ce5f-8b8b-4355-994a-aa9285e610cd None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:01.925635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 157/312] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:55:01 2022] GET /identity/v3/users/7a20e22fb5054c2d9cdac45c9369d6b7 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:01.932479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95ce5f-8b8b-4355-994a-aa9285e610cd None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:02.022954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4614f-5cd4-4855-9b2c-a8f60ccd5155 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:02.057131 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:02.064380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95ce5f-8b8b-4355-994a-aa9285e610cd None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:02.064720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8443b-7a25-4c25-b8c6-a369354bb45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:02.065411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8443b-7a25-4c25-b8c6-a369354bb45d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:02.065706 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8443b-7a25-4c25-b8c6-a369354bb45d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:02.065982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8443b-7a25-4c25-b8c6-a369354bb45d None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:02.066771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8443b-7a25-4c25-b8c6-a369354bb45d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:02.067082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8443b-7a25-4c25-b8c6-a369354bb45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:02.068724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8443b-7a25-4c25-b8c6-a369354bb45d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:02.074813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:02.085703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 156/313] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:55:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:02.088227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8443b-7a25-4c25-b8c6-a369354bb45d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:02.111925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd593d36-1139-4908-8029-ec7c217e70e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:02.113109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd593d36-1139-4908-8029-ec7c217e70e4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:02.113409 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd593d36-1139-4908-8029-ec7c217e70e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:02.113693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd593d36-1139-4908-8029-ec7c217e70e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:02.114857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd593d36-1139-4908-8029-ec7c217e70e4 None admin] RBAC: Adding query filter params (role.id=ccb4819e599749909ff92aedeeb810fd, user.id=7a20e22fb5054c2d9cdac45c9369d6b7, scope.system=all) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:02.115180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd593d36-1139-4908-8029-ec7c217e70e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:02.116895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd593d36-1139-4908-8029-ec7c217e70e4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:02.126499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 158/314] 10.222.0.49 () {56 vars in 1308 bytes} [Mon May 23 16:55:01 2022] GET /identity/v3/role_assignments?user.id=7a20e22fb5054c2d9cdac45c9369d6b7&scope.system=all&role.id=ccb4819e599749909ff92aedeeb810fd => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:02.217637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8443b-7a25-4c25-b8c6-a369354bb45d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:02.261575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f1e97-8cdd-44bc-b024-c2f7767bf466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:02.262560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f1e97-8cdd-44bc-b024-c2f7767bf466 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:02.262850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f1e97-8cdd-44bc-b024-c2f7767bf466 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:02.263128 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f1e97-8cdd-44bc-b024-c2f7767bf466 None admin] PATH_INFO: `/v3/users/b96f579f1412440a8d75c031bc43b705` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:02.264346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f1e97-8cdd-44bc-b024-c2f7767bf466 None admin] RBAC: Authorizing `identity:get_user(user_id=b96f579f1412440a8d75c031bc43b705)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:02.265789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f1e97-8cdd-44bc-b024-c2f7767bf466 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:02.268783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 157/315] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:55:02 2022] GET /identity/v3/users/b96f579f1412440a8d75c031bc43b705 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:02.274132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd593d36-1139-4908-8029-ec7c217e70e4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:02.388581 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd593d36-1139-4908-8029-ec7c217e70e4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:02.425123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acbda0-2978-4d09-9f05-29258b5238dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:02.425837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acbda0-2978-4d09-9f05-29258b5238dd None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:02.426126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acbda0-2978-4d09-9f05-29258b5238dd None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:02.426430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acbda0-2978-4d09-9f05-29258b5238dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:02.455953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:02.499304 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acbda0-2978-4d09-9f05-29258b5238dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:02.500687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acbda0-2978-4d09-9f05-29258b5238dd None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:02.604312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 159/316] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:02.610001 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f1e97-8cdd-44bc-b024-c2f7767bf466 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:02.684489 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:02.721571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f1e97-8cdd-44bc-b024-c2f7767bf466 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:02.757807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc495a-0190-4066-88c8-8cd6bd029a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:02.758917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc495a-0190-4066-88c8-8cd6bd029a05 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:02.759340 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc495a-0190-4066-88c8-8cd6bd029a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:02.759753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc495a-0190-4066-88c8-8cd6bd029a05 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:02.761064 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc495a-0190-4066-88c8-8cd6bd029a05 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:02.762665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc495a-0190-4066-88c8-8cd6bd029a05 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:02.764798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 158/317] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:02 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:02.771356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acbda0-2978-4d09-9f05-29258b5238dd None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:02.842929 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:02.885313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acbda0-2978-4d09-9f05-29258b5238dd None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:02.920697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e122f-b737-460c-bdfd-79b2b12122d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:02.921358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e122f-b737-460c-bdfd-79b2b12122d9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:02.921642 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e122f-b737-460c-bdfd-79b2b12122d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:02.921919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e122f-b737-460c-bdfd-79b2b12122d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:02.922849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e122f-b737-460c-bdfd-79b2b12122d9 None admin] RBAC: Adding query filter params (role.id=ccb4819e599749909ff92aedeeb810fd, scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b, user.id=b96f579f1412440a8d75c031bc43b705) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:02.923230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e122f-b737-460c-bdfd-79b2b12122d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:02.924967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e122f-b737-460c-bdfd-79b2b12122d9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:02.931654 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 160/318] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:02 2022] GET /identity/v3/role_assignments?user.id=b96f579f1412440a8d75c031bc43b705&scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b&role.id=ccb4819e599749909ff92aedeeb810fd => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:03.793988 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab4169-ca89-4dab-a8a3-26adb1f39ba5 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:03.798621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab4169-ca89-4dab-a8a3-26adb1f39ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:03.798621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab4169-ca89-4dab-a8a3-26adb1f39ba5 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:03.798621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 159/319] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:03.807443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598e0ca-4781-4825-af0a-634d7104eb69 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:03.808743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598e0ca-4781-4825-af0a-634d7104eb69 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:03.809026 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598e0ca-4781-4825-af0a-634d7104eb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:03.828165 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b598e0ca-4781-4825-af0a-634d7104eb69 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:03.830025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b598e0ca-4781-4825-af0a-634d7104eb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:03.899854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 161/320] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:03.923315 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab4169-ca89-4dab-a8a3-26adb1f39ba5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:03.937694 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5c06a-17eb-4184-be8d-8ddb6fc15bfd None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:03.937991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5c06a-17eb-4184-be8d-8ddb6fc15bfd None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:03.938302 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5c06a-17eb-4184-be8d-8ddb6fc15bfd None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:03.940579 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 162/321] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:55:03.946721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcfe32-e039-412f-bf9d-d054720d2b1a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:03.947034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcfe32-e039-412f-bf9d-d054720d2b1a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:03.947294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcfe32-e039-412f-bf9d-d054720d2b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:03.964733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-acbcfe32-e039-412f-bf9d-d054720d2b1a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:03.965907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-acbcfe32-e039-412f-bf9d-d054720d2b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:04.024761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:04.038314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab4169-ca89-4dab-a8a3-26adb1f39ba5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:04.047549 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 163/322] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:55:04.070757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcfe32-e039-412f-bf9d-d054720d2b1a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:04.075265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79390a33-4f3e-44cf-8123-b54d2c9dc664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:04.076075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79390a33-4f3e-44cf-8123-b54d2c9dc664 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:04.076360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79390a33-4f3e-44cf-8123-b54d2c9dc664 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:04.076630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79390a33-4f3e-44cf-8123-b54d2c9dc664 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:04.080779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:04.090249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79390a33-4f3e-44cf-8123-b54d2c9dc664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-79390a33-4f3e-44cf-8123-b54d2c9dc664 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:04.098643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:04.099672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:04.100510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 160/323] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:04.105441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79390a33-4f3e-44cf-8123-b54d2c9dc664 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:04.185844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcfe32-e039-412f-bf9d-d054720d2b1a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:04.209978 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79390a33-4f3e-44cf-8123-b54d2c9dc664 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:04.222879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb5037-49f2-4e86-8c1b-e3be39d7b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:04.224098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb5037-49f2-4e86-8c1b-e3be39d7b276 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:04.224933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb5037-49f2-4e86-8c1b-e3be39d7b276 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:04.225405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb5037-49f2-4e86-8c1b-e3be39d7b276 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:04.226788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb5037-49f2-4e86-8c1b-e3be39d7b276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:04.228408 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb5037-49f2-4e86-8c1b-e3be39d7b276 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:04.230536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 164/324] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:04.235640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb5037-49f2-4e86-8c1b-e3be39d7b276 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:04.250205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82463203-63c9-43fb-b38f-9a1169fd7082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:04.251523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82463203-63c9-43fb-b38f-9a1169fd7082 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:04.251960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82463203-63c9-43fb-b38f-9a1169fd7082 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:04.252245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82463203-63c9-43fb-b38f-9a1169fd7082 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:04.252996 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82463203-63c9-43fb-b38f-9a1169fd7082 None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:04.253308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82463203-63c9-43fb-b38f-9a1169fd7082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:04.254692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82463203-63c9-43fb-b38f-9a1169fd7082 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:04.263360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 161/325] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:55:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:04.269154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82463203-63c9-43fb-b38f-9a1169fd7082 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:04.293513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:04.337064 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:04.353925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb5037-49f2-4e86-8c1b-e3be39d7b276 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:04.382928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82463203-63c9-43fb-b38f-9a1169fd7082 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:04.399974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738d831-aba3-42fa-948b-1bbe1d11f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:04.400644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738d831-aba3-42fa-948b-1bbe1d11f094 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:04.400933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738d831-aba3-42fa-948b-1bbe1d11f094 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:04.401214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738d831-aba3-42fa-948b-1bbe1d11f094 None admin] PATH_INFO: `/v3/groups` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:04.401907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738d831-aba3-42fa-948b-1bbe1d11f094 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:04.403378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738d831-aba3-42fa-948b-1bbe1d11f094 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:04.426401 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 165/326] 10.222.0.49 () {60 vars in 1134 bytes} [Mon May 23 16:55:04 2022] POST /identity/v3/groups => generated 226 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:55:04.426590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cde4e-ed6d-4a9f-93c8-274d1971c48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:04.426590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cde4e-ed6d-4a9f-93c8-274d1971c48e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:04.426590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cde4e-ed6d-4a9f-93c8-274d1971c48e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:04.426590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cde4e-ed6d-4a9f-93c8-274d1971c48e None admin] PATH_INFO: `/v3/users/5ec35091425740f3aa7f3b544b6dad20` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:04.426907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cde4e-ed6d-4a9f-93c8-274d1971c48e None admin] RBAC: Authorizing `identity:get_user(user_id=5ec35091425740f3aa7f3b544b6dad20)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:04.426907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cde4e-ed6d-4a9f-93c8-274d1971c48e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:04.426907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 162/327] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:55:04 2022] GET /identity/v3/users/5ec35091425740f3aa7f3b544b6dad20 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:04.432239 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738d831-aba3-42fa-948b-1bbe1d11f094 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:04.506940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485aafe-201a-4c1f-b24d-001bbd7cc2da None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:04.507309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485aafe-201a-4c1f-b24d-001bbd7cc2da None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:04.507553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485aafe-201a-4c1f-b24d-001bbd7cc2da None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:04.509336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 163/328] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:55:04.515199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ca4da-50b5-4136-a3ae-0d9be0104467 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:04.515490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ca4da-50b5-4136-a3ae-0d9be0104467 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:04.515767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ca4da-50b5-4136-a3ae-0d9be0104467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:04.537804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-166ca4da-50b5-4136-a3ae-0d9be0104467 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:04.539442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-166ca4da-50b5-4136-a3ae-0d9be0104467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:04.542479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738d831-aba3-42fa-948b-1bbe1d11f094 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:04.558697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:04.583674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00794290-ed5b-4029-9075-af58ac97d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:04.584376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00794290-ed5b-4029-9075-af58ac97d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:04.584665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00794290-ed5b-4029-9075-af58ac97d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:04.584948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00794290-ed5b-4029-9075-af58ac97d6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:04.585802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00794290-ed5b-4029-9075-af58ac97d6c9 None admin] RBAC: Adding query filter params (role.id=3027d01b9e8b469784a8db0de5f043bd, user.id=5ec35091425740f3aa7f3b544b6dad20, scope.system=all) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:04.586118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00794290-ed5b-4029-9075-af58ac97d6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:04.587662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00794290-ed5b-4029-9075-af58ac97d6c9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:04.610750 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 166/329] 10.222.0.49 () {56 vars in 1308 bytes} [Mon May 23 16:55:04 2022] GET /identity/v3/role_assignments?user.id=5ec35091425740f3aa7f3b544b6dad20&scope.system=all&role.id=3027d01b9e8b469784a8db0de5f043bd => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:04.632700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 164/330] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:04.655446 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00794290-ed5b-4029-9075-af58ac97d6c9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:04.771868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00794290-ed5b-4029-9075-af58ac97d6c9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:04.816229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f084a-7fd7-4a3b-8636-3cb543b0cba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:04.817664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f084a-7fd7-4a3b-8636-3cb543b0cba2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:04.818094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f084a-7fd7-4a3b-8636-3cb543b0cba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:04.818608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f084a-7fd7-4a3b-8636-3cb543b0cba2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:04.830697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f084a-7fd7-4a3b-8636-3cb543b0cba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-8c2f084a-7fd7-4a3b-8636-3cb543b0cba2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:04.838493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:04.839400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:04.840179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 167/331] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:04.845687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ca4da-50b5-4136-a3ae-0d9be0104467 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:04.917134 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:04.967963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ca4da-50b5-4136-a3ae-0d9be0104467 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:05.005420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fe8d0-2dc3-4cd0-82a8-8fdc67313c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:05.006095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fe8d0-2dc3-4cd0-82a8-8fdc67313c78 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:05.006400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fe8d0-2dc3-4cd0-82a8-8fdc67313c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:05.006684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fe8d0-2dc3-4cd0-82a8-8fdc67313c78 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:05.007436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fe8d0-2dc3-4cd0-82a8-8fdc67313c78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:05.007751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fe8d0-2dc3-4cd0-82a8-8fdc67313c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:05.009113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fe8d0-2dc3-4cd0-82a8-8fdc67313c78 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:05.019179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 165/332] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:55:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:05.024657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f084a-7fd7-4a3b-8636-3cb543b0cba2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:05.059804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:05.142400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f084a-7fd7-4a3b-8636-3cb543b0cba2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:05.184459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211ace4-e3ff-4f9f-89f1-c99fe3be61d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:05.185343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211ace4-e3ff-4f9f-89f1-c99fe3be61d4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:05.185629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211ace4-e3ff-4f9f-89f1-c99fe3be61d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:05.185908 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211ace4-e3ff-4f9f-89f1-c99fe3be61d4 None admin] PATH_INFO: `/v3/users/7a20e22fb5054c2d9cdac45c9369d6b7` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:05.187394 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211ace4-e3ff-4f9f-89f1-c99fe3be61d4 None admin] RBAC: Authorizing `identity:get_user(user_id=7a20e22fb5054c2d9cdac45c9369d6b7)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:05.189734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211ace4-e3ff-4f9f-89f1-c99fe3be61d4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:05.191830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 168/333] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:55:05 2022] GET /identity/v3/users/7a20e22fb5054c2d9cdac45c9369d6b7 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:05.197218 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fe8d0-2dc3-4cd0-82a8-8fdc67313c78 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:05.385898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fe8d0-2dc3-4cd0-82a8-8fdc67313c78 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:05.416028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:05.442253 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e7adf-8a07-4ba6-aaab-1c2c5ccb2b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:05.443160 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e7adf-8a07-4ba6-aaab-1c2c5ccb2b8f None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:05.443441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e7adf-8a07-4ba6-aaab-1c2c5ccb2b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:05.443709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e7adf-8a07-4ba6-aaab-1c2c5ccb2b8f None admin] PATH_INFO: `/v3/system/users/7a20e22fb5054c2d9cdac45c9369d6b7/roles/ccb4819e599749909ff92aedeeb810fd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:05.447584 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e7adf-8a07-4ba6-aaab-1c2c5ccb2b8f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7a20e22fb5054c2d9cdac45c9369d6b7, role_id=ccb4819e599749909ff92aedeeb810fd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:05.448958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e7adf-8a07-4ba6-aaab-1c2c5ccb2b8f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:05.468045 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 166/334] 10.222.0.49 () {58 vars in 1334 bytes} [Mon May 23 16:55:05 2022] PUT /identity/v3/system/users/7a20e22fb5054c2d9cdac45c9369d6b7/roles/ccb4819e599749909ff92aedeeb810fd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:07.641138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48215d6-ad16-409f-8996-32a6d2c1cd66 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:07.642962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48215d6-ad16-409f-8996-32a6d2c1cd66 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:07.643483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48215d6-ad16-409f-8996-32a6d2c1cd66 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:07.645833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 169/335] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:07.651614 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b884b3-9d6e-48d3-bc89-82b518942e93 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:07.652493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b884b3-9d6e-48d3-bc89-82b518942e93 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:07.652975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b884b3-9d6e-48d3-bc89-82b518942e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:07.656432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48aae-1843-434d-ab31-602a03c1b3ad None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:07.659148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48aae-1843-434d-ab31-602a03c1b3ad None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:07.659661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48aae-1843-434d-ab31-602a03c1b3ad None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:07.661247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 170/336] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:07.667304 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af56e-5222-43a4-825e-e702a8e6aed6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:07.668393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af56e-5222-43a4-825e-e702a8e6aed6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:07.669349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af56e-5222-43a4-825e-e702a8e6aed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:07.691497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e9b884b3-9d6e-48d3-bc89-82b518942e93 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:07.693085 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e9b884b3-9d6e-48d3-bc89-82b518942e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:07.698207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-884af56e-5222-43a4-825e-e702a8e6aed6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:07.699672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-884af56e-5222-43a4-825e-e702a8e6aed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:07.797133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 167/337] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:07.839910 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b884b3-9d6e-48d3-bc89-82b518942e93 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:07.873064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 171/338] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:07.909117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af56e-5222-43a4-825e-e702a8e6aed6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:07.966731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:08.026929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b884b3-9d6e-48d3-bc89-82b518942e93 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:08.070790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:08.076836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93e0f8-356a-4ee0-a69b-dd895f192ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:08.077980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93e0f8-356a-4ee0-a69b-dd895f192ebb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:08.078276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93e0f8-356a-4ee0-a69b-dd895f192ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:08.078679 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93e0f8-356a-4ee0-a69b-dd895f192ebb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:08.091476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93e0f8-356a-4ee0-a69b-dd895f192ebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-ad93e0f8-356a-4ee0-a69b-dd895f192ebb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:08.101146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:08.102072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:08.103451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 168/339] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:08.120461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93e0f8-356a-4ee0-a69b-dd895f192ebb None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:08.169364 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af56e-5222-43a4-825e-e702a8e6aed6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:08.220043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a90743-6c36-4d99-a178-d57d84a400ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:08.221226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a90743-6c36-4d99-a178-d57d84a400ab None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:08.221725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a90743-6c36-4d99-a178-d57d84a400ab None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:08.222202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a90743-6c36-4d99-a178-d57d84a400ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:08.238507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a90743-6c36-4d99-a178-d57d84a400ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-83a90743-6c36-4d99-a178-d57d84a400ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:08.248271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:08.249210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:08.250011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:08.250011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:08.250011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:08.250011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:08.250011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:08.250011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:08.250011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:08.250011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:08.250011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:08.250011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:08.250011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:08.250011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:08.253505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93e0f8-356a-4ee0-a69b-dd895f192ebb None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:08.255197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 172/340] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:55:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:08.261015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a90743-6c36-4d99-a178-d57d84a400ab None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:08.300134 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3ff5f-1647-4717-a15d-b22c4d691f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:08.300741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3ff5f-1647-4717-a15d-b22c4d691f23 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:08.301025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3ff5f-1647-4717-a15d-b22c4d691f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:08.301303 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3ff5f-1647-4717-a15d-b22c4d691f23 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:08.302052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3ff5f-1647-4717-a15d-b22c4d691f23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:08.302448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3ff5f-1647-4717-a15d-b22c4d691f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:08.303856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3ff5f-1647-4717-a15d-b22c4d691f23 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:08.322792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 169/341] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:55:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:08.327168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38ac27-02fe-4165-abae-6a9c8e491f36 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:08.327328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38ac27-02fe-4165-abae-6a9c8e491f36 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:08.327518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38ac27-02fe-4165-abae-6a9c8e491f36 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:08.330150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 170/342] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:55:08.335590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38ac27-02fe-4165-abae-6a9c8e491f36 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:08.372170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:08.386727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:08.387307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a90743-6c36-4d99-a178-d57d84a400ab None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:08.428360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab741ff-a28a-42df-b18b-2d986e53237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:08.430066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab741ff-a28a-42df-b18b-2d986e53237e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:08.431211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab741ff-a28a-42df-b18b-2d986e53237e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:08.431703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab741ff-a28a-42df-b18b-2d986e53237e None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:08.432854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab741ff-a28a-42df-b18b-2d986e53237e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:08.434484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab741ff-a28a-42df-b18b-2d986e53237e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:08.436776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab741ff-a28a-42df-b18b-2d986e53237e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:08.455884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 173/343] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:08.461465 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed1865-01ab-482e-bae8-1caaaaab17d8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:08.463162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed1865-01ab-482e-bae8-1caaaaab17d8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:08.463699 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed1865-01ab-482e-bae8-1caaaaab17d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:08.495997 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f2ed1865-01ab-482e-bae8-1caaaaab17d8 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:08.498668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f2ed1865-01ab-482e-bae8-1caaaaab17d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:08.524282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38ac27-02fe-4165-abae-6a9c8e491f36 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:08.592953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50a1b-63b5-4a4c-b807-d934d365c89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:08.594001 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50a1b-63b5-4a4c-b807-d934d365c89b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:08.595834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50a1b-63b5-4a4c-b807-d934d365c89b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:08.596334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50a1b-63b5-4a4c-b807-d934d365c89b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:08.619197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 174/344] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:08.620534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed1865-01ab-482e-bae8-1caaaaab17d8 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:08.710273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab50a1b-63b5-4a4c-b807-d934d365c89b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:08.710273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab50a1b-63b5-4a4c-b807-d934d365c89b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:08.744461 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:08.763597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:08.772885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed1865-01ab-482e-bae8-1caaaaab17d8 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:08.816061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3661303-4f3a-4e5a-b136-a50ba90d3919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:08.817103 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3661303-4f3a-4e5a-b136-a50ba90d3919 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:08.817601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3661303-4f3a-4e5a-b136-a50ba90d3919 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:08.818084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3661303-4f3a-4e5a-b136-a50ba90d3919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:08.854140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 171/345] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 16:55:08.855224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50a1b-63b5-4a4c-b807-d934d365c89b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:08.912239 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3661303-4f3a-4e5a-b136-a50ba90d3919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:08.914797 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3661303-4f3a-4e5a-b136-a50ba90d3919 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:08.989892 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50a1b-63b5-4a4c-b807-d934d365c89b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:09.016932 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:09.044197 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d51f8-da31-4164-b3d2-2dce83c8d1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:09.045372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d51f8-da31-4164-b3d2-2dce83c8d1fe None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.045803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d51f8-da31-4164-b3d2-2dce83c8d1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.046220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d51f8-da31-4164-b3d2-2dce83c8d1fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.047432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 175/346] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:09.048533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:09.049261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ca09-4d49-45a2-9552-8be11378b2ae None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.052788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ca09-4d49-45a2-9552-8be11378b2ae None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.052788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ca09-4d49-45a2-9552-8be11378b2ae None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.053168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 176/347] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:09.054000 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193ca09-4d49-45a2-9552-8be11378b2ae None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:09.073609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d51f8-da31-4164-b3d2-2dce83c8d1fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-6c9d51f8-da31-4164-b3d2-2dce83c8d1fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:09.085636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:09.086867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:09.087943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:09.087943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:09.087943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:09.087943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:09.087943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:09.087943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:09.087943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:09.087943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:09.087943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:09.087943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:09.087943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:09.087943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:09.090534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 172/348] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:55:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:09.092943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ec9ba-901d-4ce8-8fae-f39a32391212 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.093663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ec9ba-901d-4ce8-8fae-f39a32391212 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.094087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ec9ba-901d-4ce8-8fae-f39a32391212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.118190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-770ec9ba-901d-4ce8-8fae-f39a32391212 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:09.120027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-770ec9ba-901d-4ce8-8fae-f39a32391212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:09.206486 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193ca09-4d49-45a2-9552-8be11378b2ae None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:09.215444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 173/349] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:09.216516 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ec9ba-901d-4ce8-8fae-f39a32391212 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:09.245345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918420ec-af7d-4407-a982-eec61382f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:09.246010 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918420ec-af7d-4407-a982-eec61382f6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.246301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918420ec-af7d-4407-a982-eec61382f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.247634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918420ec-af7d-4407-a982-eec61382f6c3 None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.248256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918420ec-af7d-4407-a982-eec61382f6c3 None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:09.249755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918420ec-af7d-4407-a982-eec61382f6c3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:09.252069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 177/350] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:09 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:09.252861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918420ec-af7d-4407-a982-eec61382f6c3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:09.309775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:09.345010 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ec9ba-901d-4ce8-8fae-f39a32391212 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:09.372808 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:09.372991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918420ec-af7d-4407-a982-eec61382f6c3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:09.386594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251c2a-77c5-4f45-a1ea-648fde1261c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:09.387456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251c2a-77c5-4f45-a1ea-648fde1261c1 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.388232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251c2a-77c5-4f45-a1ea-648fde1261c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.388232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251c2a-77c5-4f45-a1ea-648fde1261c1 None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.389202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251c2a-77c5-4f45-a1ea-648fde1261c1 None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:09.391774 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251c2a-77c5-4f45-a1ea-648fde1261c1 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:09.393884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 174/351] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:09 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:09.395120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc8687-554c-425e-a616-345b832b9723 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.395405 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc8687-554c-425e-a616-345b832b9723 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.395681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc8687-554c-425e-a616-345b832b9723 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.396898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 175/352] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:09.397576 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc8687-554c-425e-a616-345b832b9723 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:09.417228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51be8d6-9ef4-4421-a007-9983bfa5bfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:09.418195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51be8d6-9ef4-4421-a007-9983bfa5bfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.418523 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51be8d6-9ef4-4421-a007-9983bfa5bfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.418802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51be8d6-9ef4-4421-a007-9983bfa5bfe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.419563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51be8d6-9ef4-4421-a007-9983bfa5bfe2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:09.419870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51be8d6-9ef4-4421-a007-9983bfa5bfe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:09.421235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51be8d6-9ef4-4421-a007-9983bfa5bfe2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:09.432102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 178/353] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:09.433270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51be8d6-9ef4-4421-a007-9983bfa5bfe2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:09.517961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc8687-554c-425e-a616-345b832b9723 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:09.554041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51be8d6-9ef4-4421-a007-9983bfa5bfe2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:09.557740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0d397-69bb-4931-b0ef-91a97039062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:09.558639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0d397-69bb-4931-b0ef-91a97039062e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.558930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0d397-69bb-4931-b0ef-91a97039062e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.559214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0d397-69bb-4931-b0ef-91a97039062e None admin] PATH_INFO: `/v3/groups/d6b97655cde1404ea94c1c6c847833fc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.568197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:09.570284 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0d397-69bb-4931-b0ef-91a97039062e None admin] RBAC: Authorizing `identity:get_group(group_id=d6b97655cde1404ea94c1c6c847833fc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:09.571934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0d397-69bb-4931-b0ef-91a97039062e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:09.573665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 176/354] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:09 2022] GET /identity/v3/groups/d6b97655cde1404ea94c1c6c847833fc => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:09.575267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d4c2c-4d9b-406c-a6ac-c032571f22a3 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.575474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d4c2c-4d9b-406c-a6ac-c032571f22a3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.575750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d4c2c-4d9b-406c-a6ac-c032571f22a3 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.576983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 177/355] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:09.577669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d4c2c-4d9b-406c-a6ac-c032571f22a3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:09.604128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea1152-560e-4eee-80bf-8490e2c36242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:09.605857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1152-560e-4eee-80bf-8490e2c36242 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.605857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1152-560e-4eee-80bf-8490e2c36242 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.605857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1152-560e-4eee-80bf-8490e2c36242 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.619484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea1152-560e-4eee-80bf-8490e2c36242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-abea1152-560e-4eee-80bf-8490e2c36242 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:09.627823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:09.628786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:09.629600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 179/356] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:09.632253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19851238-86ec-46ff-9877-476911a1c44f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.632548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19851238-86ec-46ff-9877-476911a1c44f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.632827 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19851238-86ec-46ff-9877-476911a1c44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.652282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-19851238-86ec-46ff-9877-476911a1c44f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:09.653520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-19851238-86ec-46ff-9877-476911a1c44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:09.658779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:09.717036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d4c2c-4d9b-406c-a6ac-c032571f22a3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:09.740431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 180/357] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:09.741294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19851238-86ec-46ff-9877-476911a1c44f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:09.756941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c26908-7676-4fc4-be1c-98e15e87817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:09.757801 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c26908-7676-4fc4-be1c-98e15e87817e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.758087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c26908-7676-4fc4-be1c-98e15e87817e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.758378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c26908-7676-4fc4-be1c-98e15e87817e None admin] PATH_INFO: `/v3/groups/d6b97655cde1404ea94c1c6c847833fc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.759542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c26908-7676-4fc4-be1c-98e15e87817e None admin] RBAC: Authorizing `identity:get_group(group_id=d6b97655cde1404ea94c1c6c847833fc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:09.760973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c26908-7676-4fc4-be1c-98e15e87817e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:09.762682 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 178/358] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:09 2022] GET /identity/v3/groups/d6b97655cde1404ea94c1c6c847833fc => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:09.763957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f799540-2983-489a-adaf-eaf95848e096 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.767130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f799540-2983-489a-adaf-eaf95848e096 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.767130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f799540-2983-489a-adaf-eaf95848e096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.784541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5f799540-2983-489a-adaf-eaf95848e096 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:09.785616 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5f799540-2983-489a-adaf-eaf95848e096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:09.863367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 179/359] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:09.864309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f799540-2983-489a-adaf-eaf95848e096 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:09.871884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:09.876672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19851238-86ec-46ff-9877-476911a1c44f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:09.921153 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d85ffa-32e1-4f48-acf0-f8256e5d808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:09.921811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d85ffa-32e1-4f48-acf0-f8256e5d808f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.922095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d85ffa-32e1-4f48-acf0-f8256e5d808f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.922397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d85ffa-32e1-4f48-acf0-f8256e5d808f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:09.926924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:09.982276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f799540-2983-489a-adaf-eaf95848e096 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:10.017440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d85ffa-32e1-4f48-acf0-f8256e5d808f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:10.018966 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d85ffa-32e1-4f48-acf0-f8256e5d808f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:10.026620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0023e8d-7df7-4d13-bc94-1731d372e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:10.027320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0023e8d-7df7-4d13-bc94-1731d372e91b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:10.027605 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0023e8d-7df7-4d13-bc94-1731d372e91b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:10.027880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0023e8d-7df7-4d13-bc94-1731d372e91b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:10.029598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0023e8d-7df7-4d13-bc94-1731d372e91b None admin] RBAC: Adding query filter params (group.id=d6b97655cde1404ea94c1c6c847833fc, role.id=3027d01b9e8b469784a8db0de5f043bd, scope.project.id=18a4708787dc49b085266177f70c0577) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:10.029598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0023e8d-7df7-4d13-bc94-1731d372e91b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:10.030498 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0023e8d-7df7-4d13-bc94-1731d372e91b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:10.037086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 180/360] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 23 16:55:09 2022] GET /identity/v3/role_assignments?group.id=d6b97655cde1404ea94c1c6c847833fc&scope.project.id=18a4708787dc49b085266177f70c0577&role.id=3027d01b9e8b469784a8db0de5f043bd => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:10.037389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0023e8d-7df7-4d13-bc94-1731d372e91b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:10.149505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:10.154652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 181/361] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:10.155635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d85ffa-32e1-4f48-acf0-f8256e5d808f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:10.187142 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0023e8d-7df7-4d13-bc94-1731d372e91b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:10.214875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:10.240278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a977f19-c385-43fe-956a-2b0c0543cb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:10.241290 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a977f19-c385-43fe-956a-2b0c0543cb3e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:10.241579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a977f19-c385-43fe-956a-2b0c0543cb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:10.242175 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a977f19-c385-43fe-956a-2b0c0543cb3e None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:10.242964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a977f19-c385-43fe-956a-2b0c0543cb3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:10.243276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a977f19-c385-43fe-956a-2b0c0543cb3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:10.244640 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a977f19-c385-43fe-956a-2b0c0543cb3e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:10.256990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 181/362] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:55:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:10.257933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a977f19-c385-43fe-956a-2b0c0543cb3e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:10.310541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d85ffa-32e1-4f48-acf0-f8256e5d808f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:10.373863 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e69d3-720e-4622-8a4f-2105e8a9e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:10.374743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e69d3-720e-4622-8a4f-2105e8a9e195 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:10.375029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e69d3-720e-4622-8a4f-2105e8a9e195 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:10.375349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e69d3-720e-4622-8a4f-2105e8a9e195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:10.376736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e69d3-720e-4622-8a4f-2105e8a9e195 None admin] RBAC: Adding query filter params (group.id=d6b97655cde1404ea94c1c6c847833fc, role.id=c4b17c7a2a644e91a1872f5fa53e6421, scope.project.id=18a4708787dc49b085266177f70c0577) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:10.377224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e69d3-720e-4622-8a4f-2105e8a9e195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:10.379624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e69d3-720e-4622-8a4f-2105e8a9e195 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:10.387647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 182/363] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 23 16:55:10 2022] GET /identity/v3/role_assignments?group.id=d6b97655cde1404ea94c1c6c847833fc&scope.project.id=18a4708787dc49b085266177f70c0577&role.id=c4b17c7a2a644e91a1872f5fa53e6421 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:10.388467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e69d3-720e-4622-8a4f-2105e8a9e195 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:10.405546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a977f19-c385-43fe-956a-2b0c0543cb3e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:10.448995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f64615-beeb-4657-a6f5-68ed00f94767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:10.450078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f64615-beeb-4657-a6f5-68ed00f94767 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:10.450386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f64615-beeb-4657-a6f5-68ed00f94767 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:10.450673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f64615-beeb-4657-a6f5-68ed00f94767 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:10.462993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f64615-beeb-4657-a6f5-68ed00f94767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:10.467194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-47f64615-beeb-4657-a6f5-68ed00f94767 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:10.472472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:10.473415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:10.474216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:10.474216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:10.474216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:10.474216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:10.474216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:10.474216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:10.474216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:10.474216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:10.474216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:10.474216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:10.474216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:55:10.474216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:10.474888 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 182/364] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:10.475863 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f64615-beeb-4657-a6f5-68ed00f94767 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:10.524618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e69d3-720e-4622-8a4f-2105e8a9e195 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:10.538561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:10.582646 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ad406-4de0-44b3-90c1-d3c5ee16cff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:10.583693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ad406-4de0-44b3-90c1-d3c5ee16cff3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:10.584274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ad406-4de0-44b3-90c1-d3c5ee16cff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:10.584554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ad406-4de0-44b3-90c1-d3c5ee16cff3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:10.597716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ad406-4de0-44b3-90c1-d3c5ee16cff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-8b2ad406-4de0-44b3-90c1-d3c5ee16cff3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:10.606096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:10.607105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:10.607898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:10.607898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:10.607898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:10.607898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:10.607898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:10.607898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:10.607898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:10.607898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:10.607898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:10.607898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:10.607898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:55:10.607898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:10.608528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 183/365] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:55:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:10.609097 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ad406-4de0-44b3-90c1-d3c5ee16cff3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:10.632345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f64615-beeb-4657-a6f5-68ed00f94767 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:10.682383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b5237-64dd-4093-9e96-704fc96fd09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:10.684566 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b5237-64dd-4093-9e96-704fc96fd09b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:10.685267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b5237-64dd-4093-9e96-704fc96fd09b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:10.685928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b5237-64dd-4093-9e96-704fc96fd09b None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:10.689909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b5237-64dd-4093-9e96-704fc96fd09b None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:10.692180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b5237-64dd-4093-9e96-704fc96fd09b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:10.694907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 183/366] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:10 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:10.695896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b5237-64dd-4093-9e96-704fc96fd09b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:10.763781 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ad406-4de0-44b3-90c1-d3c5ee16cff3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:10.805785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:10.810907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b5237-64dd-4093-9e96-704fc96fd09b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:10.820819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad0945-a5af-4f3b-86d8-c121b72fb766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:10.822160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad0945-a5af-4f3b-86d8-c121b72fb766 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:10.823001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad0945-a5af-4f3b-86d8-c121b72fb766 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:10.823761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad0945-a5af-4f3b-86d8-c121b72fb766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:10.845434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:10.850990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61132a9-a7f4-4b27-a407-007ae4330292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:10.851671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61132a9-a7f4-4b27-a407-007ae4330292 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:10.852077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61132a9-a7f4-4b27-a407-007ae4330292 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:10.852512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61132a9-a7f4-4b27-a407-007ae4330292 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:10.853397 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61132a9-a7f4-4b27-a407-007ae4330292 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:10.853745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61132a9-a7f4-4b27-a407-007ae4330292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:10.855236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61132a9-a7f4-4b27-a407-007ae4330292 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:10.865633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 184/367] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:55:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:10.866528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61132a9-a7f4-4b27-a407-007ae4330292 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:10.915702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad0945-a5af-4f3b-86d8-c121b72fb766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:10.918044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad0945-a5af-4f3b-86d8-c121b72fb766 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:11.005672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61132a9-a7f4-4b27-a407-007ae4330292 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:11.042272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca641042-1a18-433a-88c2-8d87889686ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:11.042983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca641042-1a18-433a-88c2-8d87889686ba None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:11.043274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca641042-1a18-433a-88c2-8d87889686ba None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:11.043559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca641042-1a18-433a-88c2-8d87889686ba None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:11.044378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca641042-1a18-433a-88c2-8d87889686ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:11.044617 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca641042-1a18-433a-88c2-8d87889686ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:11.045973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca641042-1a18-433a-88c2-8d87889686ba None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:11.056236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 185/368] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:11.056236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca641042-1a18-433a-88c2-8d87889686ba None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:11.056836 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 184/369] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:11.057949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad0945-a5af-4f3b-86d8-c121b72fb766 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:11.086637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:11.089931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:11.161693 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca641042-1a18-433a-88c2-8d87889686ba None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:11.173184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad0945-a5af-4f3b-86d8-c121b72fb766 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:11.197711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44467388-a098-42b9-a664-fb81f32b0e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:11.198698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467388-a098-42b9-a664-fb81f32b0e7b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:11.199054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467388-a098-42b9-a664-fb81f32b0e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:11.199677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467388-a098-42b9-a664-fb81f32b0e7b None admin] PATH_INFO: `/v3/groups/d6b97655cde1404ea94c1c6c847833fc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:11.200969 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44467388-a098-42b9-a664-fb81f32b0e7b None admin] RBAC: Authorizing `identity:get_group(group_id=d6b97655cde1404ea94c1c6c847833fc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:11.202506 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44467388-a098-42b9-a664-fb81f32b0e7b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:11.204987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 186/370] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:11 2022] GET /identity/v3/groups/d6b97655cde1404ea94c1c6c847833fc => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:11.205920 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44467388-a098-42b9-a664-fb81f32b0e7b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:11.214068 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db068175-659e-4349-ba21-d9255f95cd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:11.215426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db068175-659e-4349-ba21-d9255f95cd25 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:11.215957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db068175-659e-4349-ba21-d9255f95cd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:11.216413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db068175-659e-4349-ba21-d9255f95cd25 None admin] PATH_INFO: `/v3/users/7a20e22fb5054c2d9cdac45c9369d6b7` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:11.217920 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db068175-659e-4349-ba21-d9255f95cd25 None admin] RBAC: Authorizing `identity:get_user(user_id=7a20e22fb5054c2d9cdac45c9369d6b7)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:11.220394 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db068175-659e-4349-ba21-d9255f95cd25 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:11.222901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 185/371] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:55:11 2022] GET /identity/v3/users/7a20e22fb5054c2d9cdac45c9369d6b7 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:11.224033 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db068175-659e-4349-ba21-d9255f95cd25 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:11.314229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:11.317151 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44467388-a098-42b9-a664-fb81f32b0e7b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:11.332062 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:11.342953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db068175-659e-4349-ba21-d9255f95cd25 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:11.354599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8f1c5-bfd7-4e5f-9d5b-36d7e88a0fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:11.355736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8f1c5-bfd7-4e5f-9d5b-36d7e88a0fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:11.356127 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8f1c5-bfd7-4e5f-9d5b-36d7e88a0fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:11.356564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8f1c5-bfd7-4e5f-9d5b-36d7e88a0fe1 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:11.357802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8f1c5-bfd7-4e5f-9d5b-36d7e88a0fe1 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:11.359459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8f1c5-bfd7-4e5f-9d5b-36d7e88a0fe1 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:11.366648 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 187/372] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:11 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:11.366648 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8f1c5-bfd7-4e5f-9d5b-36d7e88a0fe1 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:11.387645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7aa0b-3fa3-4961-8c4d-0cce499e3b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:11.388564 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7aa0b-3fa3-4961-8c4d-0cce499e3b2b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:11.389019 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7aa0b-3fa3-4961-8c4d-0cce499e3b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:11.389558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7aa0b-3fa3-4961-8c4d-0cce499e3b2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:11.464539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7aa0b-3fa3-4961-8c4d-0cce499e3b2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:11.466252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7aa0b-3fa3-4961-8c4d-0cce499e3b2b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:11.470964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8f1c5-bfd7-4e5f-9d5b-36d7e88a0fe1 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:11.508047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e0185-d8ef-436d-ab4e-bc6310b9c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:11.508844 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e0185-d8ef-436d-ab4e-bc6310b9c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:11.509256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e0185-d8ef-436d-ab4e-bc6310b9c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:11.509640 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e0185-d8ef-436d-ab4e-bc6310b9c6c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:11.510721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e0185-d8ef-436d-ab4e-bc6310b9c6c7 None admin] RBAC: Adding query filter params (group.id=d6b97655cde1404ea94c1c6c847833fc, role.id=c4b17c7a2a644e91a1872f5fa53e6421, scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:11.511137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e0185-d8ef-436d-ab4e-bc6310b9c6c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:11.512875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e0185-d8ef-436d-ab4e-bc6310b9c6c7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:11.519853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 188/373] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 23 16:55:11 2022] GET /identity/v3/role_assignments?group.id=d6b97655cde1404ea94c1c6c847833fc&scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b&role.id=c4b17c7a2a644e91a1872f5fa53e6421 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:11.520826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e0185-d8ef-436d-ab4e-bc6310b9c6c7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:11.556802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:11.574998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:11.587179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 186/374] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:11.588283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7aa0b-3fa3-4961-8c4d-0cce499e3b2b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:11.640197 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e0185-d8ef-436d-ab4e-bc6310b9c6c7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:11.681864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e9382-14a4-4dfb-9361-64919dd434e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:11.682973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e9382-14a4-4dfb-9361-64919dd434e6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:11.683495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e9382-14a4-4dfb-9361-64919dd434e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:11.684030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e9382-14a4-4dfb-9361-64919dd434e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:11.685249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e9382-14a4-4dfb-9361-64919dd434e6 None admin] RBAC: Adding query filter params (role.id=ccb4819e599749909ff92aedeeb810fd, user.id=7a20e22fb5054c2d9cdac45c9369d6b7, scope.system=all) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:11.685777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e9382-14a4-4dfb-9361-64919dd434e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:11.687630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e9382-14a4-4dfb-9361-64919dd434e6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:11.702661 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 189/375] 10.222.0.49 () {56 vars in 1308 bytes} [Mon May 23 16:55:11 2022] GET /identity/v3/role_assignments?user.id=7a20e22fb5054c2d9cdac45c9369d6b7&scope.system=all&role.id=ccb4819e599749909ff92aedeeb810fd => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:11.704413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e9382-14a4-4dfb-9361-64919dd434e6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:11.705995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7aa0b-3fa3-4961-8c4d-0cce499e3b2b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:11.747574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a76a67-3e0c-4c12-afbf-ff4c8cffd7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:11.748367 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a76a67-3e0c-4c12-afbf-ff4c8cffd7af None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:11.748660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a76a67-3e0c-4c12-afbf-ff4c8cffd7af None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:11.748941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a76a67-3e0c-4c12-afbf-ff4c8cffd7af None admin] PATH_INFO: `/v3/groups/d6b97655cde1404ea94c1c6c847833fc` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:11.750142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a76a67-3e0c-4c12-afbf-ff4c8cffd7af None admin] RBAC: Authorizing `identity:get_group(group_id=d6b97655cde1404ea94c1c6c847833fc)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:11.752770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a76a67-3e0c-4c12-afbf-ff4c8cffd7af None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:11.755036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 187/376] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:11 2022] GET /identity/v3/groups/d6b97655cde1404ea94c1c6c847833fc => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:11.761293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a76a67-3e0c-4c12-afbf-ff4c8cffd7af None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:11.821368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:11.833905 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:11.835465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e9382-14a4-4dfb-9361-64919dd434e6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:11.877022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319c0ee-1f02-40ed-8b17-7b3f7bb104fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:11.878433 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319c0ee-1f02-40ed-8b17-7b3f7bb104fd None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:11.879035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319c0ee-1f02-40ed-8b17-7b3f7bb104fd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:11.879533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319c0ee-1f02-40ed-8b17-7b3f7bb104fd None admin] PATH_INFO: `/v3/projects/1e61a710b27f4ea29e3f6c7963fdf0c4` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:11.881062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319c0ee-1f02-40ed-8b17-7b3f7bb104fd None admin] RBAC: Authorizing `identity:get_project(project_id=1e61a710b27f4ea29e3f6c7963fdf0c4)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:11.881950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a76a67-3e0c-4c12-afbf-ff4c8cffd7af None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:11.883063 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319c0ee-1f02-40ed-8b17-7b3f7bb104fd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:11.885667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 190/377] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:11 2022] GET /identity/v3/projects/1e61a710b27f4ea29e3f6c7963fdf0c4 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:11.890970 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319c0ee-1f02-40ed-8b17-7b3f7bb104fd None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:11.922232 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125d67c-5e82-4c5d-b973-98700484e622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:11.923075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d67c-5e82-4c5d-b973-98700484e622 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:11.923307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d67c-5e82-4c5d-b973-98700484e622 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:11.923833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d67c-5e82-4c5d-b973-98700484e622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:11.926385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125d67c-5e82-4c5d-b973-98700484e622 None admin] RBAC: Adding query filter params (group.id=d6b97655cde1404ea94c1c6c847833fc, role.id=3027d01b9e8b469784a8db0de5f043bd, scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:11.926385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125d67c-5e82-4c5d-b973-98700484e622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:11.927121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125d67c-5e82-4c5d-b973-98700484e622 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:11.938645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 188/378] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 23 16:55:11 2022] GET /identity/v3/role_assignments?group.id=d6b97655cde1404ea94c1c6c847833fc&scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b&role.id=3027d01b9e8b469784a8db0de5f043bd => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:12.064072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319c0ee-1f02-40ed-8b17-7b3f7bb104fd None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:12.105271 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b87ae-a91e-4ffb-922d-85ef583a3b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:12.106553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b87ae-a91e-4ffb-922d-85ef583a3b99 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:12.107070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b87ae-a91e-4ffb-922d-85ef583a3b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:12.107553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b87ae-a91e-4ffb-922d-85ef583a3b99 None admin] PATH_INFO: `/v3/groups/94af25c73e144c22828c386eb89b54e9` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:12.113816 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b87ae-a91e-4ffb-922d-85ef583a3b99 None admin] RBAC: Authorizing `identity:get_group(group_id=94af25c73e144c22828c386eb89b54e9)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:12.115609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b87ae-a91e-4ffb-922d-85ef583a3b99 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:12.117894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 191/379] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:11 2022] GET /identity/v3/groups/94af25c73e144c22828c386eb89b54e9 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:12.123492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125d67c-5e82-4c5d-b973-98700484e622 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:12.257746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125d67c-5e82-4c5d-b973-98700484e622 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:12.286720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:12.296974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de4660-97a9-42ec-bf18-2d13f3b779b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:12.298231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de4660-97a9-42ec-bf18-2d13f3b779b2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:12.299085 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de4660-97a9-42ec-bf18-2d13f3b779b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:12.299361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de4660-97a9-42ec-bf18-2d13f3b779b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:12.300223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de4660-97a9-42ec-bf18-2d13f3b779b2 None admin] RBAC: Adding query filter params (group.id=94af25c73e144c22828c386eb89b54e9, role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=1e61a710b27f4ea29e3f6c7963fdf0c4) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:12.300544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de4660-97a9-42ec-bf18-2d13f3b779b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:12.302004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de4660-97a9-42ec-bf18-2d13f3b779b2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:12.308576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 189/380] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 23 16:55:12 2022] GET /identity/v3/role_assignments?group.id=94af25c73e144c22828c386eb89b54e9&scope.project.id=1e61a710b27f4ea29e3f6c7963fdf0c4&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:13.071180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75afe-aedd-49c9-b07f-02d06e741fe7 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:13.071668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75afe-aedd-49c9-b07f-02d06e741fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:13.071668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75afe-aedd-49c9-b07f-02d06e741fe7 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:13.073299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 192/381] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:13.080277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a929e2f-a8fa-4479-9a41-f2db1cbd15dc None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:13.080722 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a929e2f-a8fa-4479-9a41-f2db1cbd15dc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:13.080822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a929e2f-a8fa-4479-9a41-f2db1cbd15dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:13.098078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4a929e2f-a8fa-4479-9a41-f2db1cbd15dc None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:13.099323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4a929e2f-a8fa-4479-9a41-f2db1cbd15dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:13.113048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6194a-a74d-4c8b-a31d-61bcef7ea80b None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:13.113352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6194a-a74d-4c8b-a31d-61bcef7ea80b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:13.113631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6194a-a74d-4c8b-a31d-61bcef7ea80b None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:13.115768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 193/382] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:13.121028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c80a3-92af-447f-880f-2ea5aba58edc None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:13.121242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c80a3-92af-447f-880f-2ea5aba58edc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:13.121467 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c80a3-92af-447f-880f-2ea5aba58edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:13.155467 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6a6c80a3-92af-447f-880f-2ea5aba58edc None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:13.156676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6a6c80a3-92af-447f-880f-2ea5aba58edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:13.194288 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:13.214894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 190/383] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:55:13.247438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a929e2f-a8fa-4479-9a41-f2db1cbd15dc None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:13.271327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 194/384] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:55:13.298387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c80a3-92af-447f-880f-2ea5aba58edc None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:13.373943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a929e2f-a8fa-4479-9a41-f2db1cbd15dc None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:13.399750 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:13.427138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf71ab8-4c78-4d33-a153-4c16e3ece952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:13.428218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf71ab8-4c78-4d33-a153-4c16e3ece952 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:13.428512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf71ab8-4c78-4d33-a153-4c16e3ece952 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:13.428795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf71ab8-4c78-4d33-a153-4c16e3ece952 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:13.443793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf71ab8-4c78-4d33-a153-4c16e3ece952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-5cf71ab8-4c78-4d33-a153-4c16e3ece952 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:13.461360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:13.462340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:13.463163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:13.463163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:13.463163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:13.463163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:13.463163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:13.463163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:13.463163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:13.463163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:13.463163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:13.463163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:13.463163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:13.463163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:13.466626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 191/385] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:55:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:13.471210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf71ab8-4c78-4d33-a153-4c16e3ece952 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:13.487799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c80a3-92af-447f-880f-2ea5aba58edc None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:13.531119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da17858-6ef9-4e52-8d13-78c2ad9ac947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:13.532458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da17858-6ef9-4e52-8d13-78c2ad9ac947 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:13.532749 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da17858-6ef9-4e52-8d13-78c2ad9ac947 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:13.533023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da17858-6ef9-4e52-8d13-78c2ad9ac947 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:13.557014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da17858-6ef9-4e52-8d13-78c2ad9ac947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-2da17858-6ef9-4e52-8d13-78c2ad9ac947 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:13.565670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:13.566606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:13.567394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:13.567394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:13.567394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:13.567394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:13.567394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:13.567394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:13.567394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:13.567394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:13.567394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:13.567394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:13.567394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:13.567394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:13.568690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 195/386] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:13.573033 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da17858-6ef9-4e52-8d13-78c2ad9ac947 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:13.590763 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:13.694916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf71ab8-4c78-4d33-a153-4c16e3ece952 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:13.753438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da17858-6ef9-4e52-8d13-78c2ad9ac947 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:13.761652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8755a-5c32-4550-8850-c00975c62835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:13.772644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8755a-5c32-4550-8850-c00975c62835 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:13.773283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8755a-5c32-4550-8850-c00975c62835 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:13.773774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8755a-5c32-4550-8850-c00975c62835 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:13.774806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8755a-5c32-4550-8850-c00975c62835 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:13.775341 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8755a-5c32-4550-8850-c00975c62835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:13.777185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8755a-5c32-4550-8850-c00975c62835 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:13.801904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 192/387] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:13.805229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8755a-5c32-4550-8850-c00975c62835 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:13.842823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f92c-30a1-4cf0-9b9f-5aae7caff5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:13.843514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f92c-30a1-4cf0-9b9f-5aae7caff5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:13.843799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f92c-30a1-4cf0-9b9f-5aae7caff5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:13.844075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f92c-30a1-4cf0-9b9f-5aae7caff5d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:13.845215 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f92c-30a1-4cf0-9b9f-5aae7caff5d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:13.845529 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f92c-30a1-4cf0-9b9f-5aae7caff5d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:13.846942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f92c-30a1-4cf0-9b9f-5aae7caff5d9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:13.872583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 196/388] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:55:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:13.875306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:13.879389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f92c-30a1-4cf0-9b9f-5aae7caff5d9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:13.941342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8755a-5c32-4550-8850-c00975c62835 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:13.978579 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482a87a-03a4-4dad-ba20-93af6ccee39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:13.979360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482a87a-03a4-4dad-ba20-93af6ccee39a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:13.979646 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482a87a-03a4-4dad-ba20-93af6ccee39a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:13.979927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482a87a-03a4-4dad-ba20-93af6ccee39a None admin] PATH_INFO: `/v3/groups/d6b97655cde1404ea94c1c6c847833fc` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:13.981106 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482a87a-03a4-4dad-ba20-93af6ccee39a None admin] RBAC: Authorizing `identity:get_group(group_id=d6b97655cde1404ea94c1c6c847833fc)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:13.982566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482a87a-03a4-4dad-ba20-93af6ccee39a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:13.988789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 193/389] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:13 2022] GET /identity/v3/groups/d6b97655cde1404ea94c1c6c847833fc => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:13.990188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482a87a-03a4-4dad-ba20-93af6ccee39a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:14.061716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:14.112447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f92c-30a1-4cf0-9b9f-5aae7caff5d9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:14.150846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482a87a-03a4-4dad-ba20-93af6ccee39a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:14.160994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:14.187075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76a473-f997-4cdd-9f6a-1373c9000e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:14.187964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76a473-f997-4cdd-9f6a-1373c9000e8b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:14.188838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76a473-f997-4cdd-9f6a-1373c9000e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:14.189265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76a473-f997-4cdd-9f6a-1373c9000e8b None admin] PATH_INFO: `/v3/groups/d6b97655cde1404ea94c1c6c847833fc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:14.190715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76a473-f997-4cdd-9f6a-1373c9000e8b None admin] RBAC: Authorizing `identity:get_group(group_id=d6b97655cde1404ea94c1c6c847833fc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:14.191807 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254573bf-a203-4eac-8990-94c16444be25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:14.192183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76a473-f997-4cdd-9f6a-1373c9000e8b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:14.193173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254573bf-a203-4eac-8990-94c16444be25 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:14.193668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254573bf-a203-4eac-8990-94c16444be25 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:14.194129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 197/390] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:13 2022] GET /identity/v3/groups/d6b97655cde1404ea94c1c6c847833fc => generated 226 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:14.194529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254573bf-a203-4eac-8990-94c16444be25 None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:14.196059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254573bf-a203-4eac-8990-94c16444be25 None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:14.197700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254573bf-a203-4eac-8990-94c16444be25 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:14.199367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76a473-f997-4cdd-9f6a-1373c9000e8b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:14.204437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 194/391] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:13 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:14.207293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254573bf-a203-4eac-8990-94c16444be25 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:14.321898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254573bf-a203-4eac-8990-94c16444be25 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:14.362076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48525872-7bd2-425e-9bb0-6a7e5f0b157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:14.363370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525872-7bd2-425e-9bb0-6a7e5f0b157d None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:14.363869 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525872-7bd2-425e-9bb0-6a7e5f0b157d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:14.364345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525872-7bd2-425e-9bb0-6a7e5f0b157d None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577/groups/d6b97655cde1404ea94c1c6c847833fc/roles/c4b17c7a2a644e91a1872f5fa53e6421` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:14.365049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76a473-f997-4cdd-9f6a-1373c9000e8b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:14.367008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48525872-7bd2-425e-9bb0-6a7e5f0b157d None admin] RBAC: Authorizing `identity:create_grant(project_id=18a4708787dc49b085266177f70c0577, group_id=d6b97655cde1404ea94c1c6c847833fc, role_id=c4b17c7a2a644e91a1872f5fa53e6421)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:14.368682 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48525872-7bd2-425e-9bb0-6a7e5f0b157d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:14.389158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 195/392] 10.222.0.49 () {58 vars in 1442 bytes} [Mon May 23 16:55:14 2022] PUT /identity/v3/projects/18a4708787dc49b085266177f70c0577/groups/d6b97655cde1404ea94c1c6c847833fc/roles/c4b17c7a2a644e91a1872f5fa53e6421 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:55:14.436079 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e080d00-936b-4b4c-98f6-98fa2ecbc244 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:14.436725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e080d00-936b-4b4c-98f6-98fa2ecbc244 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:14.437491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e080d00-936b-4b4c-98f6-98fa2ecbc244 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:14.440297 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 196/393] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:55:14.447708 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3425d7-58fa-4eef-aec2-709e794c81dc None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:14.448461 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3425d7-58fa-4eef-aec2-709e794c81dc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:14.448989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de742405-aa86-4b61-bad7-740d32df5244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:14.449466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3425d7-58fa-4eef-aec2-709e794c81dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:14.450129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de742405-aa86-4b61-bad7-740d32df5244 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:14.450454 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de742405-aa86-4b61-bad7-740d32df5244 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:14.450732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de742405-aa86-4b61-bad7-740d32df5244 None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:14.452018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de742405-aa86-4b61-bad7-740d32df5244 None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:14.457158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de742405-aa86-4b61-bad7-740d32df5244 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:14.457158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 198/394] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:14 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:14.463252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de742405-aa86-4b61-bad7-740d32df5244 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:14.486569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:14.494788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0d3425d7-58fa-4eef-aec2-709e794c81dc None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:14.496094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0d3425d7-58fa-4eef-aec2-709e794c81dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:14.560171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:14.645179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 197/395] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:14.651110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de742405-aa86-4b61-bad7-740d32df5244 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:14.665270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbb0c6-12a9-4322-b060-c08dd9879d2c None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:14.665566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbb0c6-12a9-4322-b060-c08dd9879d2c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:14.665851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbb0c6-12a9-4322-b060-c08dd9879d2c None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:14.667543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 198/396] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:14.671840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbb0c6-12a9-4322-b060-c08dd9879d2c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:14.693438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f81422-402f-4e28-ba9c-ae35c0dd4357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:14.694329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f81422-402f-4e28-ba9c-ae35c0dd4357 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:14.694653 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f81422-402f-4e28-ba9c-ae35c0dd4357 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:14.694924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f81422-402f-4e28-ba9c-ae35c0dd4357 None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577/groups/d6b97655cde1404ea94c1c6c847833fc/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:14.696937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f81422-402f-4e28-ba9c-ae35c0dd4357 None admin] RBAC: Authorizing `identity:create_grant(project_id=18a4708787dc49b085266177f70c0577, group_id=d6b97655cde1404ea94c1c6c847833fc, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:14.698337 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f81422-402f-4e28-ba9c-ae35c0dd4357 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:14.716237 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 199/397] 10.222.0.49 () {58 vars in 1442 bytes} [Mon May 23 16:55:14 2022] PUT /identity/v3/projects/18a4708787dc49b085266177f70c0577/groups/d6b97655cde1404ea94c1c6c847833fc/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:55:14.717720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7deabe-4cd5-4e0a-a5d5-9dd2ca85b2d2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:14.718016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7deabe-4cd5-4e0a-a5d5-9dd2ca85b2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:14.718296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7deabe-4cd5-4e0a-a5d5-9dd2ca85b2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:14.746103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-cc7deabe-4cd5-4e0a-a5d5-9dd2ca85b2d2 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:14.747144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cc7deabe-4cd5-4e0a-a5d5-9dd2ca85b2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:14.802930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbb0c6-12a9-4322-b060-c08dd9879d2c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:14.844988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba934224-89ea-44f1-b11b-46e19e2a0f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:14.846551 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba934224-89ea-44f1-b11b-46e19e2a0f88 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:14.847044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba934224-89ea-44f1-b11b-46e19e2a0f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:14.847587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba934224-89ea-44f1-b11b-46e19e2a0f88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:14.860746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba934224-89ea-44f1-b11b-46e19e2a0f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ba934224-89ea-44f1-b11b-46e19e2a0f88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:14.869673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:14.870660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:14.871491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:14.871491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:14.871491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:14.871491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:14.871491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:14.871491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:14.871491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:14.871491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:14.871491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:14.871491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:14.871491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:14.871491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:14.874338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 199/398] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:55:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:14.881712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba934224-89ea-44f1-b11b-46e19e2a0f88 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:14.914728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:14.934042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:14.941143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 200/399] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:14.965505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7deabe-4cd5-4e0a-a5d5-9dd2ca85b2d2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:15.002066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba934224-89ea-44f1-b11b-46e19e2a0f88 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:15.038629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afec07-65f7-428c-b9b6-bb927bf510fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:15.039673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afec07-65f7-428c-b9b6-bb927bf510fb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:15.040172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afec07-65f7-428c-b9b6-bb927bf510fb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:15.040654 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afec07-65f7-428c-b9b6-bb927bf510fb None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:15.041613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afec07-65f7-428c-b9b6-bb927bf510fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:15.042198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afec07-65f7-428c-b9b6-bb927bf510fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:15.043910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afec07-65f7-428c-b9b6-bb927bf510fb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:15.054857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 200/400] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:15.061090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afec07-65f7-428c-b9b6-bb927bf510fb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:15.075360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7deabe-4cd5-4e0a-a5d5-9dd2ca85b2d2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:15.112798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7759e4a-a4b2-4384-9759-95b2575889b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:15.113610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7759e4a-a4b2-4384-9759-95b2575889b1 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:15.113897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7759e4a-a4b2-4384-9759-95b2575889b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:15.114178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7759e4a-a4b2-4384-9759-95b2575889b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:15.125496 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7759e4a-a4b2-4384-9759-95b2575889b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b7759e4a-a4b2-4384-9759-95b2575889b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:15.132858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:15.133777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:15.134596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:15.134596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:15.134596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:15.134596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:15.134596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:15.134596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:15.134596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:15.134596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:15.134596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:15.134596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:15.134596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:15.134596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:15.138455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 201/401] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:15.139983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7759e4a-a4b2-4384-9759-95b2575889b1 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:15.167692 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:15.191003 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afec07-65f7-428c-b9b6-bb927bf510fb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:15.214743 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:15.245657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78835d96-1aff-443b-9443-3a92a9c8d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:15.246553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78835d96-1aff-443b-9443-3a92a9c8d977 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:15.246837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78835d96-1aff-443b-9443-3a92a9c8d977 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:15.247113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78835d96-1aff-443b-9443-3a92a9c8d977 None admin] PATH_INFO: `/v3/groups/d6b97655cde1404ea94c1c6c847833fc` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:15.248289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78835d96-1aff-443b-9443-3a92a9c8d977 None admin] RBAC: Authorizing `identity:get_group(group_id=d6b97655cde1404ea94c1c6c847833fc)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:15.249719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78835d96-1aff-443b-9443-3a92a9c8d977 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:15.252668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7759e4a-a4b2-4384-9759-95b2575889b1 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:15.259904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 201/402] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:15 2022] GET /identity/v3/groups/d6b97655cde1404ea94c1c6c847833fc => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:15.265241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78835d96-1aff-443b-9443-3a92a9c8d977 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:15.289535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbbfe6-56d5-44d9-98b2-2b585c7f1880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:15.290507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbbfe6-56d5-44d9-98b2-2b585c7f1880 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:15.290893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbbfe6-56d5-44d9-98b2-2b585c7f1880 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:15.291272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbbfe6-56d5-44d9-98b2-2b585c7f1880 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:15.292121 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbbfe6-56d5-44d9-98b2-2b585c7f1880 None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:15.292533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbbfe6-56d5-44d9-98b2-2b585c7f1880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:15.294200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbbfe6-56d5-44d9-98b2-2b585c7f1880 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:15.304311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 202/403] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:55:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:15.310555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d009295-e05d-4bf3-8023-bdf43e0c3e2e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:15.310973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d009295-e05d-4bf3-8023-bdf43e0c3e2e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:15.311412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d009295-e05d-4bf3-8023-bdf43e0c3e2e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:15.313288 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 203/404] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:15.314095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d009295-e05d-4bf3-8023-bdf43e0c3e2e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:15.391575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78835d96-1aff-443b-9443-3a92a9c8d977 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:15.426766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d009295-e05d-4bf3-8023-bdf43e0c3e2e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:15.428651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33586ce-7c3e-40c9-aa7a-af09ab75293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:15.429684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33586ce-7c3e-40c9-aa7a-af09ab75293d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:15.430039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33586ce-7c3e-40c9-aa7a-af09ab75293d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:15.430452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33586ce-7c3e-40c9-aa7a-af09ab75293d None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:15.431733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33586ce-7c3e-40c9-aa7a-af09ab75293d None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:15.433273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33586ce-7c3e-40c9-aa7a-af09ab75293d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:15.435507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 202/405] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:15 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:15.436862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad382de-2312-44a3-af60-8476dbd59a70 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:15.437228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad382de-2312-44a3-af60-8476dbd59a70 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:15.437583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad382de-2312-44a3-af60-8476dbd59a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:15.451655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:15.458697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5ad382de-2312-44a3-af60-8476dbd59a70 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:15.460089 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5ad382de-2312-44a3-af60-8476dbd59a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:15.464692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ba274-afe5-457b-970d-07a3925d857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:15.465555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ba274-afe5-457b-970d-07a3925d857c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:15.465840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ba274-afe5-457b-970d-07a3925d857c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:15.466118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ba274-afe5-457b-970d-07a3925d857c None admin] PATH_INFO: `/v3/groups/d6b97655cde1404ea94c1c6c847833fc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:15.467324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ba274-afe5-457b-970d-07a3925d857c None admin] RBAC: Authorizing `identity:get_group(group_id=d6b97655cde1404ea94c1c6c847833fc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:15.468763 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ba274-afe5-457b-970d-07a3925d857c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:15.475529 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 204/406] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:15 2022] GET /identity/v3/groups/d6b97655cde1404ea94c1c6c847833fc => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:15.476545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ba274-afe5-457b-970d-07a3925d857c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:15.481288 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:15.536387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 203/407] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:15.543554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad382de-2312-44a3-af60-8476dbd59a70 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:15.585758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ba274-afe5-457b-970d-07a3925d857c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:15.622401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b7b7b-9303-4cff-9179-24da0f74147b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:15.623399 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b7b7b-9303-4cff-9179-24da0f74147b None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:15.623682 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b7b7b-9303-4cff-9179-24da0f74147b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:15.623957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b7b7b-9303-4cff-9179-24da0f74147b None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b/groups/d6b97655cde1404ea94c1c6c847833fc/roles/c4b17c7a2a644e91a1872f5fa53e6421` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:15.627344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b7b7b-9303-4cff-9179-24da0f74147b None admin] RBAC: Authorizing `identity:create_grant(project_id=3cbc0a559a674cb78cba6f09b7f95a3b, group_id=d6b97655cde1404ea94c1c6c847833fc, role_id=c4b17c7a2a644e91a1872f5fa53e6421)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:15.628876 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b7b7b-9303-4cff-9179-24da0f74147b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:15.644231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 205/408] 10.222.0.49 () {58 vars in 1442 bytes} [Mon May 23 16:55:15 2022] PUT /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b/groups/d6b97655cde1404ea94c1c6c847833fc/roles/c4b17c7a2a644e91a1872f5fa53e6421 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:15.645506 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b7b7b-9303-4cff-9179-24da0f74147b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:15.675406 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad382de-2312-44a3-af60-8476dbd59a70 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:15.715798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:15.718430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f535e-76a7-468b-b831-e075a5c91758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:15.721640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f535e-76a7-468b-b831-e075a5c91758 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:15.722214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f535e-76a7-468b-b831-e075a5c91758 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:15.722696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f535e-76a7-468b-b831-e075a5c91758 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:15.726083 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f535e-76a7-468b-b831-e075a5c91758 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:15.728084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f535e-76a7-468b-b831-e075a5c91758 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:15.730831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 204/409] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:15 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:15.742955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f535e-76a7-468b-b831-e075a5c91758 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:15.784768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b7b7b-9303-4cff-9179-24da0f74147b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:15.820639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:15.828610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e4569-7461-4720-894b-5d102ab91a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:15.829950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e4569-7461-4720-894b-5d102ab91a0c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:15.830237 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e4569-7461-4720-894b-5d102ab91a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:15.830565 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e4569-7461-4720-894b-5d102ab91a0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:15.844067 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e4569-7461-4720-894b-5d102ab91a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-8c7e4569-7461-4720-894b-5d102ab91a0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:15.854861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:15.855836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:15.856647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 206/410] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:55:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:15.863087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e4569-7461-4720-894b-5d102ab91a0c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:15.954805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f535e-76a7-468b-b831-e075a5c91758 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:15.988356 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e4569-7461-4720-894b-5d102ab91a0c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:15.990026 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73289ef6-8e93-4c0a-bc04-28bec89c8334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:15.990943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73289ef6-8e93-4c0a-bc04-28bec89c8334 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:15.991223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73289ef6-8e93-4c0a-bc04-28bec89c8334 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:15.991495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73289ef6-8e93-4c0a-bc04-28bec89c8334 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b/groups/d6b97655cde1404ea94c1c6c847833fc/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:15.993441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73289ef6-8e93-4c0a-bc04-28bec89c8334 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cbc0a559a674cb78cba6f09b7f95a3b, group_id=d6b97655cde1404ea94c1c6c847833fc, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:15.994989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73289ef6-8e93-4c0a-bc04-28bec89c8334 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:15.999578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:16.026142 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09498396-a4d1-4bfd-bd69-e9b4cbcebba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:16.026872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09498396-a4d1-4bfd-bd69-e9b4cbcebba1 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:16.027154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09498396-a4d1-4bfd-bd69-e9b4cbcebba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:16.027477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09498396-a4d1-4bfd-bd69-e9b4cbcebba1 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:16.028265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09498396-a4d1-4bfd-bd69-e9b4cbcebba1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:16.028663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09498396-a4d1-4bfd-bd69-e9b4cbcebba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:16.030065 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09498396-a4d1-4bfd-bd69-e9b4cbcebba1 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:16.031537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 205/411] 10.222.0.49 () {58 vars in 1442 bytes} [Mon May 23 16:55:15 2022] PUT /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b/groups/d6b97655cde1404ea94c1c6c847833fc/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:55:16.040912 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 207/412] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:16.046587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73289ef6-8e93-4c0a-bc04-28bec89c8334 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:16.160889 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:16.183757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73289ef6-8e93-4c0a-bc04-28bec89c8334 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:16.224140 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d48f9-9cd2-4c8e-9ad4-bbff81bca784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:16.225267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d48f9-9cd2-4c8e-9ad4-bbff81bca784 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:16.225705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d48f9-9cd2-4c8e-9ad4-bbff81bca784 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:16.226160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d48f9-9cd2-4c8e-9ad4-bbff81bca784 None admin] PATH_INFO: `/v3/groups/94af25c73e144c22828c386eb89b54e9` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:16.227635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d48f9-9cd2-4c8e-9ad4-bbff81bca784 None admin] RBAC: Authorizing `identity:get_group(group_id=94af25c73e144c22828c386eb89b54e9)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:16.229292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d48f9-9cd2-4c8e-9ad4-bbff81bca784 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:16.231582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 206/413] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:16 2022] GET /identity/v3/groups/94af25c73e144c22828c386eb89b54e9 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:16.237675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09498396-a4d1-4bfd-bd69-e9b4cbcebba1 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:16.375056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09498396-a4d1-4bfd-bd69-e9b4cbcebba1 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:16.412989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83103fce-3cd9-48ca-bd31-631758b81995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:16.413858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83103fce-3cd9-48ca-bd31-631758b81995 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:16.414143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83103fce-3cd9-48ca-bd31-631758b81995 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:16.414471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83103fce-3cd9-48ca-bd31-631758b81995 None admin] PATH_INFO: `/v3/projects/1e61a710b27f4ea29e3f6c7963fdf0c4` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:16.415719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83103fce-3cd9-48ca-bd31-631758b81995 None admin] RBAC: Authorizing `identity:get_project(project_id=1e61a710b27f4ea29e3f6c7963fdf0c4)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:16.417255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83103fce-3cd9-48ca-bd31-631758b81995 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:16.418982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 208/414] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:16 2022] GET /identity/v3/projects/1e61a710b27f4ea29e3f6c7963fdf0c4 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:16.424960 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d48f9-9cd2-4c8e-9ad4-bbff81bca784 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:16.557033 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d48f9-9cd2-4c8e-9ad4-bbff81bca784 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:16.611084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d8855-3f59-454d-8839-fd2496246f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:16.611987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d8855-3f59-454d-8839-fd2496246f3c None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:16.612325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d8855-3f59-454d-8839-fd2496246f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:16.612606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d8855-3f59-454d-8839-fd2496246f3c None admin] PATH_INFO: `/v3/projects/1e61a710b27f4ea29e3f6c7963fdf0c4/groups/94af25c73e144c22828c386eb89b54e9/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:16.614724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d8855-3f59-454d-8839-fd2496246f3c None admin] RBAC: Authorizing `identity:create_grant(project_id=1e61a710b27f4ea29e3f6c7963fdf0c4, group_id=94af25c73e144c22828c386eb89b54e9, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:16.616162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d8855-3f59-454d-8839-fd2496246f3c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:16.643982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 207/415] 10.222.0.49 () {58 vars in 1442 bytes} [Mon May 23 16:55:16 2022] PUT /identity/v3/projects/1e61a710b27f4ea29e3f6c7963fdf0c4/groups/94af25c73e144c22828c386eb89b54e9/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:17.208759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24e0f-41eb-4a40-9b25-d986548749d9 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:17.209167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24e0f-41eb-4a40-9b25-d986548749d9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:17.209345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24e0f-41eb-4a40-9b25-d986548749d9 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:17.211017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 209/416] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:17.216056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7618641-eccb-4f9d-8c07-4c72ad9dd20a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:17.216497 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7618641-eccb-4f9d-8c07-4c72ad9dd20a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:17.216669 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7618641-eccb-4f9d-8c07-4c72ad9dd20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:17.239403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f7618641-eccb-4f9d-8c07-4c72ad9dd20a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:17.240602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f7618641-eccb-4f9d-8c07-4c72ad9dd20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:17.243777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:17.332629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 208/417] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:17.368239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c24e0f-41eb-4a40-9b25-d986548749d9 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:17.420141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:17.480506 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c24e0f-41eb-4a40-9b25-d986548749d9 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:17.517200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314a9b9-5ca6-4b05-9dd1-584b0291d87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:17.518018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314a9b9-5ca6-4b05-9dd1-584b0291d87b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:17.518299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314a9b9-5ca6-4b05-9dd1-584b0291d87b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:17.518599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314a9b9-5ca6-4b05-9dd1-584b0291d87b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:17.529088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314a9b9-5ca6-4b05-9dd1-584b0291d87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-4314a9b9-5ca6-4b05-9dd1-584b0291d87b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:17.537518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:17.538455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:17.539276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 210/418] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:55:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:17.548199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7618641-eccb-4f9d-8c07-4c72ad9dd20a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:17.615036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c69edf-5116-4337-90dd-96f630a3e5da None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:17.615353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c69edf-5116-4337-90dd-96f630a3e5da None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:17.615592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c69edf-5116-4337-90dd-96f630a3e5da None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:17.617107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 211/419] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:55:17.624286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ef4d-bc76-4501-a736-559b4f006c28 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:17.624613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ef4d-bc76-4501-a736-559b4f006c28 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:17.624840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ef4d-bc76-4501-a736-559b4f006c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:17.653549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2397ef4d-bc76-4501-a736-559b4f006c28 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:17.659959 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2397ef4d-bc76-4501-a736-559b4f006c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:17.707161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7618641-eccb-4f9d-8c07-4c72ad9dd20a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:17.759986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac72e6e-f2f0-4624-a90e-3e6176389919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:17.760611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72e6e-f2f0-4624-a90e-3e6176389919 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:17.760910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72e6e-f2f0-4624-a90e-3e6176389919 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:17.761185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72e6e-f2f0-4624-a90e-3e6176389919 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:17.761942 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac72e6e-f2f0-4624-a90e-3e6176389919 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:17.762247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac72e6e-f2f0-4624-a90e-3e6176389919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:17.763656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac72e6e-f2f0-4624-a90e-3e6176389919 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:17.792900 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 209/420] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:17.798679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac72e6e-f2f0-4624-a90e-3e6176389919 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:17.799925 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 212/421] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:55:17.814347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:17.838897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397ef4d-bc76-4501-a736-559b4f006c28 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:17.885028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:17.951412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac72e6e-f2f0-4624-a90e-3e6176389919 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:17.994823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b36235-1ccc-4fda-964a-b0ed6ef251a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:17.995479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b36235-1ccc-4fda-964a-b0ed6ef251a0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:17.995766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b36235-1ccc-4fda-964a-b0ed6ef251a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:17.996046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b36235-1ccc-4fda-964a-b0ed6ef251a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:18.018133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397ef4d-bc76-4501-a736-559b4f006c28 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:18.060698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacfbb1-e232-4f5e-868f-f1d9dbdb3cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:18.061625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacfbb1-e232-4f5e-868f-f1d9dbdb3cdb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:18.061884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacfbb1-e232-4f5e-868f-f1d9dbdb3cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:18.062164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacfbb1-e232-4f5e-868f-f1d9dbdb3cdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:18.074624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacfbb1-e232-4f5e-868f-f1d9dbdb3cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-6dacfbb1-e232-4f5e-868f-f1d9dbdb3cdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:18.083638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:18.084548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:18.085435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 213/422] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:18.090297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacfbb1-e232-4f5e-868f-f1d9dbdb3cdb None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:18.095787 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b36235-1ccc-4fda-964a-b0ed6ef251a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:18.097502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b36235-1ccc-4fda-964a-b0ed6ef251a0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:18.099914 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:18.198999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:18.209738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacfbb1-e232-4f5e-868f-f1d9dbdb3cdb None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:18.247191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53569d57-8f9d-4fd8-978f-7e6a1d2c839f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:18.247872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53569d57-8f9d-4fd8-978f-7e6a1d2c839f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:18.248164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53569d57-8f9d-4fd8-978f-7e6a1d2c839f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:18.248442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53569d57-8f9d-4fd8-978f-7e6a1d2c839f None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:18.249291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53569d57-8f9d-4fd8-978f-7e6a1d2c839f None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:18.249707 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53569d57-8f9d-4fd8-978f-7e6a1d2c839f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:18.251293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53569d57-8f9d-4fd8-978f-7e6a1d2c839f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:18.257014 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 210/423] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:18.261026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 214/424] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:55:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:18.262521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116b76f-0704-4979-ad7c-d5dca5c19757 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:18.262922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116b76f-0704-4979-ad7c-d5dca5c19757 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:18.263212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116b76f-0704-4979-ad7c-d5dca5c19757 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:18.264978 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 211/425] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:18.267610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53569d57-8f9d-4fd8-978f-7e6a1d2c839f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:18.269891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116b76f-0704-4979-ad7c-d5dca5c19757 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:18.397611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116b76f-0704-4979-ad7c-d5dca5c19757 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:18.399429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:18.402241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53569d57-8f9d-4fd8-978f-7e6a1d2c839f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:18.438306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe0bcf-924c-4cb9-9dea-d49ee515d9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:18.439258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe0bcf-924c-4cb9-9dea-d49ee515d9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:18.439546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe0bcf-924c-4cb9-9dea-d49ee515d9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:18.439740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56fe13-5a97-4f8b-9d9b-f1780f014154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:18.439863 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe0bcf-924c-4cb9-9dea-d49ee515d9c6 None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:18.440748 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56fe13-5a97-4f8b-9d9b-f1780f014154 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:18.441078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe0bcf-924c-4cb9-9dea-d49ee515d9c6 None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:18.441350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56fe13-5a97-4f8b-9d9b-f1780f014154 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:18.441773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56fe13-5a97-4f8b-9d9b-f1780f014154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:18.442533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe0bcf-924c-4cb9-9dea-d49ee515d9c6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:18.448915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 215/426] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:18 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:18.448915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307e33b-b8fc-4427-a318-c0c7bf7f65e3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:18.448915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307e33b-b8fc-4427-a318-c0c7bf7f65e3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:18.448915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307e33b-b8fc-4427-a318-c0c7bf7f65e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:18.468547 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4307e33b-b8fc-4427-a318-c0c7bf7f65e3 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:18.470068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4307e33b-b8fc-4427-a318-c0c7bf7f65e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:18.486292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:18.535159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56fe13-5a97-4f8b-9d9b-f1780f014154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:18.536949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56fe13-5a97-4f8b-9d9b-f1780f014154 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:18.545215 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 216/427] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:18.546250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307e33b-b8fc-4427-a318-c0c7bf7f65e3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:18.653314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307e33b-b8fc-4427-a318-c0c7bf7f65e3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:18.653815 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 212/428] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:18.654945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56fe13-5a97-4f8b-9d9b-f1780f014154 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:18.658121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:18.687446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ac013-417d-49d6-8c8f-10ff8ba2eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:18.688828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ac013-417d-49d6-8c8f-10ff8ba2eec6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:18.689116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ac013-417d-49d6-8c8f-10ff8ba2eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:18.689388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ac013-417d-49d6-8c8f-10ff8ba2eec6 None admin] PATH_INFO: `/v3/groups/d6b97655cde1404ea94c1c6c847833fc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:18.690824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ac013-417d-49d6-8c8f-10ff8ba2eec6 None admin] RBAC: Authorizing `identity:get_group(group_id=d6b97655cde1404ea94c1c6c847833fc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:18.692186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ac013-417d-49d6-8c8f-10ff8ba2eec6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:18.698654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 217/429] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:18 2022] GET /identity/v3/groups/d6b97655cde1404ea94c1c6c847833fc => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:18.698654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ac013-417d-49d6-8c8f-10ff8ba2eec6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:18.720788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:18.795121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56fe13-5a97-4f8b-9d9b-f1780f014154 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:18.823863 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ac013-417d-49d6-8c8f-10ff8ba2eec6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:18.836412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e07bc-9441-41cf-ac32-ae0581abe50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:18.837559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e07bc-9441-41cf-ac32-ae0581abe50f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:18.838211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e07bc-9441-41cf-ac32-ae0581abe50f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:18.838711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e07bc-9441-41cf-ac32-ae0581abe50f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:18.851197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e07bc-9441-41cf-ac32-ae0581abe50f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:18.860838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3a3d-41a6-4fe9-90fd-8b4bc7eafb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c07e07bc-9441-41cf-ac32-ae0581abe50f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:18.861679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:18.862627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:18.863490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:18.863490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:18.863490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:18.863490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:18.863490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:18.863490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:18.863490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:18.863490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:18.863490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:18.863490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:18.863490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:18.863490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:18.864103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3a3d-41a6-4fe9-90fd-8b4bc7eafb9a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:18.864103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3a3d-41a6-4fe9-90fd-8b4bc7eafb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:18.864103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3a3d-41a6-4fe9-90fd-8b4bc7eafb9a None admin] PATH_INFO: `/v3/projects/18a4708787dc49b085266177f70c0577` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:18.865711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff3a3d-41a6-4fe9-90fd-8b4bc7eafb9a None admin] RBAC: Authorizing `identity:get_project(project_id=18a4708787dc49b085266177f70c0577)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:18.866562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 213/430] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:55:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:18.867594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e07bc-9441-41cf-ac32-ae0581abe50f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:18.867732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff3a3d-41a6-4fe9-90fd-8b4bc7eafb9a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:18.870396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 218/431] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:18 2022] GET /identity/v3/projects/18a4708787dc49b085266177f70c0577 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:18.872040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3a3d-41a6-4fe9-90fd-8b4bc7eafb9a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:18.942275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:18.968067 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:18.984511 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3a3d-41a6-4fe9-90fd-8b4bc7eafb9a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:18.990106 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e07bc-9441-41cf-ac32-ae0581abe50f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:19.021205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a88010-d2a4-4338-ac33-d6835fa56c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:19.022120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a88010-d2a4-4338-ac33-d6835fa56c47 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:19.022610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a88010-d2a4-4338-ac33-d6835fa56c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:19.023030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a88010-d2a4-4338-ac33-d6835fa56c47 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:19.023915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a88010-d2a4-4338-ac33-d6835fa56c47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:19.024393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a88010-d2a4-4338-ac33-d6835fa56c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:19.025895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a88010-d2a4-4338-ac33-d6835fa56c47 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:19.028489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0d881-7a2c-4bd4-8d21-7149b47929c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:19.028996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0d881-7a2c-4bd4-8d21-7149b47929c9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:19.029290 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0d881-7a2c-4bd4-8d21-7149b47929c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:19.029572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0d881-7a2c-4bd4-8d21-7149b47929c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:19.030436 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0d881-7a2c-4bd4-8d21-7149b47929c9 None admin] RBAC: Adding query filter params (group.id=d6b97655cde1404ea94c1c6c847833fc, role.id=c4b17c7a2a644e91a1872f5fa53e6421, scope.project.id=18a4708787dc49b085266177f70c0577) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:19.030756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0d881-7a2c-4bd4-8d21-7149b47929c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:19.032767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0d881-7a2c-4bd4-8d21-7149b47929c9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:19.036280 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 219/432] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:19.037471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a88010-d2a4-4338-ac33-d6835fa56c47 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:19.039067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 214/433] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 23 16:55:18 2022] GET /identity/v3/role_assignments?group.id=d6b97655cde1404ea94c1c6c847833fc&scope.project.id=18a4708787dc49b085266177f70c0577&role.id=c4b17c7a2a644e91a1872f5fa53e6421 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:19.048402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0d881-7a2c-4bd4-8d21-7149b47929c9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:19.192581 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0d881-7a2c-4bd4-8d21-7149b47929c9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:19.193917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a88010-d2a4-4338-ac33-d6835fa56c47 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:19.223946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:19.234815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71042689-df8c-488a-8e3e-96babade3224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:19.235360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be019c4-fa87-43a4-851e-37ca0ca709a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:19.235726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042689-df8c-488a-8e3e-96babade3224 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:19.236012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042689-df8c-488a-8e3e-96babade3224 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:19.236291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042689-df8c-488a-8e3e-96babade3224 None admin] PATH_INFO: `/v3/groups/d6b97655cde1404ea94c1c6c847833fc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:19.236933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be019c4-fa87-43a4-851e-37ca0ca709a9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:19.237425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be019c4-fa87-43a4-851e-37ca0ca709a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:19.237635 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71042689-df8c-488a-8e3e-96babade3224 None admin] RBAC: Authorizing `identity:get_group(group_id=d6b97655cde1404ea94c1c6c847833fc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:19.238102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be019c4-fa87-43a4-851e-37ca0ca709a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:19.239275 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71042689-df8c-488a-8e3e-96babade3224 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:19.241028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 220/434] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:19 2022] GET /identity/v3/groups/d6b97655cde1404ea94c1c6c847833fc => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:19.242341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf9689-bed5-4ca8-bbeb-51c8001e8eb3 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:19.242659 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf9689-bed5-4ca8-bbeb-51c8001e8eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:19.242939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf9689-bed5-4ca8-bbeb-51c8001e8eb3 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:19.244673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 221/435] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:19.252731 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf9689-bed5-4ca8-bbeb-51c8001e8eb3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:19.275084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:19.338146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be019c4-fa87-43a4-851e-37ca0ca709a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:19.339820 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be019c4-fa87-43a4-851e-37ca0ca709a9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:19.392504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf9689-bed5-4ca8-bbeb-51c8001e8eb3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:19.428511 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a9e78-0374-42d8-9e38-f668dd64d14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:19.429174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a9e78-0374-42d8-9e38-f668dd64d14e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:19.429447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a9e78-0374-42d8-9e38-f668dd64d14e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:19.429723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a9e78-0374-42d8-9e38-f668dd64d14e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:19.430588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a9e78-0374-42d8-9e38-f668dd64d14e None admin] RBAC: Adding query filter params (group.id=d6b97655cde1404ea94c1c6c847833fc, role.id=3027d01b9e8b469784a8db0de5f043bd, scope.project.id=18a4708787dc49b085266177f70c0577) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:19.430911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a9e78-0374-42d8-9e38-f668dd64d14e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:19.432352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a9e78-0374-42d8-9e38-f668dd64d14e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:19.446553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 222/436] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 23 16:55:19 2022] GET /identity/v3/role_assignments?group.id=d6b97655cde1404ea94c1c6c847833fc&scope.project.id=18a4708787dc49b085266177f70c0577&role.id=3027d01b9e8b469784a8db0de5f043bd => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:19.446553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3fbde-b47d-4a05-9313-b8ff2f328727 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:19.446553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3fbde-b47d-4a05-9313-b8ff2f328727 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:19.446553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3fbde-b47d-4a05-9313-b8ff2f328727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:19.447029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 215/437] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 16:55:19.447029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc83fff-91bf-4de2-b993-c3ededc50392 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:19.447155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc83fff-91bf-4de2-b993-c3ededc50392 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:19.447694 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc83fff-91bf-4de2-b993-c3ededc50392 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:19.449602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 216/438] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:19.451216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc83fff-91bf-4de2-b993-c3ededc50392 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:19.466715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4ca3fbde-b47d-4a05-9313-b8ff2f328727 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:19.469014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4ca3fbde-b47d-4a05-9313-b8ff2f328727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:19.490772 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:19.565851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 223/439] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:19.565851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dce03-0c28-4793-8e4d-867c5a7788c8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:19.565851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dce03-0c28-4793-8e4d-867c5a7788c8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:19.565851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dce03-0c28-4793-8e4d-867c5a7788c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:19.584876 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5e0dce03-0c28-4793-8e4d-867c5a7788c8 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:19.585853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc83fff-91bf-4de2-b993-c3ededc50392 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:19.586240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5e0dce03-0c28-4793-8e4d-867c5a7788c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:19.589679 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:19.625085 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1deb71a-e0b6-4b2c-bdcf-6670188d9d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:19.626288 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deb71a-e0b6-4b2c-bdcf-6670188d9d87 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:19.627439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deb71a-e0b6-4b2c-bdcf-6670188d9d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:19.627439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deb71a-e0b6-4b2c-bdcf-6670188d9d87 None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:19.629047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1deb71a-e0b6-4b2c-bdcf-6670188d9d87 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:19.630511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1deb71a-e0b6-4b2c-bdcf-6670188d9d87 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:19.636796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 217/440] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:19 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:19.637624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1deb71a-e0b6-4b2c-bdcf-6670188d9d87 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:19.669257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 224/441] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:19.670111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dce03-0c28-4793-8e4d-867c5a7788c8 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:19.758837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:19.768823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1deb71a-e0b6-4b2c-bdcf-6670188d9d87 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:19.805007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dce03-0c28-4793-8e4d-867c5a7788c8 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:19.823481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9872eb-d02f-4bb5-84c7-dd8a97910b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:19.824519 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9872eb-d02f-4bb5-84c7-dd8a97910b6d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:19.824807 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9872eb-d02f-4bb5-84c7-dd8a97910b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:19.825074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9872eb-d02f-4bb5-84c7-dd8a97910b6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:19.839986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9872eb-d02f-4bb5-84c7-dd8a97910b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:19.843370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bb330-bb07-457a-a076-9c53bff41fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:19.844270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bb330-bb07-457a-a076-9c53bff41fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:19.844727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bb330-bb07-457a-a076-9c53bff41fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:19.845009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bb330-bb07-457a-a076-9c53bff41fb5 None admin] PATH_INFO: `/v3/groups/d6b97655cde1404ea94c1c6c847833fc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:19.846186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bb330-bb07-457a-a076-9c53bff41fb5 None admin] RBAC: Authorizing `identity:get_group(group_id=d6b97655cde1404ea94c1c6c847833fc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:19.847666 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bb330-bb07-457a-a076-9c53bff41fb5 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-af9872eb-d02f-4bb5-84c7-dd8a97910b6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:19.848464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:19.849323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:19.850959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:19.850959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:19.850959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:19.850959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:19.850959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:19.850959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:19.850959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:19.850959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:19.850959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:19.850959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:19.850959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:55:19.850959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:19.851604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 225/442] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:19 2022] GET /identity/v3/groups/d6b97655cde1404ea94c1c6c847833fc => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:19.851681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 218/443] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:19.851748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bb330-bb07-457a-a076-9c53bff41fb5 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:19.855253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9872eb-d02f-4bb5-84c7-dd8a97910b6d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:19.865128 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:19.979062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bb330-bb07-457a-a076-9c53bff41fb5 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:19.979282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9872eb-d02f-4bb5-84c7-dd8a97910b6d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:20.017684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bea7f-bc03-4a5e-81c5-10a3e7927d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:20.018585 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bea7f-bc03-4a5e-81c5-10a3e7927d4b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:20.018876 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bea7f-bc03-4a5e-81c5-10a3e7927d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:20.019154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bea7f-bc03-4a5e-81c5-10a3e7927d4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:20.019268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15554803-b0f4-4c29-8423-e48587a05cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:20.019814 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15554803-b0f4-4c29-8423-e48587a05cea None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:20.020097 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15554803-b0f4-4c29-8423-e48587a05cea None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:20.020375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15554803-b0f4-4c29-8423-e48587a05cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:20.021210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15554803-b0f4-4c29-8423-e48587a05cea None admin] RBAC: Adding query filter params (group.id=d6b97655cde1404ea94c1c6c847833fc, role.id=c4b17c7a2a644e91a1872f5fa53e6421, scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:20.021522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15554803-b0f4-4c29-8423-e48587a05cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:20.022993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15554803-b0f4-4c29-8423-e48587a05cea None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:20.028892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 219/444] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 23 16:55:19 2022] GET /identity/v3/role_assignments?group.id=d6b97655cde1404ea94c1c6c847833fc&scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b&role.id=c4b17c7a2a644e91a1872f5fa53e6421 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:20.029507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bea7f-bc03-4a5e-81c5-10a3e7927d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:20.029686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15554803-b0f4-4c29-8423-e48587a05cea None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-487bea7f-bc03-4a5e-81c5-10a3e7927d4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:20.038214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:20.039289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:20.040092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:20.040092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:20.040092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:20.040092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:20.040092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:20.040092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:20.040092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:20.040092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:20.040092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:20.040092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:20.040092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:55:20.040092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:20.041230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 226/445] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:55:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:20.046513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bea7f-bc03-4a5e-81c5-10a3e7927d4b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:20.051578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:20.128666 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:20.148116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15554803-b0f4-4c29-8423-e48587a05cea None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:20.169026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bea7f-bc03-4a5e-81c5-10a3e7927d4b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:20.186683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6cfdd-daf8-4029-be5c-0307a9be972a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:20.187366 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6cfdd-daf8-4029-be5c-0307a9be972a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:20.187656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6cfdd-daf8-4029-be5c-0307a9be972a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:20.188027 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6cfdd-daf8-4029-be5c-0307a9be972a None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:20.188802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6cfdd-daf8-4029-be5c-0307a9be972a None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:20.189119 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6cfdd-daf8-4029-be5c-0307a9be972a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:20.190570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6cfdd-daf8-4029-be5c-0307a9be972a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:20.200065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 220/446] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:55:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:20.205702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6cfdd-daf8-4029-be5c-0307a9be972a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:20.216757 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8fd1f-1a60-4887-b98e-310c45e69b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:20.217803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8fd1f-1a60-4887-b98e-310c45e69b3e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:20.218097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8fd1f-1a60-4887-b98e-310c45e69b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:20.219959 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8fd1f-1a60-4887-b98e-310c45e69b3e None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:20.220727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8fd1f-1a60-4887-b98e-310c45e69b3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:20.221041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8fd1f-1a60-4887-b98e-310c45e69b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:20.222439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8fd1f-1a60-4887-b98e-310c45e69b3e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:20.232650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 227/447] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:20.237857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8fd1f-1a60-4887-b98e-310c45e69b3e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:20.301151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:20.320718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6cfdd-daf8-4029-be5c-0307a9be972a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:20.347658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8fd1f-1a60-4887-b98e-310c45e69b3e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:20.353916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d99917-e1a0-4a9f-a6d6-d85dd9ad0704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:20.354587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d99917-e1a0-4a9f-a6d6-d85dd9ad0704 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:20.354869 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d99917-e1a0-4a9f-a6d6-d85dd9ad0704 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:20.355142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d99917-e1a0-4a9f-a6d6-d85dd9ad0704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:20.379442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:20.385566 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5f132-d4e0-42ac-be9d-93e3d29e6159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:20.386215 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5f132-d4e0-42ac-be9d-93e3d29e6159 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:20.386553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5f132-d4e0-42ac-be9d-93e3d29e6159 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:20.386837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5f132-d4e0-42ac-be9d-93e3d29e6159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:20.424988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d99917-e1a0-4a9f-a6d6-d85dd9ad0704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:20.426458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d99917-e1a0-4a9f-a6d6-d85dd9ad0704 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:20.453069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5f132-d4e0-42ac-be9d-93e3d29e6159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:20.454871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5f132-d4e0-42ac-be9d-93e3d29e6159 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:20.505369 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:20.525333 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 221/448] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 16:55:20.530912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d99917-e1a0-4a9f-a6d6-d85dd9ad0704 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:20.554307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 228/449] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 16:55:20.559718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5f132-d4e0-42ac-be9d-93e3d29e6159 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:20.589139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:20.628780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d99917-e1a0-4a9f-a6d6-d85dd9ad0704 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:20.657741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5f132-d4e0-42ac-be9d-93e3d29e6159 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:20.663195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea39b6-fe93-4d2c-b2e0-df056de89ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:20.664042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea39b6-fe93-4d2c-b2e0-df056de89ddc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:20.664326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea39b6-fe93-4d2c-b2e0-df056de89ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:20.664601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea39b6-fe93-4d2c-b2e0-df056de89ddc None admin] PATH_INFO: `/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:20.666180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea39b6-fe93-4d2c-b2e0-df056de89ddc None admin] RBAC: Authorizing `identity:get_project(project_id=3cbc0a559a674cb78cba6f09b7f95a3b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:20.667693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea39b6-fe93-4d2c-b2e0-df056de89ddc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:20.669370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 222/450] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:20 2022] GET /identity/v3/projects/3cbc0a559a674cb78cba6f09b7f95a3b => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:20.674761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea39b6-fe93-4d2c-b2e0-df056de89ddc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:20.692850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2638d-9611-465c-a47e-553627517251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:20.693709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2638d-9611-465c-a47e-553627517251 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:20.693992 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2638d-9611-465c-a47e-553627517251 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:20.694266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2638d-9611-465c-a47e-553627517251 None admin] PATH_INFO: `/v3/projects/1e61a710b27f4ea29e3f6c7963fdf0c4` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:20.695458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2638d-9611-465c-a47e-553627517251 None admin] RBAC: Authorizing `identity:get_project(project_id=1e61a710b27f4ea29e3f6c7963fdf0c4)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:20.696869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2638d-9611-465c-a47e-553627517251 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:20.698576 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 229/451] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:55:20 2022] GET /identity/v3/projects/1e61a710b27f4ea29e3f6c7963fdf0c4 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:20.704632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2638d-9611-465c-a47e-553627517251 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:20.724711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:20.778671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea39b6-fe93-4d2c-b2e0-df056de89ddc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:20.801315 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:20.805236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2638d-9611-465c-a47e-553627517251 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:20.816415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d6641-ba67-42bd-a17b-484a1ea1a388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:20.817270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d6641-ba67-42bd-a17b-484a1ea1a388 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:20.817560 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d6641-ba67-42bd-a17b-484a1ea1a388 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:20.817835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d6641-ba67-42bd-a17b-484a1ea1a388 None admin] PATH_INFO: `/v3/groups/d6b97655cde1404ea94c1c6c847833fc` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:20.819122 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d6641-ba67-42bd-a17b-484a1ea1a388 None admin] RBAC: Authorizing `identity:get_group(group_id=d6b97655cde1404ea94c1c6c847833fc)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:20.820937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d6641-ba67-42bd-a17b-484a1ea1a388 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:20.822581 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 223/452] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:20 2022] GET /identity/v3/groups/d6b97655cde1404ea94c1c6c847833fc => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:20.828534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d6641-ba67-42bd-a17b-484a1ea1a388 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:20.839340 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a47db-8909-4eef-9543-9e77bbc40406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:20.840197 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a47db-8909-4eef-9543-9e77bbc40406 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:20.840484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a47db-8909-4eef-9543-9e77bbc40406 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:20.840760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a47db-8909-4eef-9543-9e77bbc40406 None admin] PATH_INFO: `/v3/groups/94af25c73e144c22828c386eb89b54e9` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:20.841926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a47db-8909-4eef-9543-9e77bbc40406 None admin] RBAC: Authorizing `identity:get_group(group_id=94af25c73e144c22828c386eb89b54e9)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:20.843430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a47db-8909-4eef-9543-9e77bbc40406 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:20.845658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 230/453] 10.222.0.49 () {56 vars in 1180 bytes} [Mon May 23 16:55:20 2022] GET /identity/v3/groups/94af25c73e144c22828c386eb89b54e9 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:20.851261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a47db-8909-4eef-9543-9e77bbc40406 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:20.927969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d6641-ba67-42bd-a17b-484a1ea1a388 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:20.944385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:20.948259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a47db-8909-4eef-9543-9e77bbc40406 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:20.963168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae931e-ae2b-45f9-a9e8-e1c65089d071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:20.963820 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae931e-ae2b-45f9-a9e8-e1c65089d071 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:20.964107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae931e-ae2b-45f9-a9e8-e1c65089d071 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:20.964384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae931e-ae2b-45f9-a9e8-e1c65089d071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:20.965217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae931e-ae2b-45f9-a9e8-e1c65089d071 None admin] RBAC: Adding query filter params (group.id=d6b97655cde1404ea94c1c6c847833fc, role.id=3027d01b9e8b469784a8db0de5f043bd, scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:20.965528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae931e-ae2b-45f9-a9e8-e1c65089d071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:20.966996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae931e-ae2b-45f9-a9e8-e1c65089d071 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:20.973358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 224/454] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 23 16:55:20 2022] GET /identity/v3/role_assignments?group.id=d6b97655cde1404ea94c1c6c847833fc&scope.project.id=3cbc0a559a674cb78cba6f09b7f95a3b&role.id=3027d01b9e8b469784a8db0de5f043bd => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:20.982879 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e0af7-e698-4a2f-bfb5-31e288377a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:20.983551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e0af7-e698-4a2f-bfb5-31e288377a2d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:20.983834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e0af7-e698-4a2f-bfb5-31e288377a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:20.984108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e0af7-e698-4a2f-bfb5-31e288377a2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:20.984962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e0af7-e698-4a2f-bfb5-31e288377a2d None admin] RBAC: Adding query filter params (group.id=94af25c73e144c22828c386eb89b54e9, role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=1e61a710b27f4ea29e3f6c7963fdf0c4) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:20.985271 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e0af7-e698-4a2f-bfb5-31e288377a2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:20.986764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e0af7-e698-4a2f-bfb5-31e288377a2d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:20.993544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 231/455] 10.222.0.49 () {56 vars in 1376 bytes} [Mon May 23 16:55:20 2022] GET /identity/v3/role_assignments?group.id=94af25c73e144c22828c386eb89b54e9&scope.project.id=1e61a710b27f4ea29e3f6c7963fdf0c4&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:23.873752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fceab5-48e6-47f3-8921-b53ebf7ad6fa None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:23.874660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fceab5-48e6-47f3-8921-b53ebf7ad6fa None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:23.875086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fceab5-48e6-47f3-8921-b53ebf7ad6fa None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:23.877441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 225/456] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:23.882444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a817e-2c54-467c-be77-d08abf452d26 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:23.883224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a817e-2c54-467c-be77-d08abf452d26 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:23.883652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a817e-2c54-467c-be77-d08abf452d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:23.911412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e97a817e-2c54-467c-be77-d08abf452d26 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:23.912862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e97a817e-2c54-467c-be77-d08abf452d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:23.946441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:24.008538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 232/457] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:24.056801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fceab5-48e6-47f3-8921-b53ebf7ad6fa None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:24.069784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947fe36-e378-4773-ab81-857d16cfc2e3 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:24.070084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947fe36-e378-4773-ab81-857d16cfc2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:24.070389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947fe36-e378-4773-ab81-857d16cfc2e3 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:24.072021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 233/458] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:24.078141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a66ae-9641-4344-ae55-1a3568d7a9c4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:24.079018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a66ae-9641-4344-ae55-1a3568d7a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:24.079484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a66ae-9641-4344-ae55-1a3568d7a9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:24.099211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-018a66ae-9641-4344-ae55-1a3568d7a9c4 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:24.100675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-018a66ae-9641-4344-ae55-1a3568d7a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:24.182594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 234/459] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:55:24.211350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a66ae-9641-4344-ae55-1a3568d7a9c4 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:24.299212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fceab5-48e6-47f3-8921-b53ebf7ad6fa None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:24.325798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:24.338326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a66ae-9641-4344-ae55-1a3568d7a9c4 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:24.379420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d54a67-3a05-474d-8528-8960d37471ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:24.380667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d54a67-3a05-474d-8528-8960d37471ac None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:24.381137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d54a67-3a05-474d-8528-8960d37471ac None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:24.381751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d54a67-3a05-474d-8528-8960d37471ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:24.391214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b9a60-9cd8-43b7-b561-8d39b2c2eeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:24.392147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b9a60-9cd8-43b7-b561-8d39b2c2eeee None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:24.392582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b9a60-9cd8-43b7-b561-8d39b2c2eeee None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:24.392933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b9a60-9cd8-43b7-b561-8d39b2c2eeee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:24.394722 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d54a67-3a05-474d-8528-8960d37471ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:24.396564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d54a67-3a05-474d-8528-8960d37471ac None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:24.415450 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b9a60-9cd8-43b7-b561-8d39b2c2eeee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:24.417006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b9a60-9cd8-43b7-b561-8d39b2c2eeee None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f1d54a67-3a05-474d-8528-8960d37471ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:24.417705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:24.418570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:24.419402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:24.419402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:24.419402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:24.419402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:24.421740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 235/460] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:24.428914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d54a67-3a05-474d-8528-8960d37471ac None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-430b9a60-9cd8-43b7-b561-8d39b2c2eeee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:24.463647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:24.464568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:24.465458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:24.465458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:24.465458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:24.465458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:24.465458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 226/461] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:24.466645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cd7be-5b97-4c20-b9c6-44c6b25d8e58 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:24.467031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cd7be-5b97-4c20-b9c6-44c6b25d8e58 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:24.467648 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cd7be-5b97-4c20-b9c6-44c6b25d8e58 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:24.469189 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 227/462] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:24.474555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce120e4-7cf3-4cc5-8489-42db0eec2d2c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:24.474948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce120e4-7cf3-4cc5-8489-42db0eec2d2c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:24.475327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce120e4-7cf3-4cc5-8489-42db0eec2d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:24.493705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-1ce120e4-7cf3-4cc5-8489-42db0eec2d2c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:24.494931 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1ce120e4-7cf3-4cc5-8489-42db0eec2d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:24.523282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:24.549011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d54a67-3a05-474d-8528-8960d37471ac None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:24.579229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 228/463] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:24.579229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce120e4-7cf3-4cc5-8489-42db0eec2d2c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:24.599686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453fae5-a8ed-4c39-ae6a-6e4006c242f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:24.600873 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453fae5-a8ed-4c39-ae6a-6e4006c242f0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:24.601357 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453fae5-a8ed-4c39-ae6a-6e4006c242f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:24.601840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453fae5-a8ed-4c39-ae6a-6e4006c242f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:24.603135 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453fae5-a8ed-4c39-ae6a-6e4006c242f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:24.603669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453fae5-a8ed-4c39-ae6a-6e4006c242f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:24.605870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453fae5-a8ed-4c39-ae6a-6e4006c242f0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:24.624745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 236/464] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:24.627732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f351fc-1e51-4c06-951e-c8c3e9ee6bb7 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:24.628241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f351fc-1e51-4c06-951e-c8c3e9ee6bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:24.628736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f351fc-1e51-4c06-951e-c8c3e9ee6bb7 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:24.634423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 237/465] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:24.634423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f351fc-1e51-4c06-951e-c8c3e9ee6bb7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:24.635471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:24.713307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce120e4-7cf3-4cc5-8489-42db0eec2d2c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:24.748405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4b522-7ffe-4727-8315-a9c86a22959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:24.748601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f351fc-1e51-4c06-951e-c8c3e9ee6bb7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:24.749063 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4b522-7ffe-4727-8315-a9c86a22959f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:24.749345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4b522-7ffe-4727-8315-a9c86a22959f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:24.749620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4b522-7ffe-4727-8315-a9c86a22959f None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:24.751022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4b522-7ffe-4727-8315-a9c86a22959f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:24.751472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4b522-7ffe-4727-8315-a9c86a22959f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:24.752839 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4b522-7ffe-4727-8315-a9c86a22959f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:24.765069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 229/466] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:24.765659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4b522-7ffe-4727-8315-a9c86a22959f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:24.793049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8d28b-2405-492f-9fa7-a226e78d4cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:24.793847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8d28b-2405-492f-9fa7-a226e78d4cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:24.794143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8d28b-2405-492f-9fa7-a226e78d4cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:24.794438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8d28b-2405-492f-9fa7-a226e78d4cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:24.802739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:24.805990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8d28b-2405-492f-9fa7-a226e78d4cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:24.807483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8d28b-2405-492f-9fa7-a226e78d4cd0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-3ea8d28b-2405-492f-9fa7-a226e78d4cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:24.825696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:24.826771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:24.827721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:24.827721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:24.827721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:24.827721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:24.830341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 238/467] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:24.831586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5423d-3d6b-487f-bf82-e573a0aab6b3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:24.831882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5423d-3d6b-487f-bf82-e573a0aab6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:24.832163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5423d-3d6b-487f-bf82-e573a0aab6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:24.849905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3bd5423d-3d6b-487f-bf82-e573a0aab6b3 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:24.851127 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3bd5423d-3d6b-487f-bf82-e573a0aab6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:24.893530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4b522-7ffe-4727-8315-a9c86a22959f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:24.902146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:24.921451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 239/468] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:24.923083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5423d-3d6b-487f-bf82-e573a0aab6b3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:24.943520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622a591-b817-4e56-bab0-206d3b7b590b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:24.944951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622a591-b817-4e56-bab0-206d3b7b590b None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:24.945416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622a591-b817-4e56-bab0-206d3b7b590b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:24.946145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622a591-b817-4e56-bab0-206d3b7b590b None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:24.947377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622a591-b817-4e56-bab0-206d3b7b590b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:24.949731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622a591-b817-4e56-bab0-206d3b7b590b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:24.972637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 230/469] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:55:24 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:24.974132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622a591-b817-4e56-bab0-206d3b7b590b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:25.076127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:25.084827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5423d-3d6b-487f-bf82-e573a0aab6b3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:25.106788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622a591-b817-4e56-bab0-206d3b7b590b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:25.129187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd718c85-3f04-4ed2-93b6-f6e79b5134a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:25.130430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd718c85-3f04-4ed2-93b6-f6e79b5134a9 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:25.130915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd718c85-3f04-4ed2-93b6-f6e79b5134a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:25.131474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd718c85-3f04-4ed2-93b6-f6e79b5134a9 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:25.132399 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd718c85-3f04-4ed2-93b6-f6e79b5134a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:25.134083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd718c85-3f04-4ed2-93b6-f6e79b5134a9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:25.156062 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db416b-2e7e-42bd-b039-38bc9f04296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:25.157153 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db416b-2e7e-42bd-b039-38bc9f04296b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:25.157450 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db416b-2e7e-42bd-b039-38bc9f04296b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:25.157728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db416b-2e7e-42bd-b039-38bc9f04296b None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:25.158503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db416b-2e7e-42bd-b039-38bc9f04296b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:25.158815 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db416b-2e7e-42bd-b039-38bc9f04296b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:25.160201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db416b-2e7e-42bd-b039-38bc9f04296b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:25.161385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 240/470] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:55:24 2022] POST /identity/v3/users => generated 246 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:25.162837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd718c85-3f04-4ed2-93b6-f6e79b5134a9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:25.181395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 231/471] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:25.182613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db416b-2e7e-42bd-b039-38bc9f04296b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:25.228968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:25.311583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db416b-2e7e-42bd-b039-38bc9f04296b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:25.318911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd718c85-3f04-4ed2-93b6-f6e79b5134a9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:25.358828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5b6e1-4717-4e60-9c77-2d8fcc4fec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:25.360088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5b6e1-4717-4e60-9c77-2d8fcc4fec04 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:25.360555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5b6e1-4717-4e60-9c77-2d8fcc4fec04 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:25.361006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5b6e1-4717-4e60-9c77-2d8fcc4fec04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:25.367529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aba796-9291-451d-9c91-7704436b285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:25.368290 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aba796-9291-451d-9c91-7704436b285c None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:25.368662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aba796-9291-451d-9c91-7704436b285c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:25.370036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aba796-9291-451d-9c91-7704436b285c None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:25.370036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aba796-9291-451d-9c91-7704436b285c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:25.371925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aba796-9291-451d-9c91-7704436b285c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:25.376915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5b6e1-4717-4e60-9c77-2d8fcc4fec04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:25.378619 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5b6e1-4717-4e60-9c77-2d8fcc4fec04 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:25.384378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b7a5b6e1-4717-4e60-9c77-2d8fcc4fec04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:25.403043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:25.403968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:25.404798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:25.404798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:25.404798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:25.404798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:25.406899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 232/472] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:55:25 2022] POST /identity/v3/users => generated 249 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:55:25.408973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 241/473] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:25.415231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aba796-9291-451d-9c91-7704436b285c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:25.539157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aba796-9291-451d-9c91-7704436b285c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:25.591269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62b3c8-7319-4e27-a911-be00c2447f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:25.591955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62b3c8-7319-4e27-a911-be00c2447f79 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:25.592240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62b3c8-7319-4e27-a911-be00c2447f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:25.592580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62b3c8-7319-4e27-a911-be00c2447f79 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:25.593332 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62b3c8-7319-4e27-a911-be00c2447f79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:25.593689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62b3c8-7319-4e27-a911-be00c2447f79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:25.595194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62b3c8-7319-4e27-a911-be00c2447f79 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:25.613642 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 233/474] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:25.619165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5b6e1-4717-4e60-9c77-2d8fcc4fec04 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:25.742698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:25.751709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5b6e1-4717-4e60-9c77-2d8fcc4fec04 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:25.764341 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb39e38-edca-4d10-a4c4-cf500f670b75 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:25.764521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb39e38-edca-4d10-a4c4-cf500f670b75 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:25.764764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb39e38-edca-4d10-a4c4-cf500f670b75 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:25.767209 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 234/475] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:25.774435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f17d5b-9c7c-4048-a68e-33bcd10268c6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:25.774863 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f17d5b-9c7c-4048-a68e-33bcd10268c6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:25.775317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f17d5b-9c7c-4048-a68e-33bcd10268c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:25.794671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdead7-319e-40e3-9935-36e0fa21e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:25.795476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdead7-319e-40e3-9935-36e0fa21e3b2 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:25.795665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdead7-319e-40e3-9935-36e0fa21e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:25.798382 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdead7-319e-40e3-9935-36e0fa21e3b2 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:25.798382 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdead7-319e-40e3-9935-36e0fa21e3b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:25.799641 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdead7-319e-40e3-9935-36e0fa21e3b2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:25.808876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-22f17d5b-9c7c-4048-a68e-33bcd10268c6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:25.810095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-22f17d5b-9c7c-4048-a68e-33bcd10268c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:25.845537 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 242/476] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:55:25 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:25.902472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:25.923352 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 235/477] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:25.971604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdead7-319e-40e3-9935-36e0fa21e3b2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:26.144540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdead7-319e-40e3-9935-36e0fa21e3b2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:26.194546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41739e14-d857-42ec-8f13-d6cd4eb38bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:26.195155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41739e14-d857-42ec-8f13-d6cd4eb38bc4 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:26.195441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41739e14-d857-42ec-8f13-d6cd4eb38bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:26.195723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41739e14-d857-42ec-8f13-d6cd4eb38bc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:26.196491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41739e14-d857-42ec-8f13-d6cd4eb38bc4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:26.197870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41739e14-d857-42ec-8f13-d6cd4eb38bc4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:26.209353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.sql.core [None req-41739e14-d857-42ec-8f13-d6cd4eb38bc4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 16:55:26.209353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 16:55:26.209353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [parameters: {'id': '8f0ea3b5ade54626a87a427cbb4948af', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 16:55:26.209353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80412) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-41739e14-d857-42ec-8f13-d6cd4eb38bc4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result = self._query(query) May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application conn.query(q) May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result.read() May 23 16:55:26.227975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return ref.to_dict() May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 16:55:26.228909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application next(self.gen) May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application yield resource May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application next(self.gen) May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.session.rollback() May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.force_reraise() May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise self.value May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application session.commit() May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 16:55:26.229883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._prepare_impl() May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.session.flush() May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._flush(objects) May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application compat.raise_( May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application flush_context.execute() May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rec.execute(self) May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 16:55:26.230794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 16:55:26.231656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result = self._query(query) May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application conn.query(q) May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result.read() May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 16:55:26.232466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [parameters: {'id': '8f0ea3b5ade54626a87a427cbb4948af', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:26.233235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 16:55:26.234022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:26.240990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 243/478] 10.222.0.49 () {60 vars in 1131 bytes} [Mon May 23 16:55:25 2022] POST /identity/v3/roles => generated 144 bytes in 259 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:26.241146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f17d5b-9c7c-4048-a68e-33bcd10268c6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:26.346197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f17d5b-9c7c-4048-a68e-33bcd10268c6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:26.383821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c405b5c-ef09-4364-92c5-5fa8d552b40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:26.384632 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c405b5c-ef09-4364-92c5-5fa8d552b40c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:26.384917 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c405b5c-ef09-4364-92c5-5fa8d552b40c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:26.385192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c405b5c-ef09-4364-92c5-5fa8d552b40c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:26.397137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c405b5c-ef09-4364-92c5-5fa8d552b40c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-0c405b5c-ef09-4364-92c5-5fa8d552b40c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:26.405275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:26.407963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:26.409938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:26.409938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:26.409938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:26.409938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:26.409938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:26.409938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:26.409938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:26.409938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:26.409938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:26.409938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:26.409938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:55:26.409938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:26.418431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 236/479] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:55:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:26.418692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41739e14-d857-42ec-8f13-d6cd4eb38bc4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:26.430752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:26.521771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41739e14-d857-42ec-8f13-d6cd4eb38bc4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:26.558332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80285d-e109-4b10-bf3c-3a80fa2d34c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:26.559033 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80285d-e109-4b10-bf3c-3a80fa2d34c9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:26.559323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80285d-e109-4b10-bf3c-3a80fa2d34c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:26.559604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80285d-e109-4b10-bf3c-3a80fa2d34c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:26.560415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80285d-e109-4b10-bf3c-3a80fa2d34c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:26.560727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80285d-e109-4b10-bf3c-3a80fa2d34c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:26.562153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80285d-e109-4b10-bf3c-3a80fa2d34c9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:26.574525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 244/480] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:27.868942 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334973c-26b4-41a8-8f07-88fb07187024 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:27.869449 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334973c-26b4-41a8-8f07-88fb07187024 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:27.869562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334973c-26b4-41a8-8f07-88fb07187024 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:27.871343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 237/481] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:27.876812 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563ae17-0b58-4d50-9b3b-195532afc706 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:27.877256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563ae17-0b58-4d50-9b3b-195532afc706 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:27.877437 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563ae17-0b58-4d50-9b3b-195532afc706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:27.896516 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4563ae17-0b58-4d50-9b3b-195532afc706 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:27.897802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4563ae17-0b58-4d50-9b3b-195532afc706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:27.974660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 245/482] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:28.011021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334973c-26b4-41a8-8f07-88fb07187024 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:28.062182 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:28.136066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d3225-fdf1-4c7c-a0fb-28bc219fb808 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:28.136359 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d3225-fdf1-4c7c-a0fb-28bc219fb808 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:28.136639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d3225-fdf1-4c7c-a0fb-28bc219fb808 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:28.138941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334973c-26b4-41a8-8f07-88fb07187024 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:28.139056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 246/483] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:55:28.151632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c60c8-4480-4d6b-88b3-e4ee0c3ca5b9 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:28.151999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c60c8-4480-4d6b-88b3-e4ee0c3ca5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:28.152281 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c60c8-4480-4d6b-88b3-e4ee0c3ca5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:28.167394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:28.179045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda35a6-975a-4531-9417-6560e2f923e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:28.179859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda35a6-975a-4531-9417-6560e2f923e7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:28.180150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda35a6-975a-4531-9417-6560e2f923e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:28.180436 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda35a6-975a-4531-9417-6560e2f923e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:28.183384 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6b0c60c8-4480-4d6b-88b3-e4ee0c3ca5b9 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:28.184583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6b0c60c8-4480-4d6b-88b3-e4ee0c3ca5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:28.207003 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda35a6-975a-4531-9417-6560e2f923e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-bcda35a6-975a-4531-9417-6560e2f923e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:28.214996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:28.216040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:28.216831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:28.216831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:28.216831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:28.216831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:28.216831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:28.216831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:28.216831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:28.216831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:28.216831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:28.216831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:28.216831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:28.216831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:28.219058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 238/484] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:28.227609 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda35a6-975a-4531-9417-6560e2f923e7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:28.334029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda35a6-975a-4531-9417-6560e2f923e7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:28.346683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:28.364069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 247/485] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:55:28.369618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a4062-c44e-412c-b043-bd5d8e83f7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:28.370309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a4062-c44e-412c-b043-bd5d8e83f7de None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:28.370618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a4062-c44e-412c-b043-bd5d8e83f7de None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:28.370909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a4062-c44e-412c-b043-bd5d8e83f7de None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:28.371684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a4062-c44e-412c-b043-bd5d8e83f7de None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:28.372002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a4062-c44e-412c-b043-bd5d8e83f7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:28.373418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a4062-c44e-412c-b043-bd5d8e83f7de None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:28.383207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 239/486] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:28.391577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c60c8-4480-4d6b-88b3-e4ee0c3ca5b9 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:28.401757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a4062-c44e-412c-b043-bd5d8e83f7de None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:28.528765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a4062-c44e-412c-b043-bd5d8e83f7de None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:28.533696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c60c8-4480-4d6b-88b3-e4ee0c3ca5b9 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:28.566241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc025855-83f5-4d75-a6c1-a87e524cef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:28.567072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc025855-83f5-4d75-a6c1-a87e524cef47 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:28.567363 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc025855-83f5-4d75-a6c1-a87e524cef47 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:28.567645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc025855-83f5-4d75-a6c1-a87e524cef47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:28.570180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a149e1-9ce1-4da6-83e2-906103030acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:28.571182 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a149e1-9ce1-4da6-83e2-906103030acd None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:28.571615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a149e1-9ce1-4da6-83e2-906103030acd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:28.572060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a149e1-9ce1-4da6-83e2-906103030acd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:28.574492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:28.579946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc025855-83f5-4d75-a6c1-a87e524cef47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:28.585322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a149e1-9ce1-4da6-83e2-906103030acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:28.586970 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a149e1-9ce1-4da6-83e2-906103030acd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-fc025855-83f5-4d75-a6c1-a87e524cef47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:28.589029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:28.590105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:28.591124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 240/487] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:28.596358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aeebc-e70e-4aa2-a211-6233e7edea82 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:28.596358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aeebc-e70e-4aa2-a211-6233e7edea82 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:28.596358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aeebc-e70e-4aa2-a211-6233e7edea82 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:28.596358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 241/488] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:28.598672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aeebc-e70e-4aa2-a211-6233e7edea82 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e9a149e1-9ce1-4da6-83e2-906103030acd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:28.614878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:28.615964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:28.616918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:28.616918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:28.616918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:28.616918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:28.618740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 248/489] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:28.620243 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00397-69f0-4b62-b241-f63467f531ce None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:28.620759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00397-69f0-4b62-b241-f63467f531ce None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:28.621235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00397-69f0-4b62-b241-f63467f531ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:28.629502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:28.639504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a8c00397-69f0-4b62-b241-f63467f531ce None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:28.641507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a8c00397-69f0-4b62-b241-f63467f531ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:28.712231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 249/490] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:28.713470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c00397-69f0-4b62-b241-f63467f531ce None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:28.718939 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aeebc-e70e-4aa2-a211-6233e7edea82 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:28.775087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fe968-6c13-41fa-8eed-09901c2ac4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:28.775759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fe968-6c13-41fa-8eed-09901c2ac4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:28.776053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fe968-6c13-41fa-8eed-09901c2ac4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:28.776331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fe968-6c13-41fa-8eed-09901c2ac4e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:28.777088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fe968-6c13-41fa-8eed-09901c2ac4e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:28.777444 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fe968-6c13-41fa-8eed-09901c2ac4e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:28.778849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fe968-6c13-41fa-8eed-09901c2ac4e2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:28.788356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 242/491] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:28.793197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fe968-6c13-41fa-8eed-09901c2ac4e2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:28.833798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c00397-69f0-4b62-b241-f63467f531ce None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:28.853383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:28.874761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba746b-4054-49da-bc21-48c853ee45b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:28.876449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba746b-4054-49da-bc21-48c853ee45b2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:28.876942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba746b-4054-49da-bc21-48c853ee45b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:28.877847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba746b-4054-49da-bc21-48c853ee45b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:28.878800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba746b-4054-49da-bc21-48c853ee45b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:28.879313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba746b-4054-49da-bc21-48c853ee45b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:28.880894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba746b-4054-49da-bc21-48c853ee45b2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:28.894463 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 250/492] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:28.895560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba746b-4054-49da-bc21-48c853ee45b2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:28.914888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:28.934524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fe968-6c13-41fa-8eed-09901c2ac4e2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:28.971065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061dc61-46c8-40f9-8091-d0a51959127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:28.972285 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061dc61-46c8-40f9-8091-d0a51959127f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:28.972771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061dc61-46c8-40f9-8091-d0a51959127f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:28.973253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061dc61-46c8-40f9-8091-d0a51959127f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:28.984896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061dc61-46c8-40f9-8091-d0a51959127f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c061dc61-46c8-40f9-8091-d0a51959127f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:28.993206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:28.994096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:28.994930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:28.994930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:28.994930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:28.994930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:28.994930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:28.994930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:28.994930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:28.994930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:28.994930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:28.994930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:28.994930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:28.994930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:28.997638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 243/493] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:28.998653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061dc61-46c8-40f9-8091-d0a51959127f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:29.032009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba746b-4054-49da-bc21-48c853ee45b2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:29.069564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8d24-ded7-4b89-b9f4-b5735bb48f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:29.070380 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8d24-ded7-4b89-b9f4-b5735bb48f95 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.070675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8d24-ded7-4b89-b9f4-b5735bb48f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.070950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8d24-ded7-4b89-b9f4-b5735bb48f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.085677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd8d24-ded7-4b89-b9f4-b5735bb48f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:29.087196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd8d24-ded7-4b89-b9f4-b5735bb48f95 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-c1cd8d24-ded7-4b89-b9f4-b5735bb48f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:29.104987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:29.105856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:29.106773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:29.106773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:29.106773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:29.106773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:29.106773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 251/494] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:29.107032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8d24-ded7-4b89-b9f4-b5735bb48f95 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:29.113879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061dc61-46c8-40f9-8091-d0a51959127f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:29.138943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:29.150909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77ea50-0b3c-41f4-9282-7681298e190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:29.151711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77ea50-0b3c-41f4-9282-7681298e190e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.152001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77ea50-0b3c-41f4-9282-7681298e190e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.152283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77ea50-0b3c-41f4-9282-7681298e190e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.160337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77ea50-0b3c-41f4-9282-7681298e190e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:29.161790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77ea50-0b3c-41f4-9282-7681298e190e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-df77ea50-0b3c-41f4-9282-7681298e190e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:29.177845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:29.178830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:29.179733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:29.179733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:29.179733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:29.179733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:29.179733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:29.179733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:29.179733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:29.179733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:29.179733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 16:55:29.179733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:29.179733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 244/495] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:29.180301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8f8ce-d2cf-4b5c-88a0-3538dbdceb3e None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.181182 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8f8ce-d2cf-4b5c-88a0-3538dbdceb3e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.181182 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8f8ce-d2cf-4b5c-88a0-3538dbdceb3e None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.182293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 245/496] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:29.186950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8f8ce-d2cf-4b5c-88a0-3538dbdceb3e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:29.199548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:29.225444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8d24-ded7-4b89-b9f4-b5735bb48f95 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:29.263587 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438ee86-1de3-40a0-82dd-d627c36bc756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:29.264259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438ee86-1de3-40a0-82dd-d627c36bc756 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.264557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438ee86-1de3-40a0-82dd-d627c36bc756 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.265421 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438ee86-1de3-40a0-82dd-d627c36bc756 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.265583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438ee86-1de3-40a0-82dd-d627c36bc756 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:29.265937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438ee86-1de3-40a0-82dd-d627c36bc756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:29.267321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438ee86-1de3-40a0-82dd-d627c36bc756 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:29.280481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 252/497] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:29.280481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438ee86-1de3-40a0-82dd-d627c36bc756 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:29.302964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8f8ce-d2cf-4b5c-88a0-3538dbdceb3e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:29.340022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95048379-7464-4899-b07c-0308a8af80b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:29.340685 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95048379-7464-4899-b07c-0308a8af80b6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.340971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95048379-7464-4899-b07c-0308a8af80b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.341249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95048379-7464-4899-b07c-0308a8af80b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.341981 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95048379-7464-4899-b07c-0308a8af80b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:29.342298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95048379-7464-4899-b07c-0308a8af80b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:29.343759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95048379-7464-4899-b07c-0308a8af80b6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:29.358582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 246/498] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:29.360968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425d563-0045-4678-9b5c-ac813485cabc None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.361467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425d563-0045-4678-9b5c-ac813485cabc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.361962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425d563-0045-4678-9b5c-ac813485cabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.378389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7425d563-0045-4678-9b5c-ac813485cabc None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:29.379900 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7425d563-0045-4678-9b5c-ac813485cabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:29.383213 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:29.395188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438ee86-1de3-40a0-82dd-d627c36bc756 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:29.431342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990b8b2-cc8a-42bc-9a95-edbe3912b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:29.432025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990b8b2-cc8a-42bc-9a95-edbe3912b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.432312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990b8b2-cc8a-42bc-9a95-edbe3912b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.432590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990b8b2-cc8a-42bc-9a95-edbe3912b8c4 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.433429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990b8b2-cc8a-42bc-9a95-edbe3912b8c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:29.433736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990b8b2-cc8a-42bc-9a95-edbe3912b8c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:29.435189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990b8b2-cc8a-42bc-9a95-edbe3912b8c4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:29.445809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:29.456964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 247/499] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:29.458120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425d563-0045-4678-9b5c-ac813485cabc None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:29.476227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 253/500] 10.222.0.49 () {56 vars in 1137 bytes} [Mon May 23 16:55:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:29.477032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990b8b2-cc8a-42bc-9a95-edbe3912b8c4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:29.572319 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425d563-0045-4678-9b5c-ac813485cabc None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:29.591284 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990b8b2-cc8a-42bc-9a95-edbe3912b8c4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:29.608891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe8f9a-52aa-4b8d-abbc-50cbf8e7b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:29.609701 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe8f9a-52aa-4b8d-abbc-50cbf8e7b485 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.609984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe8f9a-52aa-4b8d-abbc-50cbf8e7b485 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.610265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe8f9a-52aa-4b8d-abbc-50cbf8e7b485 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.621220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe8f9a-52aa-4b8d-abbc-50cbf8e7b485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:29.622708 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe8f9a-52aa-4b8d-abbc-50cbf8e7b485 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:29.626957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e7709-2514-47de-9fca-abee2a2e63d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:29.627744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e7709-2514-47de-9fca-abee2a2e63d0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.628041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e7709-2514-47de-9fca-abee2a2e63d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.628370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e7709-2514-47de-9fca-abee2a2e63d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.636045 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e7709-2514-47de-9fca-abee2a2e63d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:29.637483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e7709-2514-47de-9fca-abee2a2e63d0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-46fe8f9a-52aa-4b8d-abbc-50cbf8e7b485 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:29.641359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:29.642343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:29.648247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:29.648247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:29.648247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:29.648247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:29.648247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 248/501] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:29.648247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe8f9a-52aa-4b8d-abbc-50cbf8e7b485 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-515e7709-2514-47de-9fca-abee2a2e63d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:29.658500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:29.659388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:29.660261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:29.660261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:29.660261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:29.660261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:29.660261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:29.660261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:29.660261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:29.660261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:29.660261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:55:29.660261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:29.660261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 254/502] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 23 16:55:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:29.661765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e7709-2514-47de-9fca-abee2a2e63d0 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:29.672735 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:29.705087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:29.755351 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe8f9a-52aa-4b8d-abbc-50cbf8e7b485 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:29.761696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e7709-2514-47de-9fca-abee2a2e63d0 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:29.793795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9896f5-4f21-446c-996d-40b8bd42ad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:29.794621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9896f5-4f21-446c-996d-40b8bd42ad6b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.794910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9896f5-4f21-446c-996d-40b8bd42ad6b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.795187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9896f5-4f21-446c-996d-40b8bd42ad6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.796614 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262c743-e1df-4e1e-b9b7-9ac479d5f249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:29.797797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262c743-e1df-4e1e-b9b7-9ac479d5f249 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.798072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262c743-e1df-4e1e-b9b7-9ac479d5f249 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.798341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262c743-e1df-4e1e-b9b7-9ac479d5f249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.806208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9896f5-4f21-446c-996d-40b8bd42ad6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-cb9896f5-4f21-446c-996d-40b8bd42ad6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:29.814219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:29.815193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:29.815982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 249/503] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:29.816631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9896f5-4f21-446c-996d-40b8bd42ad6b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:29.870345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262c743-e1df-4e1e-b9b7-9ac479d5f249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:29.871765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262c743-e1df-4e1e-b9b7-9ac479d5f249 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:29.882493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:29.916473 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9896f5-4f21-446c-996d-40b8bd42ad6b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:29.926522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:29.950608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67919b3d-4f1f-423a-9299-f8c35c2e65a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:29.951273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67919b3d-4f1f-423a-9299-f8c35c2e65a4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.951554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67919b3d-4f1f-423a-9299-f8c35c2e65a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.951822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67919b3d-4f1f-423a-9299-f8c35c2e65a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.952533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67919b3d-4f1f-423a-9299-f8c35c2e65a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:29.952840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67919b3d-4f1f-423a-9299-f8c35c2e65a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:29.954316 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67919b3d-4f1f-423a-9299-f8c35c2e65a4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:29.965856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 250/504] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:29.966659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67919b3d-4f1f-423a-9299-f8c35c2e65a4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:29.976362 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 255/505] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:29.978159 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d57ed2-b3f3-4ca3-bb4a-38b858107c08 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:29.978482 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d57ed2-b3f3-4ca3-bb4a-38b858107c08 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:29.978766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d57ed2-b3f3-4ca3-bb4a-38b858107c08 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:29.980030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 256/506] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:29.980900 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d57ed2-b3f3-4ca3-bb4a-38b858107c08 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:30.069326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67919b3d-4f1f-423a-9299-f8c35c2e65a4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:30.082113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d57ed2-b3f3-4ca3-bb4a-38b858107c08 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:30.091371 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:30.103680 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719bd57-28f3-46af-bd91-77bc07178d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:30.104399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719bd57-28f3-46af-bd91-77bc07178d79 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:30.104695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719bd57-28f3-46af-bd91-77bc07178d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:30.104981 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719bd57-28f3-46af-bd91-77bc07178d79 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:30.105852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719bd57-28f3-46af-bd91-77bc07178d79 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:30.106164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719bd57-28f3-46af-bd91-77bc07178d79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:30.107637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719bd57-28f3-46af-bd91-77bc07178d79 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:30.118224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbbdff-9791-456c-8f87-5257e9d976ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:30.118920 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbbdff-9791-456c-8f87-5257e9d976ae None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:30.119207 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbbdff-9791-456c-8f87-5257e9d976ae None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:30.119486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbbdff-9791-456c-8f87-5257e9d976ae None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:30.120728 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbbdff-9791-456c-8f87-5257e9d976ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:30.121228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbbdff-9791-456c-8f87-5257e9d976ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:30.122623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbbdff-9791-456c-8f87-5257e9d976ae None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:30.131299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 257/507] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:30.132084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbbdff-9791-456c-8f87-5257e9d976ae None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:30.148143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 251/508] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 23 16:55:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:30.148984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719bd57-28f3-46af-bd91-77bc07178d79 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:30.176822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:30.237927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbbdff-9791-456c-8f87-5257e9d976ae None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:30.249687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719bd57-28f3-46af-bd91-77bc07178d79 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:30.271606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa4b73-fa9a-4d08-af21-1c8a96d3f30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:30.272405 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa4b73-fa9a-4d08-af21-1c8a96d3f30f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:30.272688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa4b73-fa9a-4d08-af21-1c8a96d3f30f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:30.272961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa4b73-fa9a-4d08-af21-1c8a96d3f30f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:30.280603 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa4b73-fa9a-4d08-af21-1c8a96d3f30f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:30.283024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa4b73-fa9a-4d08-af21-1c8a96d3f30f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:30.284112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def4605-2165-4515-8497-acbecffbab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:30.284903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def4605-2165-4515-8497-acbecffbab52 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:30.285193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def4605-2165-4515-8497-acbecffbab52 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:30.285472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def4605-2165-4515-8497-acbecffbab52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:30.295788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def4605-2165-4515-8497-acbecffbab52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-65aa4b73-fa9a-4d08-af21-1c8a96d3f30f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:30.297208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:30.298264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:30.299241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:30.299241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:30.299241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:30.299241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:30.299241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:30.299241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:30.299241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:30.299241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:30.299241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 16:55:30.299241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:30.300231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def4605-2165-4515-8497-acbecffbab52 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:30.300313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 258/509] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:30.300313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422325d-af28-42cc-9e9d-0246045bc8fa None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:30.300313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422325d-af28-42cc-9e9d-0246045bc8fa None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:30.300313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422325d-af28-42cc-9e9d-0246045bc8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:30.317175 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9422325d-af28-42cc-9e9d-0246045bc8fa None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:30.318387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9422325d-af28-42cc-9e9d-0246045bc8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-2def4605-2165-4515-8497-acbecffbab52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:30.318529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:30.319484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:30.320350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:30.320350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:30.320350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:30.320350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:30.320350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 252/510] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:30.321042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def4605-2165-4515-8497-acbecffbab52 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:30.346502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:30.388502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 259/511] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:30.389261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422325d-af28-42cc-9e9d-0246045bc8fa None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:30.417967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:30.438530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def4605-2165-4515-8497-acbecffbab52 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:30.472386 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5e088-a9f5-4106-a96f-9926f8fa749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:30.473172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5e088-a9f5-4106-a96f-9926f8fa749e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:30.473460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5e088-a9f5-4106-a96f-9926f8fa749e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:30.473736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5e088-a9f5-4106-a96f-9926f8fa749e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:30.484188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5e088-a9f5-4106-a96f-9926f8fa749e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:30.485806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5e088-a9f5-4106-a96f-9926f8fa749e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:30.488448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422325d-af28-42cc-9e9d-0246045bc8fa None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6bb5e088-a9f5-4106-a96f-9926f8fa749e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:30.503671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:30.504533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:30.505380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:30.505380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:30.505380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:30.505380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:30.505380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 253/512] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:30.505690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5e088-a9f5-4106-a96f-9926f8fa749e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:30.527333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624498-5d71-47bc-ad29-e044063420ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:30.527985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624498-5d71-47bc-ad29-e044063420ee None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:30.528270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624498-5d71-47bc-ad29-e044063420ee None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:30.528546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624498-5d71-47bc-ad29-e044063420ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:30.556301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:30.597120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8624498-5d71-47bc-ad29-e044063420ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:30.598601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8624498-5d71-47bc-ad29-e044063420ee None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:30.604945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5e088-a9f5-4106-a96f-9926f8fa749e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:30.633761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:30.639501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56267ba-b43f-447b-bef1-3dcc056e059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:30.640111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56267ba-b43f-447b-bef1-3dcc056e059f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:30.640399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56267ba-b43f-447b-bef1-3dcc056e059f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:30.640822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56267ba-b43f-447b-bef1-3dcc056e059f None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:30.641638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56267ba-b43f-447b-bef1-3dcc056e059f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:30.641950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56267ba-b43f-447b-bef1-3dcc056e059f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:30.643414 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56267ba-b43f-447b-bef1-3dcc056e059f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:30.660804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 254/513] 10.222.0.49 () {56 vars in 1139 bytes} [Mon May 23 16:55:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:30.661594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56267ba-b43f-447b-bef1-3dcc056e059f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:30.701396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 260/514] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:30.702470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624498-5d71-47bc-ad29-e044063420ee None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:30.759625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56267ba-b43f-447b-bef1-3dcc056e059f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:30.759939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:30.793724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0663c9c-dd7c-48b8-9b78-7cb4503e090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:30.794413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0663c9c-dd7c-48b8-9b78-7cb4503e090f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:30.794700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0663c9c-dd7c-48b8-9b78-7cb4503e090f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:30.794979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0663c9c-dd7c-48b8-9b78-7cb4503e090f None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:30.795699 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0663c9c-dd7c-48b8-9b78-7cb4503e090f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:30.796004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0663c9c-dd7c-48b8-9b78-7cb4503e090f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:30.798346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0663c9c-dd7c-48b8-9b78-7cb4503e090f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:30.804709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624498-5d71-47bc-ad29-e044063420ee None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:30.809557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 255/515] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:30.810518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0663c9c-dd7c-48b8-9b78-7cb4503e090f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:30.841514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc437-f811-41f0-9de3-b75be1928b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:30.842302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc437-f811-41f0-9de3-b75be1928b7d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:30.842619 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc437-f811-41f0-9de3-b75be1928b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:30.842904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc437-f811-41f0-9de3-b75be1928b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:30.852784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decc437-f811-41f0-9de3-b75be1928b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:30.854229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decc437-f811-41f0-9de3-b75be1928b7d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:30.861918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-1decc437-f811-41f0-9de3-b75be1928b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:30.872636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:30.873579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:30.874745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:30.874745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:30.874745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:30.874745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:30.874745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 261/516] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:30.874745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc437-f811-41f0-9de3-b75be1928b7d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:30.914978 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0663c9c-dd7c-48b8-9b78-7cb4503e090f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:30.948099 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e9170-c5af-41a1-a28b-24018e0fde94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:30.948758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e9170-c5af-41a1-a28b-24018e0fde94 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:30.949043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e9170-c5af-41a1-a28b-24018e0fde94 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:30.949568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e9170-c5af-41a1-a28b-24018e0fde94 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:30.950287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e9170-c5af-41a1-a28b-24018e0fde94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:30.950624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e9170-c5af-41a1-a28b-24018e0fde94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:30.952005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e9170-c5af-41a1-a28b-24018e0fde94 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:30.963520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 256/517] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:30.964302 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e9170-c5af-41a1-a28b-24018e0fde94 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:30.980165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc437-f811-41f0-9de3-b75be1928b7d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:30.994423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:31.019301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d32dac-a51f-41a9-80f3-12c52c6f5c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.019953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d32dac-a51f-41a9-80f3-12c52c6f5c7b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.020243 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d32dac-a51f-41a9-80f3-12c52c6f5c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.020532 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d32dac-a51f-41a9-80f3-12c52c6f5c7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.067511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e9170-c5af-41a1-a28b-24018e0fde94 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:31.078919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:31.090082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d32dac-a51f-41a9-80f3-12c52c6f5c7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.091710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d32dac-a51f-41a9-80f3-12c52c6f5c7b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.103764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48504b5b-c482-4827-b50b-a3de0ddfaf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.104630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48504b5b-c482-4827-b50b-a3de0ddfaf25 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.104920 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48504b5b-c482-4827-b50b-a3de0ddfaf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.105196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48504b5b-c482-4827-b50b-a3de0ddfaf25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.115834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48504b5b-c482-4827-b50b-a3de0ddfaf25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.117291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48504b5b-c482-4827-b50b-a3de0ddfaf25 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-48504b5b-c482-4827-b50b-a3de0ddfaf25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:31.135442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:31.136326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:31.137159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:31.137159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:31.137159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:31.137159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:31.137159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 257/518] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:31.137414 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48504b5b-c482-4827-b50b-a3de0ddfaf25 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:31.195322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 262/519] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:31.196079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d32dac-a51f-41a9-80f3-12c52c6f5c7b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:31.211155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:31.239075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48504b5b-c482-4827-b50b-a3de0ddfaf25 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:31.273477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063ffaf-ad8b-44ee-8b30-07db3204c488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.274254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063ffaf-ad8b-44ee-8b30-07db3204c488 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.274562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063ffaf-ad8b-44ee-8b30-07db3204c488 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.274838 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063ffaf-ad8b-44ee-8b30-07db3204c488 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.282008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063ffaf-ad8b-44ee-8b30-07db3204c488 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.283739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063ffaf-ad8b-44ee-8b30-07db3204c488 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.295406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d32dac-a51f-41a9-80f3-12c52c6f5c7b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-3063ffaf-ad8b-44ee-8b30-07db3204c488 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:31.298613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:31.299594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:31.300511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:31.300511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:31.300511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:31.300511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:31.300511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:31.300511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:31.300511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:31.300511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:31.300511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 258/520] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:31.300971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063ffaf-ad8b-44ee-8b30-07db3204c488 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:31.325969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:31.332358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9d18e-d37a-4a00-9f3e-78beca8f54f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.333018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9d18e-d37a-4a00-9f3e-78beca8f54f3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.333298 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9d18e-d37a-4a00-9f3e-78beca8f54f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.333570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9d18e-d37a-4a00-9f3e-78beca8f54f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.334281 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9d18e-d37a-4a00-9f3e-78beca8f54f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:31.334612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9d18e-d37a-4a00-9f3e-78beca8f54f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.335970 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9d18e-d37a-4a00-9f3e-78beca8f54f3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.347745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 263/521] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:31.348579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9d18e-d37a-4a00-9f3e-78beca8f54f3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:31.402744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063ffaf-ad8b-44ee-8b30-07db3204c488 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:31.415780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:31.437295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d12b0b-1f9e-44d6-bbf8-fc5a184052c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.438268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d12b0b-1f9e-44d6-bbf8-fc5a184052c2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.438580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d12b0b-1f9e-44d6-bbf8-fc5a184052c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.438861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d12b0b-1f9e-44d6-bbf8-fc5a184052c2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.444431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9d18e-d37a-4a00-9f3e-78beca8f54f3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:31.446194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d12b0b-1f9e-44d6-bbf8-fc5a184052c2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.447620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d12b0b-1f9e-44d6-bbf8-fc5a184052c2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-88d12b0b-1f9e-44d6-bbf8-fc5a184052c2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:31.461703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:31.462789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:31.463673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:31.463673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:31.463673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:31.463673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:31.463673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:31.463673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:31.463673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:31.463673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:31.463673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:55:31.463673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:31.463673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 259/522] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:31.463673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d12b0b-1f9e-44d6-bbf8-fc5a184052c2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:31.482917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c63788-fe6a-47c1-b356-3f86ec5cda4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.483576 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c63788-fe6a-47c1-b356-3f86ec5cda4f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.483858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c63788-fe6a-47c1-b356-3f86ec5cda4f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.484133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c63788-fe6a-47c1-b356-3f86ec5cda4f None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.485404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c63788-fe6a-47c1-b356-3f86ec5cda4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:31.485807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c63788-fe6a-47c1-b356-3f86ec5cda4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.487167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c63788-fe6a-47c1-b356-3f86ec5cda4f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.499002 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 264/523] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:31.504313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c63788-fe6a-47c1-b356-3f86ec5cda4f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:31.552808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:31.571373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d12b0b-1f9e-44d6-bbf8-fc5a184052c2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:31.596528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c63788-fe6a-47c1-b356-3f86ec5cda4f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:31.604983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180972e-2d2d-48c3-a879-00ebf35322e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.605768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180972e-2d2d-48c3-a879-00ebf35322e1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.606052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180972e-2d2d-48c3-a879-00ebf35322e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.606329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180972e-2d2d-48c3-a879-00ebf35322e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.617243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180972e-2d2d-48c3-a879-00ebf35322e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.618818 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180972e-2d2d-48c3-a879-00ebf35322e1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.625778 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:31.631413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b7f42-c1fe-44ce-a09d-d7fd9951f610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.632068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b7f42-c1fe-44ce-a09d-d7fd9951f610 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.632355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b7f42-c1fe-44ce-a09d-d7fd9951f610 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.632635 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b7f42-c1fe-44ce-a09d-d7fd9951f610 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.633418 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b7f42-c1fe-44ce-a09d-d7fd9951f610 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:31.633731 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b7f42-c1fe-44ce-a09d-d7fd9951f610 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.635160 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b7f42-c1fe-44ce-a09d-d7fd9951f610 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-8180972e-2d2d-48c3-a879-00ebf35322e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:31.636475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:31.637453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:31.643188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:31.643188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:31.643188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:31.643188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:31.643188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 260/524] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:31.643188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180972e-2d2d-48c3-a879-00ebf35322e1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:31.658524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 265/525] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:31.659347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b7f42-c1fe-44ce-a09d-d7fd9951f610 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:31.740174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180972e-2d2d-48c3-a879-00ebf35322e1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:31.757125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b7f42-c1fe-44ce-a09d-d7fd9951f610 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:31.775223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc20d0-b2bc-4d01-a51c-6562a586ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.775894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc20d0-b2bc-4d01-a51c-6562a586ee02 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.776182 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc20d0-b2bc-4d01-a51c-6562a586ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.776463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc20d0-b2bc-4d01-a51c-6562a586ee02 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.777170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc20d0-b2bc-4d01-a51c-6562a586ee02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.778653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc20d0-b2bc-4d01-a51c-6562a586ee02 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.785433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:31.792930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1be31d-59b3-4624-8fec-5de579d9be11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.793830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1be31d-59b3-4624-8fec-5de579d9be11 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.794118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1be31d-59b3-4624-8fec-5de579d9be11 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.794431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1be31d-59b3-4624-8fec-5de579d9be11 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.795324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1be31d-59b3-4624-8fec-5de579d9be11 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:31.796167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1be31d-59b3-4624-8fec-5de579d9be11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.798440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1be31d-59b3-4624-8fec-5de579d9be11 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.800585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 261/526] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:55:31 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:31.801271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc20d0-b2bc-4d01-a51c-6562a586ee02 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:31.826567 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 266/527] 10.222.0.49 () {56 vars in 1137 bytes} [Mon May 23 16:55:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:31.827950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1be31d-59b3-4624-8fec-5de579d9be11 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:31.884972 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:31.921700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc20d0-b2bc-4d01-a51c-6562a586ee02 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:31.943929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1be31d-59b3-4624-8fec-5de579d9be11 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:31.961337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5be62-d5cf-470c-bbd1-4256f8a42f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.962155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5be62-d5cf-470c-bbd1-4256f8a42f91 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.962474 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5be62-d5cf-470c-bbd1-4256f8a42f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.962756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5be62-d5cf-470c-bbd1-4256f8a42f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.970494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5be62-d5cf-470c-bbd1-4256f8a42f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.971988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5be62-d5cf-470c-bbd1-4256f8a42f91 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.983031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e3e88-3253-4440-b8ef-e224658879b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.983707 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e3e88-3253-4440-b8ef-e224658879b8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.983992 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e3e88-3253-4440-b8ef-e224658879b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.984314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e3e88-3253-4440-b8ef-e224658879b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.985082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e3e88-3253-4440-b8ef-e224658879b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:31.985390 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e3e88-3253-4440-b8ef-e224658879b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.986803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e3e88-3253-4440-b8ef-e224658879b8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-8be5be62-d5cf-470c-bbd1-4256f8a42f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:31.987132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:31.987937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:31.988775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:31.988775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:31.988775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:31.988775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:31.988775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:31.988775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:31.988775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:31.988775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:31.988775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 262/528] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:31.989237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5be62-d5cf-470c-bbd1-4256f8a42f91 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:32.003520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 267/529] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:32.003520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e3e88-3253-4440-b8ef-e224658879b8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:32.076301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:32.113027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e3e88-3253-4440-b8ef-e224658879b8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:32.117855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5be62-d5cf-470c-bbd1-4256f8a42f91 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:32.124569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:32.153652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf23176-ac91-4168-8358-b2a4e352ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:32.153858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b3471-39ef-4981-8004-2851a5cfbd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:32.154306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23176-ac91-4168-8358-b2a4e352ad44 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:32.154502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b3471-39ef-4981-8004-2851a5cfbd46 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:32.154656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23176-ac91-4168-8358-b2a4e352ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:32.154767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b3471-39ef-4981-8004-2851a5cfbd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:32.154916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23176-ac91-4168-8358-b2a4e352ad44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:32.155075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b3471-39ef-4981-8004-2851a5cfbd46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:32.155730 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf23176-ac91-4168-8358-b2a4e352ad44 None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=a6a5b9c982724df0b88ce6ad46dc37e6) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:32.156191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf23176-ac91-4168-8358-b2a4e352ad44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:32.158029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf23176-ac91-4168-8358-b2a4e352ad44 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:32.169991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 263/530] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:31 2022] GET /identity/v3/role_assignments?user.id=a6a5b9c982724df0b88ce6ad46dc37e6&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:32.169991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf23176-ac91-4168-8358-b2a4e352ad44 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:32.234120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b3471-39ef-4981-8004-2851a5cfbd46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:32.236280 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b3471-39ef-4981-8004-2851a5cfbd46 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:32.282455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf23176-ac91-4168-8358-b2a4e352ad44 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:32.298529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:32.322150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1438114-44ad-4071-9db3-5d138b772286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:32.323111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1438114-44ad-4071-9db3-5d138b772286 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:32.323549 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1438114-44ad-4071-9db3-5d138b772286 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:32.324010 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1438114-44ad-4071-9db3-5d138b772286 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:32.325281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1438114-44ad-4071-9db3-5d138b772286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:32.325809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1438114-44ad-4071-9db3-5d138b772286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:32.327543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1438114-44ad-4071-9db3-5d138b772286 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:32.352406 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 264/531] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:32.353759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1438114-44ad-4071-9db3-5d138b772286 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:32.353962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 268/532] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:32.360092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b3471-39ef-4981-8004-2851a5cfbd46 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:32.372639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:32.477753 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1438114-44ad-4071-9db3-5d138b772286 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:32.506108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b3471-39ef-4981-8004-2851a5cfbd46 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:32.519091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73444a-f090-4018-940f-4314b49c9724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:32.520487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73444a-f090-4018-940f-4314b49c9724 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:32.520888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73444a-f090-4018-940f-4314b49c9724 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:32.521172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73444a-f090-4018-940f-4314b49c9724 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:32.530586 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73444a-f090-4018-940f-4314b49c9724 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:32.532947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73444a-f090-4018-940f-4314b49c9724 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:32.544580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004505b-5f0b-4368-a673-6ddf9343c561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:32.545365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004505b-5f0b-4368-a673-6ddf9343c561 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:32.545743 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004505b-5f0b-4368-a673-6ddf9343c561 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:32.546161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004505b-5f0b-4368-a673-6ddf9343c561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:32.547981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004505b-5f0b-4368-a673-6ddf9343c561 None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=9884780c88aa48ffa92a696740761387) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:32.548435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004505b-5f0b-4368-a673-6ddf9343c561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:32.549985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004505b-5f0b-4368-a673-6ddf9343c561 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6a73444a-f090-4018-940f-4314b49c9724 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:32.550608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:32.551606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:32.552624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:32.552624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:32.552624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:32.552624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:32.552624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:32.552624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:32.552624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:32.552624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:32.552624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 265/533] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:32.552624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73444a-f090-4018-940f-4314b49c9724 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:32.563138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 269/534] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:32 2022] GET /identity/v3/role_assignments?user.id=9884780c88aa48ffa92a696740761387&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:32.564285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004505b-5f0b-4368-a673-6ddf9343c561 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:32.600221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:32.650467 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:32.692783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73444a-f090-4018-940f-4314b49c9724 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:32.723716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004505b-5f0b-4368-a673-6ddf9343c561 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:32.757619 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa68ea-8c24-429c-a435-617730801bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:32.759572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa68ea-8c24-429c-a435-617730801bef None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:32.761690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa68ea-8c24-429c-a435-617730801bef None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:32.762136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa68ea-8c24-429c-a435-617730801bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:32.791760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa68ea-8c24-429c-a435-617730801bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:32.794195 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279f28f-aa96-494f-a188-6399c0234638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:32.795110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279f28f-aa96-494f-a188-6399c0234638 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:32.795578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279f28f-aa96-494f-a188-6399c0234638 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:32.796056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279f28f-aa96-494f-a188-6399c0234638 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:32.797109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279f28f-aa96-494f-a188-6399c0234638 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:32.797604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279f28f-aa96-494f-a188-6399c0234638 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:32.799273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279f28f-aa96-494f-a188-6399c0234638 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:32.799382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa68ea-8c24-429c-a435-617730801bef None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:32.814044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 270/535] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-99aa68ea-8c24-429c-a435-617730801bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:32.827719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:32.828870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:32.829943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:32.829943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:32.829943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:32.829943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:32.829943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 266/536] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:32.831199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279f28f-aa96-494f-a188-6399c0234638 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:32.836512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa68ea-8c24-429c-a435-617730801bef None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:32.960433 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279f28f-aa96-494f-a188-6399c0234638 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:32.978725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:33.001691 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee08da3-3b57-4011-8d6c-99f6e9977940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:33.002982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08da3-3b57-4011-8d6c-99f6e9977940 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:33.003671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08da3-3b57-4011-8d6c-99f6e9977940 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:33.004119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08da3-3b57-4011-8d6c-99f6e9977940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:33.005272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee08da3-3b57-4011-8d6c-99f6e9977940 None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=73bdfedb6d9e4ddab18a8143ba7142fc) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:33.005730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee08da3-3b57-4011-8d6c-99f6e9977940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:33.007357 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee08da3-3b57-4011-8d6c-99f6e9977940 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:33.009465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:33.015059 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 271/537] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:32 2022] GET /identity/v3/role_assignments?user.id=73bdfedb6d9e4ddab18a8143ba7142fc&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:33.016822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa68ea-8c24-429c-a435-617730801bef None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:33.066307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d05851-d6e0-4a6a-8392-44f2ea19b57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:33.067335 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d05851-d6e0-4a6a-8392-44f2ea19b57e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:33.067822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d05851-d6e0-4a6a-8392-44f2ea19b57e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:33.068278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d05851-d6e0-4a6a-8392-44f2ea19b57e None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:33.069195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d05851-d6e0-4a6a-8392-44f2ea19b57e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:33.069678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d05851-d6e0-4a6a-8392-44f2ea19b57e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:33.071287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d05851-d6e0-4a6a-8392-44f2ea19b57e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:33.085326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 267/538] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:33.090530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee08da3-3b57-4011-8d6c-99f6e9977940 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:33.239989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee08da3-3b57-4011-8d6c-99f6e9977940 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:33.284269 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a40a4b-2531-434a-afa1-2a1368317fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:33.285067 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a40a4b-2531-434a-afa1-2a1368317fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:33.285349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a40a4b-2531-434a-afa1-2a1368317fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:33.285625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a40a4b-2531-434a-afa1-2a1368317fa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:33.292558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a40a4b-2531-434a-afa1-2a1368317fa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:33.293974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a40a4b-2531-434a-afa1-2a1368317fa1 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-10a40a4b-2531-434a-afa1-2a1368317fa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:33.309398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:33.310301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:33.311187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:33.311187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:33.311187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:33.311187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:33.311187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:33.311187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:33.311187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:33.311187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:33.314908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 272/539] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:33.317189 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d05851-d6e0-4a6a-8392-44f2ea19b57e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:33.449656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d05851-d6e0-4a6a-8392-44f2ea19b57e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:33.497071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f4f95-3acd-4cf4-bd15-921af16f414a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:33.497858 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f4f95-3acd-4cf4-bd15-921af16f414a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:33.498137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f4f95-3acd-4cf4-bd15-921af16f414a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:33.498478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f4f95-3acd-4cf4-bd15-921af16f414a None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:33.499424 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f4f95-3acd-4cf4-bd15-921af16f414a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:33.500354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f4f95-3acd-4cf4-bd15-921af16f414a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:33.501967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f4f95-3acd-4cf4-bd15-921af16f414a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:33.517537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 268/540] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:33.522990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a40a4b-2531-434a-afa1-2a1368317fa1 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:33.611428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:33.655577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a40a4b-2531-434a-afa1-2a1368317fa1 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:33.695648 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f75e-1770-4050-95c1-166b36628486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:33.696314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f75e-1770-4050-95c1-166b36628486 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:33.696598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f75e-1770-4050-95c1-166b36628486 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:33.696875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f75e-1770-4050-95c1-166b36628486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:33.697770 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14f75e-1770-4050-95c1-166b36628486 None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=c91dcf97796941718e251912271aea71) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:33.698094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14f75e-1770-4050-95c1-166b36628486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:33.699794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14f75e-1770-4050-95c1-166b36628486 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:33.710421 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 273/541] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:33 2022] GET /identity/v3/role_assignments?user.id=c91dcf97796941718e251912271aea71&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:34.301902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd54a9-c095-45c2-b2c1-23e9d0c71b8d None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:34.302457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd54a9-c095-45c2-b2c1-23e9d0c71b8d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:34.302541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd54a9-c095-45c2-b2c1-23e9d0c71b8d None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:34.304128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 269/542] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:34.309733 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d5569-6912-427c-935e-1250c6359afd None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:34.310149 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d5569-6912-427c-935e-1250c6359afd None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:34.310320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d5569-6912-427c-935e-1250c6359afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:34.335402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d19d5569-6912-427c-935e-1250c6359afd None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:34.336685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d19d5569-6912-427c-935e-1250c6359afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:34.434469 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 274/543] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:34.451702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd54a9-c095-45c2-b2c1-23e9d0c71b8d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:34.461457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:34.568596 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd54a9-c095-45c2-b2c1-23e9d0c71b8d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:34.620942 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4a2ce-bae1-4f5a-9a9b-a6e7ba0ace6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:34.621750 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4a2ce-bae1-4f5a-9a9b-a6e7ba0ace6d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:34.622043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4a2ce-bae1-4f5a-9a9b-a6e7ba0ace6d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:34.622319 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4a2ce-bae1-4f5a-9a9b-a6e7ba0ace6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:34.637929 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4a2ce-bae1-4f5a-9a9b-a6e7ba0ace6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-e1b4a2ce-bae1-4f5a-9a9b-a6e7ba0ace6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:34.646389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:34.647325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:34.648174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:34.648174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:34.648174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:34.648174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:34.648174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:34.648174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:34.648174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:34.648174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:34.648174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:34.648174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:34.648174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:34.648174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:34.652385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 270/544] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:34.659666 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d5569-6912-427c-935e-1250c6359afd None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:34.737339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:34.813358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d5569-6912-427c-935e-1250c6359afd None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:34.855001 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861ad3a-eaed-497f-bbae-460fbe9d3d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:34.855676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861ad3a-eaed-497f-bbae-460fbe9d3d3d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:34.855960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861ad3a-eaed-497f-bbae-460fbe9d3d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:34.856235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861ad3a-eaed-497f-bbae-460fbe9d3d3d None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:34.856988 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861ad3a-eaed-497f-bbae-460fbe9d3d3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:34.857299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861ad3a-eaed-497f-bbae-460fbe9d3d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:34.858681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861ad3a-eaed-497f-bbae-460fbe9d3d3d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:34.874151 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 275/545] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:34.881723 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4a2ce-bae1-4f5a-9a9b-a6e7ba0ace6d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:34.978755 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53467d-c12a-44f3-9308-cf50eed3677f None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:34.979041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53467d-c12a-44f3-9308-cf50eed3677f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:34.979328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53467d-c12a-44f3-9308-cf50eed3677f None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:34.980926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 276/546] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:55:34.987403 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41efe2e-b339-4309-bf5b-f807245328a7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:34.988594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41efe2e-b339-4309-bf5b-f807245328a7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:34.989060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41efe2e-b339-4309-bf5b-f807245328a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:35.007722 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:35.022024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d41efe2e-b339-4309-bf5b-f807245328a7 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:35.025037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d41efe2e-b339-4309-bf5b-f807245328a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:35.064571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4a2ce-bae1-4f5a-9a9b-a6e7ba0ace6d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:35.110512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd03ab7-8a99-4883-9f23-caac84e5b8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:35.111191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd03ab7-8a99-4883-9f23-caac84e5b8cb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:35.111474 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd03ab7-8a99-4883-9f23-caac84e5b8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:35.111747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd03ab7-8a99-4883-9f23-caac84e5b8cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:35.131643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd03ab7-8a99-4883-9f23-caac84e5b8cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:35.133117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd03ab7-8a99-4883-9f23-caac84e5b8cb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:35.160250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 277/547] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-5bd03ab7-8a99-4883-9f23-caac84e5b8cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:35.161377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:35.162294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:35.163173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:35.163173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:35.163173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:35.163173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:35.163173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 271/548] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:35.168222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41efe2e-b339-4309-bf5b-f807245328a7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:35.201437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd03ab7-8a99-4883-9f23-caac84e5b8cb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:35.268751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:35.376308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41efe2e-b339-4309-bf5b-f807245328a7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:35.400653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd03ab7-8a99-4883-9f23-caac84e5b8cb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:35.428096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:35.446888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc11fbd-098a-4873-8034-a64b3fb64620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:35.447942 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc11fbd-098a-4873-8034-a64b3fb64620 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:35.448227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc11fbd-098a-4873-8034-a64b3fb64620 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:35.448506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc11fbd-098a-4873-8034-a64b3fb64620 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:35.456673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3e9d3-eaee-4d66-a9b9-a67cb46eb5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:35.457281 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3e9d3-eaee-4d66-a9b9-a67cb46eb5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:35.457564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3e9d3-eaee-4d66-a9b9-a67cb46eb5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:35.457839 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3e9d3-eaee-4d66-a9b9-a67cb46eb5e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:35.458604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3e9d3-eaee-4d66-a9b9-a67cb46eb5e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:35.458909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3e9d3-eaee-4d66-a9b9-a67cb46eb5e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:35.460278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3e9d3-eaee-4d66-a9b9-a67cb46eb5e9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:35.467404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc11fbd-098a-4873-8034-a64b3fb64620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-3fc11fbd-098a-4873-8034-a64b3fb64620 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:35.475484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:35.476948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:35.477924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:35.477924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:35.477924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:35.477924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:35.477924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:35.477924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:35.477924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:35.477924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:35.477924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:35.477924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:35.477924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:35.477924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:35.491996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 272/549] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:35.495128 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 278/550] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:35.497024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc11fbd-098a-4873-8034-a64b3fb64620 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:35.503512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3e9d3-eaee-4d66-a9b9-a67cb46eb5e9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:35.643056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3e9d3-eaee-4d66-a9b9-a67cb46eb5e9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:35.645386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:35.680718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c7262-8049-495e-9458-0cb0594396fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:35.681933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c7262-8049-495e-9458-0cb0594396fb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:35.682219 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c7262-8049-495e-9458-0cb0594396fb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:35.682527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c7262-8049-495e-9458-0cb0594396fb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:35.692319 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c7262-8049-495e-9458-0cb0594396fb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:35.693744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c7262-8049-495e-9458-0cb0594396fb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:35.707385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc11fbd-098a-4873-8034-a64b3fb64620 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-9c6c7262-8049-495e-9458-0cb0594396fb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:35.712485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:35.713404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:35.714533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:35.714533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:35.714533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:35.714533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:35.714533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:35.714533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:35.714533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:35.714533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:35.714533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 16:55:35.714533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:35.714533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 279/551] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:55:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:35.715631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030c1b1-cf78-4571-b927-9ec3d6f4ba9e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:35.715631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030c1b1-cf78-4571-b927-9ec3d6f4ba9e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:35.715867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030c1b1-cf78-4571-b927-9ec3d6f4ba9e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:35.717065 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 280/552] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:35.722202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030c1b1-cf78-4571-b927-9ec3d6f4ba9e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:35.747350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f3898-5295-47b2-8516-d697140eb330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:35.748081 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f3898-5295-47b2-8516-d697140eb330 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:35.748369 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f3898-5295-47b2-8516-d697140eb330 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:35.748645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f3898-5295-47b2-8516-d697140eb330 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:35.749402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f3898-5295-47b2-8516-d697140eb330 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:35.750217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f3898-5295-47b2-8516-d697140eb330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:35.751834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f3898-5295-47b2-8516-d697140eb330 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:35.760822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 273/553] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:35.762141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97850df-8c76-4e99-836d-eb4f2b0479c0 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:35.762529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97850df-8c76-4e99-836d-eb4f2b0479c0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:35.762812 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97850df-8c76-4e99-836d-eb4f2b0479c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:35.779796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c97850df-8c76-4e99-836d-eb4f2b0479c0 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:35.781548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c97850df-8c76-4e99-836d-eb4f2b0479c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:35.819535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:35.847255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030c1b1-cf78-4571-b927-9ec3d6f4ba9e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:35.862388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 274/554] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:35.862388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97850df-8c76-4e99-836d-eb4f2b0479c0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:35.893912 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f50300-f251-48cd-b44b-00e953757434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:35.894545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f50300-f251-48cd-b44b-00e953757434 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:35.894827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f50300-f251-48cd-b44b-00e953757434 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:35.895090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f50300-f251-48cd-b44b-00e953757434 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:35.895931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f50300-f251-48cd-b44b-00e953757434 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:35.896317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f50300-f251-48cd-b44b-00e953757434 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:35.897728 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f50300-f251-48cd-b44b-00e953757434 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:35.919950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 281/555] 10.222.0.49 () {56 vars in 1135 bytes} [Mon May 23 16:55:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:35.919950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d81e5-a0b6-4f7b-be20-200c9b67958c None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:35.919950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d81e5-a0b6-4f7b-be20-200c9b67958c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:35.919950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d81e5-a0b6-4f7b-be20-200c9b67958c None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:35.919950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 282/556] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:35.919950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d81e5-a0b6-4f7b-be20-200c9b67958c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:35.953611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:35.980750 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97850df-8c76-4e99-836d-eb4f2b0479c0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:36.020163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb921c56-2311-41fb-bfef-c4012acfeabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:36.020955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb921c56-2311-41fb-bfef-c4012acfeabb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.021240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb921c56-2311-41fb-bfef-c4012acfeabb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.021517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb921c56-2311-41fb-bfef-c4012acfeabb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.032957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb921c56-2311-41fb-bfef-c4012acfeabb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:36.034602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb921c56-2311-41fb-bfef-c4012acfeabb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:36.036304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d81e5-a0b6-4f7b-be20-200c9b67958c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-fb921c56-2311-41fb-bfef-c4012acfeabb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:36.052824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:36.053718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:36.054608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:36.054608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:36.054608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:36.054608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:36.054608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 275/557] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:36.054890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb921c56-2311-41fb-bfef-c4012acfeabb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:36.078967 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b411c-7f08-4d00-8b7b-7136e7bc0ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:36.079747 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b411c-7f08-4d00-8b7b-7136e7bc0ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.080034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b411c-7f08-4d00-8b7b-7136e7bc0ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.080313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b411c-7f08-4d00-8b7b-7136e7bc0ea9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.081098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:36.091171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b411c-7f08-4d00-8b7b-7136e7bc0ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-148b411c-7f08-4d00-8b7b-7136e7bc0ea9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:36.099206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:36.100165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:36.101432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:36.101432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:36.101432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:36.101432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:36.101432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:36.101432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:36.101432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:36.101432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:36.101432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:36.101432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:36.101432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:36.101432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:36.105264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 283/558] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:36.106492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601e7ef-4a95-44b3-a0ae-2583aca85458 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.106790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601e7ef-4a95-44b3-a0ae-2583aca85458 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.107079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601e7ef-4a95-44b3-a0ae-2583aca85458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.126153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9601e7ef-4a95-44b3-a0ae-2583aca85458 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:36.127404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9601e7ef-4a95-44b3-a0ae-2583aca85458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:36.165698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb921c56-2311-41fb-bfef-c4012acfeabb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:36.200906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 284/559] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:36.201946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601e7ef-4a95-44b3-a0ae-2583aca85458 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:36.216487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f442f7-87f8-4aa4-b899-b343c1b93745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:36.217440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f442f7-87f8-4aa4-b899-b343c1b93745 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.217881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f442f7-87f8-4aa4-b899-b343c1b93745 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.218288 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f442f7-87f8-4aa4-b899-b343c1b93745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.235326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:36.293625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f442f7-87f8-4aa4-b899-b343c1b93745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:36.295146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f442f7-87f8-4aa4-b899-b343c1b93745 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:36.320580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:36.326977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601e7ef-4a95-44b3-a0ae-2583aca85458 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:36.364444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167bd87-2e62-476c-89e4-9ec3bfa74d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:36.365113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167bd87-2e62-476c-89e4-9ec3bfa74d83 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.365404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167bd87-2e62-476c-89e4-9ec3bfa74d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.365682 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167bd87-2e62-476c-89e4-9ec3bfa74d83 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.366430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167bd87-2e62-476c-89e4-9ec3bfa74d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:36.366744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167bd87-2e62-476c-89e4-9ec3bfa74d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:36.368101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167bd87-2e62-476c-89e4-9ec3bfa74d83 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:36.380080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 285/560] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:36.385188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167bd87-2e62-476c-89e4-9ec3bfa74d83 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:36.404873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 276/561] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:36.405710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f442f7-87f8-4aa4-b899-b343c1b93745 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:36.459238 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:36.490153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167bd87-2e62-476c-89e4-9ec3bfa74d83 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:36.512689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f442f7-87f8-4aa4-b899-b343c1b93745 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:36.527401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f306-272e-4482-927b-c962fad989e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:36.528073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f306-272e-4482-927b-c962fad989e2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.528355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f306-272e-4482-927b-c962fad989e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.528629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f306-272e-4482-927b-c962fad989e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.529361 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47f306-272e-4482-927b-c962fad989e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:36.529666 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47f306-272e-4482-927b-c962fad989e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:36.531623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47f306-272e-4482-927b-c962fad989e2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:36.538211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:36.539805 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 286/562] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:36.541103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7af05-1765-48b2-8840-a12fcb0c8a32 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.541347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7af05-1765-48b2-8840-a12fcb0c8a32 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.541624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7af05-1765-48b2-8840-a12fcb0c8a32 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.543032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 287/563] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:36.543561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7af05-1765-48b2-8840-a12fcb0c8a32 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:36.553040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825e10e-8fb3-4e10-a0e9-5efa1d5a49a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:36.553836 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825e10e-8fb3-4e10-a0e9-5efa1d5a49a5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.554119 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825e10e-8fb3-4e10-a0e9-5efa1d5a49a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.554417 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825e10e-8fb3-4e10-a0e9-5efa1d5a49a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.565002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825e10e-8fb3-4e10-a0e9-5efa1d5a49a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-e825e10e-8fb3-4e10-a0e9-5efa1d5a49a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:36.572698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:36.573741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 277/564] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:36.575343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825e10e-8fb3-4e10-a0e9-5efa1d5a49a5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:36.648956 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7af05-1765-48b2-8840-a12fcb0c8a32 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:36.677054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825e10e-8fb3-4e10-a0e9-5efa1d5a49a5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:36.682837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b47fb-3084-44ca-b5db-623a7223747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:36.683630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b47fb-3084-44ca-b5db-623a7223747d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.683912 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b47fb-3084-44ca-b5db-623a7223747d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.684187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b47fb-3084-44ca-b5db-623a7223747d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.686092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:36.692365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b47fb-3084-44ca-b5db-623a7223747d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:36.693785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b47fb-3084-44ca-b5db-623a7223747d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-d68b47fb-3084-44ca-b5db-623a7223747d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:36.708358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:36.709355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:36.710309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:36.710309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:36.710309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:36.710309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:36.710309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:36.710309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:36.710309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:36.710309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:36.710309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 16:55:36.710309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:36.710309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 288/565] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:36.710309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b47fb-3084-44ca-b5db-623a7223747d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:36.714782 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73e25d-a750-4f5d-8e80-fef3b3504668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:36.715593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73e25d-a750-4f5d-8e80-fef3b3504668 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.715875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73e25d-a750-4f5d-8e80-fef3b3504668 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.716146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73e25d-a750-4f5d-8e80-fef3b3504668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.727431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73e25d-a750-4f5d-8e80-fef3b3504668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:36.728860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73e25d-a750-4f5d-8e80-fef3b3504668 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6e73e25d-a750-4f5d-8e80-fef3b3504668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:36.745689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:36.746780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:36.747669 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:36.747669 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:36.747669 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:36.747669 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:36.747669 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 278/566] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:36.748007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49cdc3-3b78-49d8-92b4-9a71886f2390 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.748295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49cdc3-3b78-49d8-92b4-9a71886f2390 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.748573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49cdc3-3b78-49d8-92b4-9a71886f2390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.767268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-aa49cdc3-3b78-49d8-92b4-9a71886f2390 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:36.768478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-aa49cdc3-3b78-49d8-92b4-9a71886f2390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:36.797556 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:36.815818 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b47fb-3084-44ca-b5db-623a7223747d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:36.839341 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 279/567] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:36.840175 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49cdc3-3b78-49d8-92b4-9a71886f2390 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:36.857991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258aac-7b02-48f5-a809-0abbe709daf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:36.858842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258aac-7b02-48f5-a809-0abbe709daf4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.859712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258aac-7b02-48f5-a809-0abbe709daf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.859966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258aac-7b02-48f5-a809-0abbe709daf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.871433 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf258aac-7b02-48f5-a809-0abbe709daf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:36.872889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf258aac-7b02-48f5-a809-0abbe709daf4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-bf258aac-7b02-48f5-a809-0abbe709daf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:36.891451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:36.892407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:36.893297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:36.893297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:36.893297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:36.893297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:36.893297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 289/568] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:36.893595 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258aac-7b02-48f5-a809-0abbe709daf4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:36.940500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:36.940899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49cdc3-3b78-49d8-92b4-9a71886f2390 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:36.974558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c379ab-7368-4dbf-a3f7-f00c63fb56df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:36.975179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c379ab-7368-4dbf-a3f7-f00c63fb56df None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:36.975467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c379ab-7368-4dbf-a3f7-f00c63fb56df None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:36.975746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c379ab-7368-4dbf-a3f7-f00c63fb56df None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:36.976494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c379ab-7368-4dbf-a3f7-f00c63fb56df None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:36.976810 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c379ab-7368-4dbf-a3f7-f00c63fb56df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:36.978166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c379ab-7368-4dbf-a3f7-f00c63fb56df None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:36.988257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 280/569] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:36.989153 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c379ab-7368-4dbf-a3f7-f00c63fb56df None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:36.994546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258aac-7b02-48f5-a809-0abbe709daf4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.017281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:37.028797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d436f-4bd2-4629-bb15-c15b3953511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.029458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d436f-4bd2-4629-bb15-c15b3953511f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.029741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d436f-4bd2-4629-bb15-c15b3953511f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:37.030015 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d436f-4bd2-4629-bb15-c15b3953511f None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:37.031248 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d436f-4bd2-4629-bb15-c15b3953511f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:37.031724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d436f-4bd2-4629-bb15-c15b3953511f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:37.033143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d436f-4bd2-4629-bb15-c15b3953511f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:37.050421 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 290/570] 10.222.0.49 () {56 vars in 1137 bytes} [Mon May 23 16:55:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:37.051205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d436f-4bd2-4629-bb15-c15b3953511f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:37.093853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c379ab-7368-4dbf-a3f7-f00c63fb56df None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.128044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c347f-82c6-4c13-9c15-cda3dec13f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.128709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c347f-82c6-4c13-9c15-cda3dec13f71 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.128997 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c347f-82c6-4c13-9c15-cda3dec13f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:37.129275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c347f-82c6-4c13-9c15-cda3dec13f71 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:37.130008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c347f-82c6-4c13-9c15-cda3dec13f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:37.130326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c347f-82c6-4c13-9c15-cda3dec13f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:37.131712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c347f-82c6-4c13-9c15-cda3dec13f71 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:37.143192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 281/571] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:37.143986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c347f-82c6-4c13-9c15-cda3dec13f71 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:37.147936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d436f-4bd2-4629-bb15-c15b3953511f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.150615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:37.182781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f3b0f-494c-491d-8c26-bd62a083a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.183577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f3b0f-494c-491d-8c26-bd62a083a62c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.183867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f3b0f-494c-491d-8c26-bd62a083a62c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:37.184153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f3b0f-494c-491d-8c26-bd62a083a62c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:37.195062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f3b0f-494c-491d-8c26-bd62a083a62c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-c59f3b0f-494c-491d-8c26-bd62a083a62c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:37.203124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:37.209106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 291/572] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:37.210130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f3b0f-494c-491d-8c26-bd62a083a62c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:37.229138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:37.246190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c347f-82c6-4c13-9c15-cda3dec13f71 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.278829 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58b877-1540-4b60-a1ee-d93a07975a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.279492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58b877-1540-4b60-a1ee-d93a07975a4d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.279779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58b877-1540-4b60-a1ee-d93a07975a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:37.280059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58b877-1540-4b60-a1ee-d93a07975a4d None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:37.280778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58b877-1540-4b60-a1ee-d93a07975a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:37.281578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58b877-1540-4b60-a1ee-d93a07975a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:37.282981 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58b877-1540-4b60-a1ee-d93a07975a4d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:37.297712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 282/573] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:37.298697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58b877-1540-4b60-a1ee-d93a07975a4d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:37.317096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f3b0f-494c-491d-8c26-bd62a083a62c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.349758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0e368-7101-46fd-8cc6-79b56414e083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.350613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0e368-7101-46fd-8cc6-79b56414e083 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.350908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0e368-7101-46fd-8cc6-79b56414e083 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:37.351191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0e368-7101-46fd-8cc6-79b56414e083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:37.361919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0e368-7101-46fd-8cc6-79b56414e083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:37.363388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0e368-7101-46fd-8cc6-79b56414e083 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-4ac0e368-7101-46fd-8cc6-79b56414e083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:37.380790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:37.382272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:37.383211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:37.383211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:37.383211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:37.383211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:37.383211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 292/574] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:37.383211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0e368-7101-46fd-8cc6-79b56414e083 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:37.400341 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58b877-1540-4b60-a1ee-d93a07975a4d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.401611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:37.433229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ab33f-28af-4928-badd-80d457dcdd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.434024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ab33f-28af-4928-badd-80d457dcdd8c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.434312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ab33f-28af-4928-badd-80d457dcdd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:37.434623 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ab33f-28af-4928-badd-80d457dcdd8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:37.446044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ab33f-28af-4928-badd-80d457dcdd8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:37.447541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ab33f-28af-4928-badd-80d457dcdd8c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:37.454697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-527ab33f-28af-4928-badd-80d457dcdd8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:37.466008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:37.466952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:37.468102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:37.468102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:37.468102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:37.468102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:37.468102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 283/575] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:37.468102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ab33f-28af-4928-badd-80d457dcdd8c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:37.485503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0e368-7101-46fd-8cc6-79b56414e083 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.520667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217b177-f916-4429-9ae1-4bcae07bc089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.521457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b177-f916-4429-9ae1-4bcae07bc089 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.521745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b177-f916-4429-9ae1-4bcae07bc089 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:37.522022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b177-f916-4429-9ae1-4bcae07bc089 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:37.528650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217b177-f916-4429-9ae1-4bcae07bc089 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:37.530090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217b177-f916-4429-9ae1-4bcae07bc089 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-0217b177-f916-4429-9ae1-4bcae07bc089 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:37.544169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:37.545206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:37.546122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:37.546122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:37.546122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:37.546122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:37.546122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:37.546122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:37.546122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:37.546122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:37.546122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 293/576] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:37.546122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217b177-f916-4429-9ae1-4bcae07bc089 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:37.571044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ab33f-28af-4928-badd-80d457dcdd8c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.603660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a309151-0f23-434d-99e1-cd8bfc70758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.604329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a309151-0f23-434d-99e1-cd8bfc70758a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.604615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a309151-0f23-434d-99e1-cd8bfc70758a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:37.604895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a309151-0f23-434d-99e1-cd8bfc70758a None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:37.605648 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a309151-0f23-434d-99e1-cd8bfc70758a None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:37.605960 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a309151-0f23-434d-99e1-cd8bfc70758a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:37.607362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a309151-0f23-434d-99e1-cd8bfc70758a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:37.615957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 284/577] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:37.616735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a309151-0f23-434d-99e1-cd8bfc70758a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:37.623189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:37.647241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217b177-f916-4429-9ae1-4bcae07bc089 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.678001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:37.682467 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f49105-1287-4124-8d6d-36265dd38623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.683257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f49105-1287-4124-8d6d-36265dd38623 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.683541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f49105-1287-4124-8d6d-36265dd38623 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:37.683820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f49105-1287-4124-8d6d-36265dd38623 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:37.691493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f49105-1287-4124-8d6d-36265dd38623 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:37.692916 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f49105-1287-4124-8d6d-36265dd38623 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b3f49105-1287-4124-8d6d-36265dd38623 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:37.707568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:37.708696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:37.709676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:37.709676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:37.709676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:37.709676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:37.709676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:37.709676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:37.709676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:37.709676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:37.709676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:55:37.709676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:37.709676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 294/578] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 23 16:55:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:37.709676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f49105-1287-4124-8d6d-36265dd38623 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:37.724437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a309151-0f23-434d-99e1-cd8bfc70758a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.757560 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1058779-c99a-4bd3-aa20-26601120f68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.758152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1058779-c99a-4bd3-aa20-26601120f68a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.758467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1058779-c99a-4bd3-aa20-26601120f68a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:37.758755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1058779-c99a-4bd3-aa20-26601120f68a None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:37.759478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1058779-c99a-4bd3-aa20-26601120f68a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:37.759787 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1058779-c99a-4bd3-aa20-26601120f68a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:37.761153 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1058779-c99a-4bd3-aa20-26601120f68a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:37.775982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 285/579] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:37.776654 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1058779-c99a-4bd3-aa20-26601120f68a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:37.812248 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f49105-1287-4124-8d6d-36265dd38623 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.846018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab17f2-0f6e-4ec1-a1c6-c402ad8c6814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.846703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab17f2-0f6e-4ec1-a1c6-c402ad8c6814 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.846990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab17f2-0f6e-4ec1-a1c6-c402ad8c6814 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:37.847264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab17f2-0f6e-4ec1-a1c6-c402ad8c6814 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:37.847973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab17f2-0f6e-4ec1-a1c6-c402ad8c6814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:37.848279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab17f2-0f6e-4ec1-a1c6-c402ad8c6814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:37.849624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab17f2-0f6e-4ec1-a1c6-c402ad8c6814 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:37.851876 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:37.861564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 295/580] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:37.862447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab17f2-0f6e-4ec1-a1c6-c402ad8c6814 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:37.878529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1058779-c99a-4bd3-aa20-26601120f68a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.899241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:37.914892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05e6eb-e427-4727-8bd4-d0d2109a0ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.915554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05e6eb-e427-4727-8bd4-d0d2109a0ffc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.915842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05e6eb-e427-4727-8bd4-d0d2109a0ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:37.916124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05e6eb-e427-4727-8bd4-d0d2109a0ffc None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:37.916923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05e6eb-e427-4727-8bd4-d0d2109a0ffc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:37.917232 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05e6eb-e427-4727-8bd4-d0d2109a0ffc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:37.918716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05e6eb-e427-4727-8bd4-d0d2109a0ffc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:37.930283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 286/581] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:37.931120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05e6eb-e427-4727-8bd4-d0d2109a0ffc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:37.963618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab17f2-0f6e-4ec1-a1c6-c402ad8c6814 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:37.998287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd4c7b-7d48-4202-8013-1b6d3d281b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:37.999092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd4c7b-7d48-4202-8013-1b6d3d281b49 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:37.999373 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd4c7b-7d48-4202-8013-1b6d3d281b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:38.000196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd4c7b-7d48-4202-8013-1b6d3d281b49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:38.011700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd4c7b-7d48-4202-8013-1b6d3d281b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:38.013057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd4c7b-7d48-4202-8013-1b6d3d281b49 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:38.029859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05e6eb-e427-4727-8bd4-d0d2109a0ffc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-a3bd4c7b-7d48-4202-8013-1b6d3d281b49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:38.030492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:38.031852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:38.032901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:38.032901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:38.032901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:38.032901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:38.032901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 296/582] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:38.033240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd4c7b-7d48-4202-8013-1b6d3d281b49 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:38.066561 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1562480-8dc8-4ffb-b077-35d9008cd4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:38.067345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1562480-8dc8-4ffb-b077-35d9008cd4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:38.067697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1562480-8dc8-4ffb-b077-35d9008cd4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:38.068038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1562480-8dc8-4ffb-b077-35d9008cd4f7 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:38.068940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1562480-8dc8-4ffb-b077-35d9008cd4f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:38.069323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1562480-8dc8-4ffb-b077-35d9008cd4f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:38.070848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1562480-8dc8-4ffb-b077-35d9008cd4f7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:38.081865 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:38.089051 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 287/583] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 23 16:55:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:38.089917 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1562480-8dc8-4ffb-b077-35d9008cd4f7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:38.129327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:38.133485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd4c7b-7d48-4202-8013-1b6d3d281b49 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:38.167536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68226887-de4f-4ed2-815a-89cb98b8ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:38.168331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226887-de4f-4ed2-815a-89cb98b8ba0c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:38.168615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226887-de4f-4ed2-815a-89cb98b8ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:38.168892 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226887-de4f-4ed2-815a-89cb98b8ba0c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:38.177104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68226887-de4f-4ed2-815a-89cb98b8ba0c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:38.178809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68226887-de4f-4ed2-815a-89cb98b8ba0c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:38.194862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1562480-8dc8-4ffb-b077-35d9008cd4f7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-68226887-de4f-4ed2-815a-89cb98b8ba0c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:38.197345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:38.198392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:38.199739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:38.199739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:38.199739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:38.199739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:38.199739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:38.199739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:38.199739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:38.199739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:38.199739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 16:55:38.199739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:38.199739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 297/584] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:38.200569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68226887-de4f-4ed2-815a-89cb98b8ba0c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:38.235102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb233c-7a5a-43c8-ba93-31c629198688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:38.235979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb233c-7a5a-43c8-ba93-31c629198688 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:38.236338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb233c-7a5a-43c8-ba93-31c629198688 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:38.236668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb233c-7a5a-43c8-ba93-31c629198688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:38.243274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb233c-7a5a-43c8-ba93-31c629198688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:38.244709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb233c-7a5a-43c8-ba93-31c629198688 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-63bb233c-7a5a-43c8-ba93-31c629198688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:38.259955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:38.260967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:38.261923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:38.261923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:38.261923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:38.261923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:38.261923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:38.261923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:38.261923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:38.261923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:38.261923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 288/585] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:38.261923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb233c-7a5a-43c8-ba93-31c629198688 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:38.309293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68226887-de4f-4ed2-815a-89cb98b8ba0c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:38.318023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:38.350666 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df960d-df96-4aa1-b4af-40a41c0fbbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:38.351319 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df960d-df96-4aa1-b4af-40a41c0fbbcf None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:38.351602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df960d-df96-4aa1-b4af-40a41c0fbbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:38.351878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df960d-df96-4aa1-b4af-40a41c0fbbcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:38.352704 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df960d-df96-4aa1-b4af-40a41c0fbbcf None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=c22f94b1abe248c3969b68e17755f113) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:38.353016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df960d-df96-4aa1-b4af-40a41c0fbbcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:38.354498 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df960d-df96-4aa1-b4af-40a41c0fbbcf None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:38.359795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:38.364131 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb233c-7a5a-43c8-ba93-31c629198688 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:38.370569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 298/586] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:38 2022] GET /identity/v3/role_assignments?user.id=c22f94b1abe248c3969b68e17755f113&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:38.371855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df960d-df96-4aa1-b4af-40a41c0fbbcf None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:38.404814 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a828c2-f2d2-4212-937c-cc0bc8f92ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:38.405496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a828c2-f2d2-4212-937c-cc0bc8f92ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:38.405779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a828c2-f2d2-4212-937c-cc0bc8f92ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:38.406893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a828c2-f2d2-4212-937c-cc0bc8f92ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:38.408152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a828c2-f2d2-4212-937c-cc0bc8f92ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:38.408471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a828c2-f2d2-4212-937c-cc0bc8f92ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:38.409986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a828c2-f2d2-4212-937c-cc0bc8f92ec0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:38.425928 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 289/587] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:38.426878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a828c2-f2d2-4212-937c-cc0bc8f92ec0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:38.494440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df960d-df96-4aa1-b4af-40a41c0fbbcf None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:38.537177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4528859-5443-4156-909a-eed03c97a567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:38.537898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4528859-5443-4156-909a-eed03c97a567 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:38.538183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4528859-5443-4156-909a-eed03c97a567 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:38.538485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4528859-5443-4156-909a-eed03c97a567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:38.551737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4528859-5443-4156-909a-eed03c97a567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:38.552536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4528859-5443-4156-909a-eed03c97a567 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:38.553070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a828c2-f2d2-4212-937c-cc0bc8f92ec0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f4528859-5443-4156-909a-eed03c97a567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:38.571338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:38.572321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:38.573220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:38.573220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:38.573220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:38.573220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:38.573220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 299/588] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:38.574492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4528859-5443-4156-909a-eed03c97a567 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:38.596722 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5215e1d-3157-4852-ab47-9a909fe8c7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:38.597451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5215e1d-3157-4852-ab47-9a909fe8c7be None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:38.597747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5215e1d-3157-4852-ab47-9a909fe8c7be None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:38.598030 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5215e1d-3157-4852-ab47-9a909fe8c7be None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:38.598911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5215e1d-3157-4852-ab47-9a909fe8c7be None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:38.599229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5215e1d-3157-4852-ab47-9a909fe8c7be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:38.600671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5215e1d-3157-4852-ab47-9a909fe8c7be None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:38.605560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:38.624204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 290/589] 10.222.0.49 () {56 vars in 1139 bytes} [Mon May 23 16:55:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:38.624204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5215e1d-3157-4852-ab47-9a909fe8c7be None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:38.641291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:38.689580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4528859-5443-4156-909a-eed03c97a567 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:38.727991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5215e1d-3157-4852-ab47-9a909fe8c7be None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:38.728544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95387158-40d7-486d-8e69-5d345fb6e2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:38.729217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95387158-40d7-486d-8e69-5d345fb6e2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:38.729664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95387158-40d7-486d-8e69-5d345fb6e2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:38.729952 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95387158-40d7-486d-8e69-5d345fb6e2d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:38.731140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95387158-40d7-486d-8e69-5d345fb6e2d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:38.731460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95387158-40d7-486d-8e69-5d345fb6e2d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:38.732892 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95387158-40d7-486d-8e69-5d345fb6e2d6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:38.750339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 300/590] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:38.750339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95387158-40d7-486d-8e69-5d345fb6e2d6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:38.773339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9e913-79a9-4bc4-95d1-0a6c971895c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:38.774136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9e913-79a9-4bc4-95d1-0a6c971895c5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:38.774438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9e913-79a9-4bc4-95d1-0a6c971895c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:38.774716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9e913-79a9-4bc4-95d1-0a6c971895c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:38.782922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9e913-79a9-4bc4-95d1-0a6c971895c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:38.784368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9e913-79a9-4bc4-95d1-0a6c971895c5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-44c9e913-79a9-4bc4-95d1-0a6c971895c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:38.800053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:38.801267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:38.802263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:38.802263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:38.802263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:38.802263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:38.802263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:38.802263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:38.802263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:38.802263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:38.802263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:55:38.802263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:38.802263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 291/591] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:38.803056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9e913-79a9-4bc4-95d1-0a6c971895c5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:38.852285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:38.872050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95387158-40d7-486d-8e69-5d345fb6e2d6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:38.888278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:38.911460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4468ff-a8b9-459a-83b7-91e4bf049417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:38.912129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4468ff-a8b9-459a-83b7-91e4bf049417 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:38.912418 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4468ff-a8b9-459a-83b7-91e4bf049417 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:38.912698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4468ff-a8b9-459a-83b7-91e4bf049417 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:38.913425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4468ff-a8b9-459a-83b7-91e4bf049417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:38.913736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4468ff-a8b9-459a-83b7-91e4bf049417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:38.913832 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9e913-79a9-4bc4-95d1-0a6c971895c5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:38.915239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4468ff-a8b9-459a-83b7-91e4bf049417 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:38.927545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 301/592] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:38.928336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4468ff-a8b9-459a-83b7-91e4bf049417 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:38.954441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f79682-11d3-4e72-9062-4c8c75eade1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:38.955236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f79682-11d3-4e72-9062-4c8c75eade1f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:38.955524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f79682-11d3-4e72-9062-4c8c75eade1f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:38.955800 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f79682-11d3-4e72-9062-4c8c75eade1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:38.966262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f79682-11d3-4e72-9062-4c8c75eade1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:38.967739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f79682-11d3-4e72-9062-4c8c75eade1f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-e1f79682-11d3-4e72-9062-4c8c75eade1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:38.986476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:38.987373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:38.988265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:38.988265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:38.988265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:38.988265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:38.988265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 292/593] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:38.988548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f79682-11d3-4e72-9062-4c8c75eade1f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:39.051968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4468ff-a8b9-459a-83b7-91e4bf049417 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:39.086597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5c7d6-1aaf-4ada-98bb-ac8c46c497c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:39.087500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5c7d6-1aaf-4ada-98bb-ac8c46c497c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:39.087789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5c7d6-1aaf-4ada-98bb-ac8c46c497c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:39.088068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5c7d6-1aaf-4ada-98bb-ac8c46c497c0 None admin] PATH_INFO: `/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/a6a5b9c982724df0b88ce6ad46dc37e6/roles/3d6cf7264f664a20a5a635d4d11c3e1a` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:39.101171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f79682-11d3-4e72-9062-4c8c75eade1f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:39.102673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5c7d6-1aaf-4ada-98bb-ac8c46c497c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=733d8651e4a74a2ab694091d9fd83e49, user_id=a6a5b9c982724df0b88ce6ad46dc37e6, role_id=3d6cf7264f664a20a5a635d4d11c3e1a)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:39.104103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5c7d6-1aaf-4ada-98bb-ac8c46c497c0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:39.106310 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:39.118308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 302/594] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:55:38 2022] PUT /identity/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/a6a5b9c982724df0b88ce6ad46dc37e6/roles/3d6cf7264f664a20a5a635d4d11c3e1a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:39.119126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5c7d6-1aaf-4ada-98bb-ac8c46c497c0 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:39.145184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:39.154346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79c3d5-6990-4c8f-bc4e-f3959fb4571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:39.155391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79c3d5-6990-4c8f-bc4e-f3959fb4571d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:39.155964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79c3d5-6990-4c8f-bc4e-f3959fb4571d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:39.156829 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79c3d5-6990-4c8f-bc4e-f3959fb4571d None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:39.158105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79c3d5-6990-4c8f-bc4e-f3959fb4571d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:39.158456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79c3d5-6990-4c8f-bc4e-f3959fb4571d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:39.159965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79c3d5-6990-4c8f-bc4e-f3959fb4571d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:39.185872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 293/595] 10.222.0.49 () {56 vars in 1137 bytes} [Mon May 23 16:55:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:39.185872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79c3d5-6990-4c8f-bc4e-f3959fb4571d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:39.277824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5c7d6-1aaf-4ada-98bb-ac8c46c497c0 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:39.300268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79c3d5-6990-4c8f-bc4e-f3959fb4571d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:39.320630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45d91a-9df5-4cb4-8f07-81975a8856c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:39.321905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45d91a-9df5-4cb4-8f07-81975a8856c5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:39.322287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45d91a-9df5-4cb4-8f07-81975a8856c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:39.322703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45d91a-9df5-4cb4-8f07-81975a8856c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:39.337524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45d91a-9df5-4cb4-8f07-81975a8856c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:39.343807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45d91a-9df5-4cb4-8f07-81975a8856c5 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:39.343985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15b069-de1e-41d1-99ba-956e2b8ff4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:39.344706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15b069-de1e-41d1-99ba-956e2b8ff4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:39.345032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15b069-de1e-41d1-99ba-956e2b8ff4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:39.345312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15b069-de1e-41d1-99ba-956e2b8ff4c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:39.346045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15b069-de1e-41d1-99ba-956e2b8ff4c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:39.346355 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15b069-de1e-41d1-99ba-956e2b8ff4c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:39.348215 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15b069-de1e-41d1-99ba-956e2b8ff4c4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-de45d91a-9df5-4cb4-8f07-81975a8856c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:39.356699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:39.357804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:39.359574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:39.359574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:39.359574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:39.359574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:39.359574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:39.359574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:39.359574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:39.359574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:39.360278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 303/596] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:39.360606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45d91a-9df5-4cb4-8f07-81975a8856c5 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:39.370127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 294/597] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:39.371108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15b069-de1e-41d1-99ba-956e2b8ff4c4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:39.425101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:39.434006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:39.491766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45d91a-9df5-4cb4-8f07-81975a8856c5 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:39.506284 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15b069-de1e-41d1-99ba-956e2b8ff4c4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:39.540407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd19d7-18c7-4ffd-ae06-3fd694ff9d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:39.541207 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd19d7-18c7-4ffd-ae06-3fd694ff9d21 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:39.541549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd19d7-18c7-4ffd-ae06-3fd694ff9d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:39.542211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd19d7-18c7-4ffd-ae06-3fd694ff9d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:39.550425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492bccd-dea1-457e-aae1-6758ab91c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:39.551503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492bccd-dea1-457e-aae1-6758ab91c830 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:39.551994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492bccd-dea1-457e-aae1-6758ab91c830 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:39.552477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492bccd-dea1-457e-aae1-6758ab91c830 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:39.553470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492bccd-dea1-457e-aae1-6758ab91c830 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:39.554422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492bccd-dea1-457e-aae1-6758ab91c830 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:39.555746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd19d7-18c7-4ffd-ae06-3fd694ff9d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:39.556325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492bccd-dea1-457e-aae1-6758ab91c830 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:39.557184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd19d7-18c7-4ffd-ae06-3fd694ff9d21 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:39.576779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 295/598] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-83cd19d7-18c7-4ffd-ae06-3fd694ff9d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:39.577896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:39.579057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:39.580034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:39.580034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:39.580034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:39.580034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:39.580034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 304/599] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:39.581217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd19d7-18c7-4ffd-ae06-3fd694ff9d21 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:39.581871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492bccd-dea1-457e-aae1-6758ab91c830 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:39.700086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd19d7-18c7-4ffd-ae06-3fd694ff9d21 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:39.708305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:39.713023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492bccd-dea1-457e-aae1-6758ab91c830 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:39.723391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:39.748384 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d72967-574b-4578-9b3a-4f50f53c8f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:39.749443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d72967-574b-4578-9b3a-4f50f53c8f2f None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:39.749877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d72967-574b-4578-9b3a-4f50f53c8f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:39.750156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d72967-574b-4578-9b3a-4f50f53c8f2f None admin] PATH_INFO: `/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/9884780c88aa48ffa92a696740761387/roles/3d6cf7264f664a20a5a635d4d11c3e1a` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:39.757456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ca07f-b9a9-4730-b24f-5d10208aa174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:39.758571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ca07f-b9a9-4730-b24f-5d10208aa174 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:39.759062 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ca07f-b9a9-4730-b24f-5d10208aa174 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:39.759571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ca07f-b9a9-4730-b24f-5d10208aa174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:39.767314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ca07f-b9a9-4730-b24f-5d10208aa174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:39.768151 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d72967-574b-4578-9b3a-4f50f53c8f2f None admin] RBAC: Authorizing `identity:create_grant(project_id=733d8651e4a74a2ab694091d9fd83e49, user_id=9884780c88aa48ffa92a696740761387, role_id=3d6cf7264f664a20a5a635d4d11c3e1a)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:39.769252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ca07f-b9a9-4730-b24f-5d10208aa174 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:39.769575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d72967-574b-4578-9b3a-4f50f53c8f2f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-a09ca07f-b9a9-4730-b24f-5d10208aa174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:39.785754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:39.786746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:39.788224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:39.788224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:39.788224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:39.788224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:39.788224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:39.788224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:39.788224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:39.788224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:39.788224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 296/600] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:39.788739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ca07f-b9a9-4730-b24f-5d10208aa174 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:39.799728 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 305/601] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:55:39 2022] PUT /identity/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/9884780c88aa48ffa92a696740761387/roles/3d6cf7264f664a20a5a635d4d11c3e1a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:39.800923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d72967-574b-4578-9b3a-4f50f53c8f2f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:39.973638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d72967-574b-4578-9b3a-4f50f53c8f2f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:39.994991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ca07f-b9a9-4730-b24f-5d10208aa174 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:40.037477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df5831-2489-461b-bcb3-6d793021fd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:40.038160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df5831-2489-461b-bcb3-6d793021fd40 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:40.038477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df5831-2489-461b-bcb3-6d793021fd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:40.038761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df5831-2489-461b-bcb3-6d793021fd40 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:40.039507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df5831-2489-461b-bcb3-6d793021fd40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:40.039822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df5831-2489-461b-bcb3-6d793021fd40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:40.041590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df5831-2489-461b-bcb3-6d793021fd40 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:40.063007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 297/602] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:40.065561 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df5831-2489-461b-bcb3-6d793021fd40 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:40.072205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bb841-45fa-40a5-89ca-baa93d1abcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:40.073172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bb841-45fa-40a5-89ca-baa93d1abcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:40.073684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bb841-45fa-40a5-89ca-baa93d1abcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:40.074513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bb841-45fa-40a5-89ca-baa93d1abcd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:40.075549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bb841-45fa-40a5-89ca-baa93d1abcd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:40.076184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bb841-45fa-40a5-89ca-baa93d1abcd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:40.078466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bb841-45fa-40a5-89ca-baa93d1abcd5 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:40.095267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 306/603] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:40.104734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:40.109370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bb841-45fa-40a5-89ca-baa93d1abcd5 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:40.130696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:40.199864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df5831-2489-461b-bcb3-6d793021fd40 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:40.241577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bb841-45fa-40a5-89ca-baa93d1abcd5 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:40.264360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5cd3f-723b-4593-b661-4e247ab8cc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:40.265809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5cd3f-723b-4593-b661-4e247ab8cc3e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:40.266773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5cd3f-723b-4593-b661-4e247ab8cc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:40.267940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5cd3f-723b-4593-b661-4e247ab8cc3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:40.282743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5cd3f-723b-4593-b661-4e247ab8cc3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:40.284570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5cd3f-723b-4593-b661-4e247ab8cc3e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:40.310156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a1f8a-5ea6-4dd7-b06c-efb903be96af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:40.311490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a1f8a-5ea6-4dd7-b06c-efb903be96af None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:40.312009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a1f8a-5ea6-4dd7-b06c-efb903be96af None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:40.312533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a1f8a-5ea6-4dd7-b06c-efb903be96af None admin] PATH_INFO: `/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/73bdfedb6d9e4ddab18a8143ba7142fc/roles/3d6cf7264f664a20a5a635d4d11c3e1a` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-f6a5cd3f-723b-4593-b661-4e247ab8cc3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:40.314582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:40.315480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:40.316385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:40.316385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:40.316385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:40.316385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:40.316385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:40.316385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:40.316385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:40.316385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:40.319265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 298/604] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:40.329487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5cd3f-723b-4593-b661-4e247ab8cc3e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:40.340024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a1f8a-5ea6-4dd7-b06c-efb903be96af None admin] RBAC: Authorizing `identity:create_grant(project_id=733d8651e4a74a2ab694091d9fd83e49, user_id=73bdfedb6d9e4ddab18a8143ba7142fc, role_id=3d6cf7264f664a20a5a635d4d11c3e1a)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:40.341570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a1f8a-5ea6-4dd7-b06c-efb903be96af None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:40.372344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 307/605] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:55:40 2022] PUT /identity/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/73bdfedb6d9e4ddab18a8143ba7142fc/roles/3d6cf7264f664a20a5a635d4d11c3e1a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:40.445640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:40.464186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5cd3f-723b-4593-b661-4e247ab8cc3e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:40.512163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780de57-806e-417e-87cb-e240a7603f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:40.512784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780de57-806e-417e-87cb-e240a7603f09 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:40.513054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780de57-806e-417e-87cb-e240a7603f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:40.513386 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780de57-806e-417e-87cb-e240a7603f09 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:40.514199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780de57-806e-417e-87cb-e240a7603f09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:40.514540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780de57-806e-417e-87cb-e240a7603f09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:40.516541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780de57-806e-417e-87cb-e240a7603f09 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:40.535363 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 299/606] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:40.541284 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a1f8a-5ea6-4dd7-b06c-efb903be96af None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:40.641573 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:40.689217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a1f8a-5ea6-4dd7-b06c-efb903be96af None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:40.726064 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d6996-40c0-452d-a8b5-0b2f79a7d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:40.727011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d6996-40c0-452d-a8b5-0b2f79a7d19c None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:40.727294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d6996-40c0-452d-a8b5-0b2f79a7d19c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:40.727569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d6996-40c0-452d-a8b5-0b2f79a7d19c None admin] PATH_INFO: `/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/c91dcf97796941718e251912271aea71/roles/3d6cf7264f664a20a5a635d4d11c3e1a` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:40.745256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d6996-40c0-452d-a8b5-0b2f79a7d19c None admin] RBAC: Authorizing `identity:create_grant(project_id=733d8651e4a74a2ab694091d9fd83e49, user_id=c91dcf97796941718e251912271aea71, role_id=3d6cf7264f664a20a5a635d4d11c3e1a)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:40.746732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d6996-40c0-452d-a8b5-0b2f79a7d19c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:40.757888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ea64f-aee9-4016-b1f0-347fd879047a None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:40.758384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ea64f-aee9-4016-b1f0-347fd879047a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:40.758638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ea64f-aee9-4016-b1f0-347fd879047a None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:40.760416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 300/607] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:55:40.766115 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282665-9dc0-4668-be67-ed8b3f46890f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:40.766382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282665-9dc0-4668-be67-ed8b3f46890f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:40.766663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282665-9dc0-4668-be67-ed8b3f46890f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:40.774577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 308/608] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:55:40 2022] PUT /identity/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/c91dcf97796941718e251912271aea71/roles/3d6cf7264f664a20a5a635d4d11c3e1a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:40.811496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-53282665-9dc0-4668-be67-ed8b3f46890f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:40.812933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-53282665-9dc0-4668-be67-ed8b3f46890f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:40.932099 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 301/609] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:55:40.966753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d6996-40c0-452d-a8b5-0b2f79a7d19c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:41.117217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d6996-40c0-452d-a8b5-0b2f79a7d19c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:41.143734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:41.173545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e01cb0-b128-491e-817a-cbae64e6a3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:41.174395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01cb0-b128-491e-817a-cbae64e6a3bc None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:41.174678 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01cb0-b128-491e-817a-cbae64e6a3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:41.174958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01cb0-b128-491e-817a-cbae64e6a3bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:41.195259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e01cb0-b128-491e-817a-cbae64e6a3bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-45e01cb0-b128-491e-817a-cbae64e6a3bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:41.203669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:41.204621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:41.205478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 309/610] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:41.211462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282665-9dc0-4668-be67-ed8b3f46890f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:41.372457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:41.407049 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282665-9dc0-4668-be67-ed8b3f46890f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:41.453306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b23b88-1017-456e-80e4-2d382377ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:41.453999 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b23b88-1017-456e-80e4-2d382377ca3e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:41.454286 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b23b88-1017-456e-80e4-2d382377ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:41.454593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b23b88-1017-456e-80e4-2d382377ca3e None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:41.455355 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b23b88-1017-456e-80e4-2d382377ca3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:41.455666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b23b88-1017-456e-80e4-2d382377ca3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:41.457050 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b23b88-1017-456e-80e4-2d382377ca3e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:41.474707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 302/611] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:41.479907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e01cb0-b128-491e-817a-cbae64e6a3bc None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:41.633191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e01cb0-b128-491e-817a-cbae64e6a3bc None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:41.687786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f3f8f-c7de-4850-b423-958ea02d857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:41.688691 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f3f8f-c7de-4850-b423-958ea02d857c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:41.688977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f3f8f-c7de-4850-b423-958ea02d857c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:41.689255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f3f8f-c7de-4850-b423-958ea02d857c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:41.709375 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f3f8f-c7de-4850-b423-958ea02d857c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:41.711602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f3f8f-c7de-4850-b423-958ea02d857c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-786f3f8f-c7de-4850-b423-958ea02d857c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:41.742625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:41.743630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:41.745119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:41.745119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:41.745119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:41.745119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:41.745119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 310/612] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:41.750295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b23b88-1017-456e-80e4-2d382377ca3e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:41.764387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8b62-6c51-44ac-96fd-56d96ae531b8 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:41.764672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8b62-6c51-44ac-96fd-56d96ae531b8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:41.764950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8b62-6c51-44ac-96fd-56d96ae531b8 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:41.767301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 311/613] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:41.772368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f3c75-7b4e-408f-88a2-384b0b9650c1 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:41.772664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f3c75-7b4e-408f-88a2-384b0b9650c1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:41.772943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f3c75-7b4e-408f-88a2-384b0b9650c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:41.807659 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d15f3c75-7b4e-408f-88a2-384b0b9650c1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:41.808863 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d15f3c75-7b4e-408f-88a2-384b0b9650c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:41.857009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:41.877493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b23b88-1017-456e-80e4-2d382377ca3e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:41.913336 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96835f4-a57f-4ebc-9a70-010b066e957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:41.913936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96835f4-a57f-4ebc-9a70-010b066e957d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:41.914226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96835f4-a57f-4ebc-9a70-010b066e957d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:41.914540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96835f4-a57f-4ebc-9a70-010b066e957d None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:41.915286 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96835f4-a57f-4ebc-9a70-010b066e957d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:41.915599 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96835f4-a57f-4ebc-9a70-010b066e957d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:41.916999 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96835f4-a57f-4ebc-9a70-010b066e957d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:41.925317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:41.932720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 303/614] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:41.938885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96835f4-a57f-4ebc-9a70-010b066e957d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:41.969416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 312/615] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:42.000477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f3c75-7b4e-408f-88a2-384b0b9650c1 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:42.056969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96835f4-a57f-4ebc-9a70-010b066e957d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:42.102119 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4aae7-be49-4852-9813-0c0b9212d08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:42.103000 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4aae7-be49-4852-9813-0c0b9212d08d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:42.103295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4aae7-be49-4852-9813-0c0b9212d08d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:42.103576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4aae7-be49-4852-9813-0c0b9212d08d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:42.111474 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4aae7-be49-4852-9813-0c0b9212d08d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:42.112938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4aae7-be49-4852-9813-0c0b9212d08d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-00e4aae7-be49-4852-9813-0c0b9212d08d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:42.128008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:42.128947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:42.130117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:42.130117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:42.130117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:42.130117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:42.130117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:42.130117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:42.130117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:42.130117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:42.130117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 16:55:42.130117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:42.130117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 304/616] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:55:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:42.138045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4aae7-be49-4852-9813-0c0b9212d08d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:42.201690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f3c75-7b4e-408f-88a2-384b0b9650c1 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:42.240425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:42.249266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cde6e-88c0-4e38-917a-96e50c84148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:42.250391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cde6e-88c0-4e38-917a-96e50c84148f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:42.254032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cde6e-88c0-4e38-917a-96e50c84148f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:42.254321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cde6e-88c0-4e38-917a-96e50c84148f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:42.279047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cde6e-88c0-4e38-917a-96e50c84148f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-7a6cde6e-88c0-4e38-917a-96e50c84148f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:42.288201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:42.289204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:42.290032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:42.290032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:42.290032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:42.290032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:42.290032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:42.290032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:42.290032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:42.290032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:42.290032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:42.290032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:42.290032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:42.290032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:42.292952 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 313/617] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:42.299381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cde6e-88c0-4e38-917a-96e50c84148f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:42.307714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4aae7-be49-4852-9813-0c0b9212d08d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:42.338749 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:42.416274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cde6e-88c0-4e38-917a-96e50c84148f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:42.416472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c1c21-31ca-42fc-966e-565a50b2fc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:42.417067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c1c21-31ca-42fc-966e-565a50b2fc79 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:42.417349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c1c21-31ca-42fc-966e-565a50b2fc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:42.417625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c1c21-31ca-42fc-966e-565a50b2fc79 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:42.418506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c1c21-31ca-42fc-966e-565a50b2fc79 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:42.418834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c1c21-31ca-42fc-966e-565a50b2fc79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:42.420237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c1c21-31ca-42fc-966e-565a50b2fc79 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:42.454253 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef1890-8d96-49cc-ac4c-94460abf54ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:42.455019 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef1890-8d96-49cc-ac4c-94460abf54ed None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:42.455402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef1890-8d96-49cc-ac4c-94460abf54ed None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:42.455698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef1890-8d96-49cc-ac4c-94460abf54ed None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:42.456594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef1890-8d96-49cc-ac4c-94460abf54ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:42.457142 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef1890-8d96-49cc-ac4c-94460abf54ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:42.459518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef1890-8d96-49cc-ac4c-94460abf54ed None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:42.469634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 305/618] 10.222.0.49 () {56 vars in 1135 bytes} [Mon May 23 16:55:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:42.471361 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 314/619] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:42.475061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c1c21-31ca-42fc-966e-565a50b2fc79 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:42.476890 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef1890-8d96-49cc-ac4c-94460abf54ed None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:42.586798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:42.595582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef1890-8d96-49cc-ac4c-94460abf54ed None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:42.669321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1fe04-9dec-4e47-924b-91c4e571cf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:42.671904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1fe04-9dec-4e47-924b-91c4e571cf5f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:42.674288 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1fe04-9dec-4e47-924b-91c4e571cf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:42.674606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1fe04-9dec-4e47-924b-91c4e571cf5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:42.696360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1fe04-9dec-4e47-924b-91c4e571cf5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:42.697822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1fe04-9dec-4e47-924b-91c4e571cf5f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-59c1fe04-9dec-4e47-924b-91c4e571cf5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:42.724267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:42.725184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:42.726512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:42.726512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:42.726512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:42.726512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:42.726512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 315/620] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:42.731492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1fe04-9dec-4e47-924b-91c4e571cf5f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:42.776390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c1c21-31ca-42fc-966e-565a50b2fc79 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:42.796452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:42.816740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22656fb-e475-420b-932c-8987a7271def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:42.817856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22656fb-e475-420b-932c-8987a7271def None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:42.818384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22656fb-e475-420b-932c-8987a7271def None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:42.818877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22656fb-e475-420b-932c-8987a7271def None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:42.829875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22656fb-e475-420b-932c-8987a7271def None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:42.831645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22656fb-e475-420b-932c-8987a7271def None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c22656fb-e475-420b-932c-8987a7271def None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:42.849593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:42.850565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:42.851462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:42.851462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:42.851462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:42.851462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:42.853675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 306/621] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:42.858121 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1fe04-9dec-4e47-924b-91c4e571cf5f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:42.860655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b81b2-e3fe-4ee2-b2b7-24528e67e4fb None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:42.861164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b81b2-e3fe-4ee2-b2b7-24528e67e4fb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:42.861657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b81b2-e3fe-4ee2-b2b7-24528e67e4fb None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:42.863468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 307/622] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:42.864424 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b81b2-e3fe-4ee2-b2b7-24528e67e4fb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:42.894804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:42.900025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812c036-c843-4f72-8a07-4d6884b01813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:42.902279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812c036-c843-4f72-8a07-4d6884b01813 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:42.902279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812c036-c843-4f72-8a07-4d6884b01813 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:42.902279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812c036-c843-4f72-8a07-4d6884b01813 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:42.903111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812c036-c843-4f72-8a07-4d6884b01813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:42.903380 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812c036-c843-4f72-8a07-4d6884b01813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:42.904843 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812c036-c843-4f72-8a07-4d6884b01813 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:42.922443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 316/623] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:42.924116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd55fe-f68d-4a3a-a4a3-90e0a0886d01 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:42.924613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd55fe-f68d-4a3a-a4a3-90e0a0886d01 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:42.925095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd55fe-f68d-4a3a-a4a3-90e0a0886d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:42.944944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d6fd55fe-f68d-4a3a-a4a3-90e0a0886d01 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:42.946657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d6fd55fe-f68d-4a3a-a4a3-90e0a0886d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:42.992932 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b81b2-e3fe-4ee2-b2b7-24528e67e4fb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.025511 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 317/624] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:43.026868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd55fe-f68d-4a3a-a4a3-90e0a0886d01 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:43.030901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44020e82-9c49-40f1-837a-6d5c39749692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:43.031216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44020e82-9c49-40f1-837a-6d5c39749692 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.031443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44020e82-9c49-40f1-837a-6d5c39749692 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.031716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44020e82-9c49-40f1-837a-6d5c39749692 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.032453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44020e82-9c49-40f1-837a-6d5c39749692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:43.032765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44020e82-9c49-40f1-837a-6d5c39749692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:43.034138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44020e82-9c49-40f1-837a-6d5c39749692 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:43.046284 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 308/625] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:43.052659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44020e82-9c49-40f1-837a-6d5c39749692 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:43.089110 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:43.146663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd55fe-f68d-4a3a-a4a3-90e0a0886d01 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.167775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44020e82-9c49-40f1-837a-6d5c39749692 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.172672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:43.186822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c25a5f-97e0-48ac-bc6c-033977e76989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:43.188172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c25a5f-97e0-48ac-bc6c-033977e76989 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.188593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c25a5f-97e0-48ac-bc6c-033977e76989 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.188869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c25a5f-97e0-48ac-bc6c-033977e76989 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.197159 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c25a5f-97e0-48ac-bc6c-033977e76989 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:43.198616 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c25a5f-97e0-48ac-bc6c-033977e76989 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:43.204881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f001d-8639-44cc-ab93-09a4ebd033e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:43.205683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f001d-8639-44cc-ab93-09a4ebd033e1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.205972 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f001d-8639-44cc-ab93-09a4ebd033e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.206251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f001d-8639-44cc-ab93-09a4ebd033e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.213448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f001d-8639-44cc-ab93-09a4ebd033e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-51c25a5f-97e0-48ac-bc6c-033977e76989 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:43.214286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:43.215217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:43.216204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:43.216204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:43.216204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:43.216204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:43.216204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:43.216204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:43.216204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:43.216204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:43.216204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 16:55:43.216204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:43.217358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f001d-8639-44cc-ab93-09a4ebd033e1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:43.217430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 318/626] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:43.217430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c25a5f-97e0-48ac-bc6c-033977e76989 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-a55f001d-8639-44cc-ab93-09a4ebd033e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:43.235651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:43.236584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:43.237507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:43.237507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:43.237507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:43.237507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:43.237507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:43.237507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:43.237507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:43.237507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:43.237507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 309/627] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:43.238801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a386d11-716e-45b6-b25c-9a3b38c3c67b None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.238801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a386d11-716e-45b6-b25c-9a3b38c3c67b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.238801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a386d11-716e-45b6-b25c-9a3b38c3c67b None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.242493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 310/628] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:43.242493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a386d11-716e-45b6-b25c-9a3b38c3c67b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:43.332068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c25a5f-97e0-48ac-bc6c-033977e76989 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.336683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:43.351093 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a386d11-716e-45b6-b25c-9a3b38c3c67b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.371707 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626e457-3366-4a1b-9e51-a0fdc6b78fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:43.372535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626e457-3366-4a1b-9e51-a0fdc6b78fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.372825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626e457-3366-4a1b-9e51-a0fdc6b78fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.373100 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626e457-3366-4a1b-9e51-a0fdc6b78fb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.386046 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626e457-3366-4a1b-9e51-a0fdc6b78fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:43.392693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b154bf-c864-4fb2-aff5-80557b62255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:43.393691 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b154bf-c864-4fb2-aff5-80557b62255c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-7626e457-3366-4a1b-9e51-a0fdc6b78fb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:43.394104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:43.395232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:43.396267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 319/629] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:43.397126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626e457-3366-4a1b-9e51-a0fdc6b78fb3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:43.397316 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b154bf-c864-4fb2-aff5-80557b62255c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.397762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b154bf-c864-4fb2-aff5-80557b62255c None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.398827 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b154bf-c864-4fb2-aff5-80557b62255c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:43.399546 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b154bf-c864-4fb2-aff5-80557b62255c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:43.402105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b154bf-c864-4fb2-aff5-80557b62255c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:43.425555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 311/630] 10.222.0.49 () {56 vars in 1137 bytes} [Mon May 23 16:55:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:43.427725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927ed55-758e-47de-8846-ae82cd87263b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.428321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927ed55-758e-47de-8846-ae82cd87263b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.428761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927ed55-758e-47de-8846-ae82cd87263b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.442175 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:43.449088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9927ed55-758e-47de-8846-ae82cd87263b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:43.450571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9927ed55-758e-47de-8846-ae82cd87263b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:43.501200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626e457-3366-4a1b-9e51-a0fdc6b78fb3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.525396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 312/631] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:43.526634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927ed55-758e-47de-8846-ae82cd87263b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:43.552579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851bb5f-db79-4580-b61d-1e5ef0ddb4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:43.553254 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851bb5f-db79-4580-b61d-1e5ef0ddb4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.553544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851bb5f-db79-4580-b61d-1e5ef0ddb4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.553845 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851bb5f-db79-4580-b61d-1e5ef0ddb4b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.554672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851bb5f-db79-4580-b61d-1e5ef0ddb4b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:43.555245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851bb5f-db79-4580-b61d-1e5ef0ddb4b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:43.556406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851bb5f-db79-4580-b61d-1e5ef0ddb4b8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:43.574095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 320/632] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:43.574095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851bb5f-db79-4580-b61d-1e5ef0ddb4b8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:43.612639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:43.635802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927ed55-758e-47de-8846-ae82cd87263b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.668718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851bb5f-db79-4580-b61d-1e5ef0ddb4b8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.670004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5c31f-47d9-4b37-a1c2-c8a8ab0fc1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:43.670390 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:43.670831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5c31f-47d9-4b37-a1c2-c8a8ab0fc1fd None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.670960 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5c31f-47d9-4b37-a1c2-c8a8ab0fc1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.671232 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5c31f-47d9-4b37-a1c2-c8a8ab0fc1fd None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.672825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5c31f-47d9-4b37-a1c2-c8a8ab0fc1fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:43.673141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5c31f-47d9-4b37-a1c2-c8a8ab0fc1fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:43.674546 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5c31f-47d9-4b37-a1c2-c8a8ab0fc1fd None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:43.682403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 313/633] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:43.683180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5c31f-47d9-4b37-a1c2-c8a8ab0fc1fd None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:43.705390 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0afdf-f918-4980-ad49-4c50e6206b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:43.706042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0afdf-f918-4980-ad49-4c50e6206b73 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.706325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0afdf-f918-4980-ad49-4c50e6206b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.706627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0afdf-f918-4980-ad49-4c50e6206b73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.774111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0afdf-f918-4980-ad49-4c50e6206b73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:43.775621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0afdf-f918-4980-ad49-4c50e6206b73 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:43.782884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5c31f-47d9-4b37-a1c2-c8a8ab0fc1fd None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.816923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d564b-4845-4c58-ae7d-ba252618bfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:43.817717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d564b-4845-4c58-ae7d-ba252618bfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.818008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d564b-4845-4c58-ae7d-ba252618bfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.818289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d564b-4845-4c58-ae7d-ba252618bfc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.825242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:43.830281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d564b-4845-4c58-ae7d-ba252618bfc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-418d564b-4845-4c58-ae7d-ba252618bfc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:43.838403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:43.839356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:43.840207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 314/634] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:43.840900 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4531fc-1788-4d62-9ff1-ea99a1c7e76f None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.841583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4531fc-1788-4d62-9ff1-ea99a1c7e76f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.841583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4531fc-1788-4d62-9ff1-ea99a1c7e76f None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.842843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 315/635] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:43.844060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4531fc-1788-4d62-9ff1-ea99a1c7e76f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:43.878909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 321/636] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:43.879742 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0afdf-f918-4980-ad49-4c50e6206b73 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:43.882015 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:43.948850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4531fc-1788-4d62-9ff1-ea99a1c7e76f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.979026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0afdf-f918-4980-ad49-4c50e6206b73 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.983798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2d3a9-19db-40de-8d78-6ffadf420820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:43.985341 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2d3a9-19db-40de-8d78-6ffadf420820 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.985629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2d3a9-19db-40de-8d78-6ffadf420820 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.985905 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2d3a9-19db-40de-8d78-6ffadf420820 None admin] PATH_INFO: `/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/c22f94b1abe248c3969b68e17755f113/roles/3d6cf7264f664a20a5a635d4d11c3e1a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.000096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2d3a9-19db-40de-8d78-6ffadf420820 None admin] RBAC: Authorizing `identity:create_grant(project_id=733d8651e4a74a2ab694091d9fd83e49, user_id=c22f94b1abe248c3969b68e17755f113, role_id=3d6cf7264f664a20a5a635d4d11c3e1a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.001610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2d3a9-19db-40de-8d78-6ffadf420820 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.012923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc98edc-3098-4829-b52f-d4e458b8924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.013708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc98edc-3098-4829-b52f-d4e458b8924b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.013805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 316/637] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:55:43 2022] PUT /identity/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/c22f94b1abe248c3969b68e17755f113/roles/3d6cf7264f664a20a5a635d4d11c3e1a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:44.013988 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc98edc-3098-4829-b52f-d4e458b8924b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.014256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc98edc-3098-4829-b52f-d4e458b8924b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.014588 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2d3a9-19db-40de-8d78-6ffadf420820 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.030261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc98edc-3098-4829-b52f-d4e458b8924b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.032442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc98edc-3098-4829-b52f-d4e458b8924b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-4cc98edc-3098-4829-b52f-d4e458b8924b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:44.052189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:44.053180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:44.054553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:44.054553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:44.054553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:44.054553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:44.054553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 322/638] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:44.055086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2fe18-d522-49f0-ba23-0efa0666c6a3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.055086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2fe18-d522-49f0-ba23-0efa0666c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.055343 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2fe18-d522-49f0-ba23-0efa0666c6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.072061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-96b2fe18-d522-49f0-ba23-0efa0666c6a3 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:44.073277 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-96b2fe18-d522-49f0-ba23-0efa0666c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:44.076041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:44.134904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:44.137098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2d3a9-19db-40de-8d78-6ffadf420820 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.166540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 323/639] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:44.167836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2fe18-d522-49f0-ba23-0efa0666c6a3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.176017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c2635-cd6f-4181-98bf-061b03a21fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.176699 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c2635-cd6f-4181-98bf-061b03a21fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.176983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c2635-cd6f-4181-98bf-061b03a21fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.177261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c2635-cd6f-4181-98bf-061b03a21fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.178031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c2635-cd6f-4181-98bf-061b03a21fe4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:44.178338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c2635-cd6f-4181-98bf-061b03a21fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.179769 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c2635-cd6f-4181-98bf-061b03a21fe4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.189589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 317/640] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:44.190448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c2635-cd6f-4181-98bf-061b03a21fe4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.287008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2fe18-d522-49f0-ba23-0efa0666c6a3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.313612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c2635-cd6f-4181-98bf-061b03a21fe4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.323834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a5fd9-91d0-420e-9f46-a9a360a5d6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.324887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a5fd9-91d0-420e-9f46-a9a360a5d6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.325166 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a5fd9-91d0-420e-9f46-a9a360a5d6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.325436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a5fd9-91d0-420e-9f46-a9a360a5d6b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.326584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:44.336485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a5fd9-91d0-420e-9f46-a9a360a5d6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.337920 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a5fd9-91d0-420e-9f46-a9a360a5d6b8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.353676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a14637-906c-4788-bcad-0a7f129b7bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.354668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a14637-906c-4788-bcad-0a7f129b7bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.355165 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a14637-906c-4788-bcad-0a7f129b7bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-cb2a5fd9-91d0-420e-9f46-a9a360a5d6b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:44.355477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:44.356342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:44.357235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:44.357235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:44.357235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:44.357235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:44.357235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 324/641] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:44.357508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a5fd9-91d0-420e-9f46-a9a360a5d6b8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.358204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a14637-906c-4788-bcad-0a7f129b7bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.359595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a14637-906c-4788-bcad-0a7f129b7bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:44.359962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a14637-906c-4788-bcad-0a7f129b7bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.361475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a14637-906c-4788-bcad-0a7f129b7bc8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.375038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 318/642] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:44.375970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a14637-906c-4788-bcad-0a7f129b7bc8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.400175 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:44.474149 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a5fd9-91d0-420e-9f46-a9a360a5d6b8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.484211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a14637-906c-4788-bcad-0a7f129b7bc8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.512907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf8d9-5bb0-494c-86e8-3d6bdfbabeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.513693 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf8d9-5bb0-494c-86e8-3d6bdfbabeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.513973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf8d9-5bb0-494c-86e8-3d6bdfbabeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.514255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf8d9-5bb0-494c-86e8-3d6bdfbabeb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.522452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891b7cf-d73c-4fa7-a827-b8ccaff99517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.523249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891b7cf-d73c-4fa7-a827-b8ccaff99517 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.523536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891b7cf-d73c-4fa7-a827-b8ccaff99517 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.523812 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891b7cf-d73c-4fa7-a827-b8ccaff99517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.525396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cf8d9-5bb0-494c-86e8-3d6bdfbabeb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-fd4cf8d9-5bb0-494c-86e8-3d6bdfbabeb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:44.533572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:44.534928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:44.535809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 325/643] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:44.536518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf8d9-5bb0-494c-86e8-3d6bdfbabeb7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.540662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891b7cf-d73c-4fa7-a827-b8ccaff99517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.542192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891b7cf-d73c-4fa7-a827-b8ccaff99517 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-f891b7cf-d73c-4fa7-a827-b8ccaff99517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:44.561128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:44.562714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:44.563918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:44.563918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:44.563918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:44.563918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:44.563918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 319/644] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:44.564219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891b7cf-d73c-4fa7-a827-b8ccaff99517 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.594638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:44.641057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:44.649809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf8d9-5bb0-494c-86e8-3d6bdfbabeb7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.678862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891b7cf-d73c-4fa7-a827-b8ccaff99517 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.687889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ead4e-08d7-4ab1-af1e-f47c4def5d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.689181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ead4e-08d7-4ab1-af1e-f47c4def5d78 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.689542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ead4e-08d7-4ab1-af1e-f47c4def5d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.689823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ead4e-08d7-4ab1-af1e-f47c4def5d78 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.690615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ead4e-08d7-4ab1-af1e-f47c4def5d78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:44.690929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ead4e-08d7-4ab1-af1e-f47c4def5d78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.692290 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ead4e-08d7-4ab1-af1e-f47c4def5d78 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.706406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 326/645] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:44.706406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ead4e-08d7-4ab1-af1e-f47c4def5d78 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.720458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955a9b3-1f75-4510-ad59-105e4ced52df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.721254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955a9b3-1f75-4510-ad59-105e4ced52df None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.721541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955a9b3-1f75-4510-ad59-105e4ced52df None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.721825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955a9b3-1f75-4510-ad59-105e4ced52df None admin] PATH_INFO: `/v3/users/nova` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.729095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955a9b3-1f75-4510-ad59-105e4ced52df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.730551 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955a9b3-1f75-4510-ad59-105e4ced52df None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c955a9b3-1f75-4510-ad59-105e4ced52df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:44.744752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:44.745894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:44.747072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:44.747072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:44.747072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:44.747072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:44.747072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:44.747072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:44.747072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:44.747072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:44.747072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:55:44.747072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:44.750884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 320/646] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:44.751969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955a9b3-1f75-4510-ad59-105e4ced52df None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.823668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ead4e-08d7-4ab1-af1e-f47c4def5d78 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.846846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:44.860600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdbbc8-5a0f-4af1-bf46-f8b9c1a737b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdbbc8-5a0f-4af1-bf46-f8b9c1a737b4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.861550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdbbc8-5a0f-4af1-bf46-f8b9c1a737b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.861842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdbbc8-5a0f-4af1-bf46-f8b9c1a737b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.862609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdbbc8-5a0f-4af1-bf46-f8b9c1a737b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:44.862922 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdbbc8-5a0f-4af1-bf46-f8b9c1a737b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.864273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdbbc8-5a0f-4af1-bf46-f8b9c1a737b4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.866852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955a9b3-1f75-4510-ad59-105e4ced52df None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.877629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 327/647] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:44.877629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdbbc8-5a0f-4af1-bf46-f8b9c1a737b4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.897089 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:44.908575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbd097-b777-4d52-a5af-f804d656fa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.909245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbd097-b777-4d52-a5af-f804d656fa30 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.909533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbd097-b777-4d52-a5af-f804d656fa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.909811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbd097-b777-4d52-a5af-f804d656fa30 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.910565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbd097-b777-4d52-a5af-f804d656fa30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:44.910944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbd097-b777-4d52-a5af-f804d656fa30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.912348 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbd097-b777-4d52-a5af-f804d656fa30 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.928624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 321/648] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:44.928624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbd097-b777-4d52-a5af-f804d656fa30 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.986492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdbbc8-5a0f-4af1-bf46-f8b9c1a737b4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.021245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb47a8-7251-49d0-9fdd-b1f05ceacd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.022040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb47a8-7251-49d0-9fdd-b1f05ceacd12 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.022325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb47a8-7251-49d0-9fdd-b1f05ceacd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.022632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb47a8-7251-49d0-9fdd-b1f05ceacd12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.028127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbd097-b777-4d52-a5af-f804d656fa30 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.029655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb47a8-7251-49d0-9fdd-b1f05ceacd12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.031670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb47a8-7251-49d0-9fdd-b1f05ceacd12 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-22cb47a8-7251-49d0-9fdd-b1f05ceacd12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:45.045761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:45.047528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:45.048424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:45.048424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:45.048424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:45.048424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:45.048424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:45.048424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:45.048424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:45.048424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:45.048424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 328/649] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:45.048424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb47a8-7251-49d0-9fdd-b1f05ceacd12 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.069217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d884a-8f9b-4479-a616-9513562768db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.069892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d884a-8f9b-4479-a616-9513562768db None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.070192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d884a-8f9b-4479-a616-9513562768db None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.070497 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d884a-8f9b-4479-a616-9513562768db None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.071347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d884a-8f9b-4479-a616-9513562768db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:45.071665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d884a-8f9b-4479-a616-9513562768db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.073094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d884a-8f9b-4479-a616-9513562768db None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.089146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:45.097614 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 322/650] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:45.098513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d884a-8f9b-4479-a616-9513562768db None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.138552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:45.162647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb47a8-7251-49d0-9fdd-b1f05ceacd12 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.198991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4e03e-441c-438d-ab5a-ea16833f5257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.200044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4e03e-441c-438d-ab5a-ea16833f5257 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.200338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4e03e-441c-438d-ab5a-ea16833f5257 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.200601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4e03e-441c-438d-ab5a-ea16833f5257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.206317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d884a-8f9b-4479-a616-9513562768db None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.212467 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4e03e-441c-438d-ab5a-ea16833f5257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.214566 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4e03e-441c-438d-ab5a-ea16833f5257 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-d0a4e03e-441c-438d-ab5a-ea16833f5257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:45.238943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:45.239868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:45.240771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:45.240771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:45.240771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:45.240771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:45.246179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 329/651] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:45.246179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4e03e-441c-438d-ab5a-ea16833f5257 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.246744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efded726-2ce7-4d80-9acc-6b9c449a7216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.247545 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efded726-2ce7-4d80-9acc-6b9c449a7216 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.247831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efded726-2ce7-4d80-9acc-6b9c449a7216 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.248107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efded726-2ce7-4d80-9acc-6b9c449a7216 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.255827 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efded726-2ce7-4d80-9acc-6b9c449a7216 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.257296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efded726-2ce7-4d80-9acc-6b9c449a7216 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-efded726-2ce7-4d80-9acc-6b9c449a7216 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:45.273853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:45.275067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:45.276495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:45.276495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:45.276495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:45.276495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:45.276495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:45.276495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:45.276495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:45.276495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:45.276495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 16:55:45.276495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:45.276495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 323/652] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:45.276495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efded726-2ce7-4d80-9acc-6b9c449a7216 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.342255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:45.358459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4e03e-441c-438d-ab5a-ea16833f5257 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.387933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:45.392430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efded726-2ce7-4d80-9acc-6b9c449a7216 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.395580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51434b5a-92d2-4a9c-a3a2-4133ea5a2dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.396251 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51434b5a-92d2-4a9c-a3a2-4133ea5a2dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.396536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51434b5a-92d2-4a9c-a3a2-4133ea5a2dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.396813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51434b5a-92d2-4a9c-a3a2-4133ea5a2dd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.397602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51434b5a-92d2-4a9c-a3a2-4133ea5a2dd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:45.397913 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51434b5a-92d2-4a9c-a3a2-4133ea5a2dd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.399358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51434b5a-92d2-4a9c-a3a2-4133ea5a2dd7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.418055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 330/653] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:45.418055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51434b5a-92d2-4a9c-a3a2-4133ea5a2dd7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.429159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa675ebe-a131-4773-815e-2aa53448cdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.429817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa675ebe-a131-4773-815e-2aa53448cdbe None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.430162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa675ebe-a131-4773-815e-2aa53448cdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.430477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa675ebe-a131-4773-815e-2aa53448cdbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.498951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa675ebe-a131-4773-815e-2aa53448cdbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.500849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa675ebe-a131-4773-815e-2aa53448cdbe None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.520008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51434b5a-92d2-4a9c-a3a2-4133ea5a2dd7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.555478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cfb53-6313-44e3-9894-fe647e42f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.556139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cfb53-6313-44e3-9894-fe647e42f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.556425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cfb53-6313-44e3-9894-fe647e42f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.556701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cfb53-6313-44e3-9894-fe647e42f3c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.557417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cfb53-6313-44e3-9894-fe647e42f3c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:45.557720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cfb53-6313-44e3-9894-fe647e42f3c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.559102 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cfb53-6313-44e3-9894-fe647e42f3c9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.560192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:45.571582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 331/654] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:45.572641 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cfb53-6313-44e3-9894-fe647e42f3c9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.609756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 324/655] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:45.610947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa675ebe-a131-4773-815e-2aa53448cdbe None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.628894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:45.680474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cfb53-6313-44e3-9894-fe647e42f3c9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.713835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa675ebe-a131-4773-815e-2aa53448cdbe None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.715615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8310a-b478-4569-9a77-f95cce9b2952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.716289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8310a-b478-4569-9a77-f95cce9b2952 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.716568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8310a-b478-4569-9a77-f95cce9b2952 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.716841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8310a-b478-4569-9a77-f95cce9b2952 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.717674 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8310a-b478-4569-9a77-f95cce9b2952 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:45.717979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8310a-b478-4569-9a77-f95cce9b2952 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.719952 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8310a-b478-4569-9a77-f95cce9b2952 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.738611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 332/656] 10.222.0.49 () {56 vars in 1139 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:45.739426 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8310a-b478-4569-9a77-f95cce9b2952 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.755199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422f6dd-533f-487a-a253-071fa33ac8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.756082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422f6dd-533f-487a-a253-071fa33ac8fa None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.756515 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422f6dd-533f-487a-a253-071fa33ac8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.756952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422f6dd-533f-487a-a253-071fa33ac8fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.757796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422f6dd-533f-487a-a253-071fa33ac8fa None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=a6a5b9c982724df0b88ce6ad46dc37e6) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:45.758112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422f6dd-533f-487a-a253-071fa33ac8fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.759584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422f6dd-533f-487a-a253-071fa33ac8fa None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.765867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 325/657] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/role_assignments?user.id=a6a5b9c982724df0b88ce6ad46dc37e6&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:45.766775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422f6dd-533f-487a-a253-071fa33ac8fa None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.807578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:45.899834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8310a-b478-4569-9a77-f95cce9b2952 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.909375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422f6dd-533f-487a-a253-071fa33ac8fa None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.915082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:45.947370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515ac7c-6f7e-4792-9a9f-06f1220526ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.948268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515ac7c-6f7e-4792-9a9f-06f1220526ee None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.948553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515ac7c-6f7e-4792-9a9f-06f1220526ee None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.948830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515ac7c-6f7e-4792-9a9f-06f1220526ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.951568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d833ed1-2041-4077-af6e-c4da73db2d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.953550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d833ed1-2041-4077-af6e-c4da73db2d0d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.954226 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d833ed1-2041-4077-af6e-c4da73db2d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.954601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d833ed1-2041-4077-af6e-c4da73db2d0d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.964551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d833ed1-2041-4077-af6e-c4da73db2d0d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.966318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d833ed1-2041-4077-af6e-c4da73db2d0d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.970335 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515ac7c-6f7e-4792-9a9f-06f1220526ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.972065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515ac7c-6f7e-4792-9a9f-06f1220526ee None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-8d833ed1-2041-4077-af6e-c4da73db2d0d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:45.984441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:45.985406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:45.986335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:45.986335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:45.986335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:45.986335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:45.986335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:45.986335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:45.986335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:45.986335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:45.986335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:55:45.986335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:45.990554 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 333/658] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:45.991407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d833ed1-2041-4077-af6e-c4da73db2d0d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c515ac7c-6f7e-4792-9a9f-06f1220526ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:45.992368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:45.993220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:45.996015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:45.996015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:45.996015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:45.996015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:45.996015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 326/659] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:45.996015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515ac7c-6f7e-4792-9a9f-06f1220526ee None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:46.093757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:46.119336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d833ed1-2041-4077-af6e-c4da73db2d0d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:46.133047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515ac7c-6f7e-4792-9a9f-06f1220526ee None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:46.163680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e12c62-abeb-4c37-9934-973e3ef0fe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:46.164338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e12c62-abeb-4c37-9934-973e3ef0fe1e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.165012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e12c62-abeb-4c37-9934-973e3ef0fe1e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.165311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e12c62-abeb-4c37-9934-973e3ef0fe1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.180272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa398a6e-7915-4592-97bf-06c65e552166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:46.180954 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398a6e-7915-4592-97bf-06c65e552166 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.181238 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398a6e-7915-4592-97bf-06c65e552166 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.181899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398a6e-7915-4592-97bf-06c65e552166 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.182815 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa398a6e-7915-4592-97bf-06c65e552166 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:46.183376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa398a6e-7915-4592-97bf-06c65e552166 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:46.185067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa398a6e-7915-4592-97bf-06c65e552166 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:46.210094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:46.211983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 327/660] 10.222.0.49 () {56 vars in 1137 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:46.212903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa398a6e-7915-4592-97bf-06c65e552166 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:46.252572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e12c62-abeb-4c37-9934-973e3ef0fe1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:46.254790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e12c62-abeb-4c37-9934-973e3ef0fe1e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:46.335651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa398a6e-7915-4592-97bf-06c65e552166 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:46.362647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 334/661] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:46.362647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e12c62-abeb-4c37-9934-973e3ef0fe1e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:46.376916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a27ad-674d-47be-8f0a-9ee730d28319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:46.377555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a27ad-674d-47be-8f0a-9ee730d28319 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.377837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a27ad-674d-47be-8f0a-9ee730d28319 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.378113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a27ad-674d-47be-8f0a-9ee730d28319 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.378864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a27ad-674d-47be-8f0a-9ee730d28319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:46.379239 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a27ad-674d-47be-8f0a-9ee730d28319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:46.380533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a27ad-674d-47be-8f0a-9ee730d28319 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:46.382022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:46.393924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 328/662] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:46.399563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f51960-ef89-4f2c-a79a-576434ddff2d None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.399861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f51960-ef89-4f2c-a79a-576434ddff2d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.400140 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f51960-ef89-4f2c-a79a-576434ddff2d None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.402042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 329/663] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:46.406949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f51960-ef89-4f2c-a79a-576434ddff2d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:46.437110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:46.473489 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e12c62-abeb-4c37-9934-973e3ef0fe1e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:46.511580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1351cd-6a74-402d-a830-9094244b302a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:46.512231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1351cd-6a74-402d-a830-9094244b302a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.512516 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1351cd-6a74-402d-a830-9094244b302a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.512792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1351cd-6a74-402d-a830-9094244b302a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.514190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f51960-ef89-4f2c-a79a-576434ddff2d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:46.551303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588aa488-eaca-4915-86ea-8a5d83e9c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:46.552093 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aa488-eaca-4915-86ea-8a5d83e9c7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.552376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aa488-eaca-4915-86ea-8a5d83e9c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.552649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aa488-eaca-4915-86ea-8a5d83e9c7a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.564442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588aa488-eaca-4915-86ea-8a5d83e9c7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:46.565891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588aa488-eaca-4915-86ea-8a5d83e9c7a0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-588aa488-eaca-4915-86ea-8a5d83e9c7a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:46.584524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:46.585616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:46.586580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:46.586580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:46.586580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:46.586580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:46.586580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 330/664] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:46.586580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588aa488-eaca-4915-86ea-8a5d83e9c7a0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:46.593163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1351cd-6a74-402d-a830-9094244b302a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:46.594645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1351cd-6a74-402d-a830-9094244b302a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:46.638421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:46.664086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:46.697587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588aa488-eaca-4915-86ea-8a5d83e9c7a0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:46.699770 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 335/665] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:46.700929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20ccb2-3cc8-49dc-b567-44b0cca166a5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.701227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20ccb2-3cc8-49dc-b567-44b0cca166a5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.701508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20ccb2-3cc8-49dc-b567-44b0cca166a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.719208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9b20ccb2-3cc8-49dc-b567-44b0cca166a5 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:46.720409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9b20ccb2-3cc8-49dc-b567-44b0cca166a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:46.738697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e9fb3-5a4d-49a6-8b2d-3047bdf42d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:46.739490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e9fb3-5a4d-49a6-8b2d-3047bdf42d74 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.739775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e9fb3-5a4d-49a6-8b2d-3047bdf42d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.740053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e9fb3-5a4d-49a6-8b2d-3047bdf42d74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.746855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e9fb3-5a4d-49a6-8b2d-3047bdf42d74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:46.748369 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e9fb3-5a4d-49a6-8b2d-3047bdf42d74 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-919e9fb3-5a4d-49a6-8b2d-3047bdf42d74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:46.763250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:46.764200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:46.765633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:46.765633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:46.765633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:46.765633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:46.765633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:46.765633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:46.765633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:46.765633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:46.765633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 331/666] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:46.766151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e9fb3-5a4d-49a6-8b2d-3047bdf42d74 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:46.800848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 336/667] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:46.811401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20ccb2-3cc8-49dc-b567-44b0cca166a5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:46.879056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e9fb3-5a4d-49a6-8b2d-3047bdf42d74 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:46.887500 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:46.915361 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:46.918183 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0868f1-3b91-4ee0-8536-c7d6b50478c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:46.918874 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0868f1-3b91-4ee0-8536-c7d6b50478c5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.919157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0868f1-3b91-4ee0-8536-c7d6b50478c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.919434 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0868f1-3b91-4ee0-8536-c7d6b50478c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.919549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20ccb2-3cc8-49dc-b567-44b0cca166a5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:46.920151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0868f1-3b91-4ee0-8536-c7d6b50478c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:46.920459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0868f1-3b91-4ee0-8536-c7d6b50478c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:46.923104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0868f1-3b91-4ee0-8536-c7d6b50478c5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:46.939116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 332/668] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:46.939116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0868f1-3b91-4ee0-8536-c7d6b50478c5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:46.964442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36abd15-59f4-4331-9614-1b9046d1c49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:46.965270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36abd15-59f4-4331-9614-1b9046d1c49e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.965552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36abd15-59f4-4331-9614-1b9046d1c49e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.965825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36abd15-59f4-4331-9614-1b9046d1c49e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.976408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36abd15-59f4-4331-9614-1b9046d1c49e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:46.977838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36abd15-59f4-4331-9614-1b9046d1c49e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-c36abd15-59f4-4331-9614-1b9046d1c49e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:46.995155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:46.996055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:46.996953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:46.996953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:46.996953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:46.996953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:46.996953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 337/669] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:46.997227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36abd15-59f4-4331-9614-1b9046d1c49e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:47.053107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0868f1-3b91-4ee0-8536-c7d6b50478c5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:47.091044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69b4b2-9e99-4915-84fd-865148b918e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:47.091706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69b4b2-9e99-4915-84fd-865148b918e5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:47.091989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69b4b2-9e99-4915-84fd-865148b918e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:47.092262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69b4b2-9e99-4915-84fd-865148b918e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:47.093587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69b4b2-9e99-4915-84fd-865148b918e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:47.094057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69b4b2-9e99-4915-84fd-865148b918e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:47.095707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69b4b2-9e99-4915-84fd-865148b918e5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:47.107552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36abd15-59f4-4331-9614-1b9046d1c49e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:47.113203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 333/670] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:47.113203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69b4b2-9e99-4915-84fd-865148b918e5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:47.138819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:47.157289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e729-4085-41b0-b842-6ab2fce3e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:47.158698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e729-4085-41b0-b842-6ab2fce3e51d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:47.159168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e729-4085-41b0-b842-6ab2fce3e51d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:47.159772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e729-4085-41b0-b842-6ab2fce3e51d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:47.173536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771e729-4085-41b0-b842-6ab2fce3e51d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e771e729-4085-41b0-b842-6ab2fce3e51d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:47.182425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:47.183348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:47.184191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 338/671] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:47.184918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e729-4085-41b0-b842-6ab2fce3e51d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:47.200399 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:47.222354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69b4b2-9e99-4915-84fd-865148b918e5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:47.258042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9f56f-cf0c-40fe-bb00-074a6bbbe922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:47.258990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9f56f-cf0c-40fe-bb00-074a6bbbe922 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:47.259375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9f56f-cf0c-40fe-bb00-074a6bbbe922 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:47.259744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9f56f-cf0c-40fe-bb00-074a6bbbe922 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:47.266721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9f56f-cf0c-40fe-bb00-074a6bbbe922 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:47.268283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9f56f-cf0c-40fe-bb00-074a6bbbe922 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-55a9f56f-cf0c-40fe-bb00-074a6bbbe922 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:47.282976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:47.284111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:47.285188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:47.285188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:47.285188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:47.285188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:47.285188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:47.285188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:47.285188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:47.285188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:47.286165 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 334/672] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:47.286800 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9f56f-cf0c-40fe-bb00-074a6bbbe922 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:47.302596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e729-4085-41b0-b842-6ab2fce3e51d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:47.338878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dc5e0-a062-4ee2-a407-579b7914f231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:47.339754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dc5e0-a062-4ee2-a407-579b7914f231 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:47.340037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dc5e0-a062-4ee2-a407-579b7914f231 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:47.340309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dc5e0-a062-4ee2-a407-579b7914f231 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:47.341017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8dc5e0-a062-4ee2-a407-579b7914f231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:47.341325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8dc5e0-a062-4ee2-a407-579b7914f231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:47.342697 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8dc5e0-a062-4ee2-a407-579b7914f231 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:47.356537 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 339/673] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:47.357492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dc5e0-a062-4ee2-a407-579b7914f231 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:47.386777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:47.403446 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9f56f-cf0c-40fe-bb00-074a6bbbe922 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:47.435561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:47.438724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1003eb-2db9-4356-b826-b804b02fb7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:47.439383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1003eb-2db9-4356-b826-b804b02fb7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:47.439804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1003eb-2db9-4356-b826-b804b02fb7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:47.440089 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1003eb-2db9-4356-b826-b804b02fb7a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:47.440925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1003eb-2db9-4356-b826-b804b02fb7a7 None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=9884780c88aa48ffa92a696740761387) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:47.441241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1003eb-2db9-4356-b826-b804b02fb7a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:47.442703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1003eb-2db9-4356-b826-b804b02fb7a7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:47.448712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 335/674] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:47 2022] GET /identity/v3/role_assignments?user.id=9884780c88aa48ffa92a696740761387&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:47.449735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1003eb-2db9-4356-b826-b804b02fb7a7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:47.481231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dc5e0-a062-4ee2-a407-579b7914f231 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:47.530428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0140721-5c13-458b-9005-c2fab8dda4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:47.531576 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0140721-5c13-458b-9005-c2fab8dda4fb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:47.531880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0140721-5c13-458b-9005-c2fab8dda4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:47.532167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0140721-5c13-458b-9005-c2fab8dda4fb None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:47.532953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0140721-5c13-458b-9005-c2fab8dda4fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:47.533273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0140721-5c13-458b-9005-c2fab8dda4fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:47.534814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0140721-5c13-458b-9005-c2fab8dda4fb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:47.550552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 340/675] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:47.551737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0140721-5c13-458b-9005-c2fab8dda4fb None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:47.581806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1003eb-2db9-4356-b826-b804b02fb7a7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:47.620869 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ef021-0869-4d76-abce-e01f8b84446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:47.621849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ef021-0869-4d76-abce-e01f8b84446e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:47.622313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ef021-0869-4d76-abce-e01f8b84446e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:47.622793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ef021-0869-4d76-abce-e01f8b84446e None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:47.623797 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ef021-0869-4d76-abce-e01f8b84446e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:47.624405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ef021-0869-4d76-abce-e01f8b84446e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:47.626692 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ef021-0869-4d76-abce-e01f8b84446e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:47.642391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 336/676] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:47.643559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ef021-0869-4d76-abce-e01f8b84446e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:47.661756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:47.709100 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0140721-5c13-458b-9005-c2fab8dda4fb None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:47.744295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:47.749856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff64f8-de76-49ca-a8e9-b948e1aff93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:47.751087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff64f8-de76-49ca-a8e9-b948e1aff93e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:47.751682 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff64f8-de76-49ca-a8e9-b948e1aff93e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:47.752157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff64f8-de76-49ca-a8e9-b948e1aff93e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:47.760369 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff64f8-de76-49ca-a8e9-b948e1aff93e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:47.761908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff64f8-de76-49ca-a8e9-b948e1aff93e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e5ff64f8-de76-49ca-a8e9-b948e1aff93e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:47.786514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:47.787395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:47.788278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:47.788278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:47.788278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:47.788278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:47.788278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:47.788278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:47.788278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:47.788278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:47.788278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 341/677] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:47.788792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ef021-0869-4d76-abce-e01f8b84446e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:47.789341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff64f8-de76-49ca-a8e9-b948e1aff93e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:47.835983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e3020-5083-49ee-966a-a35d3be87830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:47.836783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e3020-5083-49ee-966a-a35d3be87830 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:47.837072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e3020-5083-49ee-966a-a35d3be87830 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:47.837806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e3020-5083-49ee-966a-a35d3be87830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:47.852006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e3020-5083-49ee-966a-a35d3be87830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:47.854141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e3020-5083-49ee-966a-a35d3be87830 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ad0e3020-5083-49ee-966a-a35d3be87830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:47.878706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:47.879645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:47.880532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:47.880532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:47.880532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:47.880532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:47.880532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 337/678] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:47.885148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e3020-5083-49ee-966a-a35d3be87830 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:47.907213 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff64f8-de76-49ca-a8e9-b948e1aff93e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:47.966595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:48.015221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e3020-5083-49ee-966a-a35d3be87830 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.054749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dad97-e71b-4f2e-b6d3-95f7cb56bfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.056205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dad97-e71b-4f2e-b6d3-95f7cb56bfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.057095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dad97-e71b-4f2e-b6d3-95f7cb56bfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.057567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dad97-e71b-4f2e-b6d3-95f7cb56bfc1 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.058866 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dad97-e71b-4f2e-b6d3-95f7cb56bfc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:48.059368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dad97-e71b-4f2e-b6d3-95f7cb56bfc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.062533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dad97-e71b-4f2e-b6d3-95f7cb56bfc1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.080673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 338/679] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:48.081912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dad97-e71b-4f2e-b6d3-95f7cb56bfc1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.090716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72163b43-f16e-4ed5-80db-85e2d51d9c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.092142 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72163b43-f16e-4ed5-80db-85e2d51d9c92 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.092641 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72163b43-f16e-4ed5-80db-85e2d51d9c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.093185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72163b43-f16e-4ed5-80db-85e2d51d9c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.094658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72163b43-f16e-4ed5-80db-85e2d51d9c92 None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=73bdfedb6d9e4ddab18a8143ba7142fc) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:48.095165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72163b43-f16e-4ed5-80db-85e2d51d9c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.097438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72163b43-f16e-4ed5-80db-85e2d51d9c92 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.112410 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 342/680] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:47 2022] GET /identity/v3/role_assignments?user.id=73bdfedb6d9e4ddab18a8143ba7142fc&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:48.112410 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72163b43-f16e-4ed5-80db-85e2d51d9c92 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.215426 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:48.250287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dad97-e71b-4f2e-b6d3-95f7cb56bfc1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.271447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72163b43-f16e-4ed5-80db-85e2d51d9c92 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.284338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:48.301434 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654f550-d8b2-4a65-8d5f-ff77980e1ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.302056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654f550-d8b2-4a65-8d5f-ff77980e1ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.302348 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654f550-d8b2-4a65-8d5f-ff77980e1ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.302675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654f550-d8b2-4a65-8d5f-ff77980e1ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.303421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654f550-d8b2-4a65-8d5f-ff77980e1ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:48.303734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654f550-d8b2-4a65-8d5f-ff77980e1ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.305331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654f550-d8b2-4a65-8d5f-ff77980e1ea4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.318981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126f355-77ce-458a-8bb0-bd330289b2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.319741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126f355-77ce-458a-8bb0-bd330289b2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.322513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126f355-77ce-458a-8bb0-bd330289b2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.322513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126f355-77ce-458a-8bb0-bd330289b2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.322513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126f355-77ce-458a-8bb0-bd330289b2c7 None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=c91dcf97796941718e251912271aea71) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:48.322513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126f355-77ce-458a-8bb0-bd330289b2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.322804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 339/681] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:48.323591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e856b-dadc-462b-b098-8374663b9282 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.323890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e856b-dadc-462b-b098-8374663b9282 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.324417 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e856b-dadc-462b-b098-8374663b9282 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.325804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 340/682] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:48.327014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126f355-77ce-458a-8bb0-bd330289b2c7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.331998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6ec7b-4545-4d09-a9a6-0338b1da5e3c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.332466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6ec7b-4545-4d09-a9a6-0338b1da5e3c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.332884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6ec7b-4545-4d09-a9a6-0338b1da5e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.335184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 343/683] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:48 2022] GET /identity/v3/role_assignments?user.id=c91dcf97796941718e251912271aea71&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:48.336212 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126f355-77ce-458a-8bb0-bd330289b2c7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.354054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c5a6ec7b-4545-4d09-a9a6-0338b1da5e3c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:48.355695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c5a6ec7b-4545-4d09-a9a6-0338b1da5e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:48.454266 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 341/684] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:55:48.475005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126f355-77ce-458a-8bb0-bd330289b2c7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.480577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6ec7b-4545-4d09-a9a6-0338b1da5e3c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.501683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:48.519824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5469f-515c-4a86-9193-68d4c8f17354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.521020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5469f-515c-4a86-9193-68d4c8f17354 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.521530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5469f-515c-4a86-9193-68d4c8f17354 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.522005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5469f-515c-4a86-9193-68d4c8f17354 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.531968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5469f-515c-4a86-9193-68d4c8f17354 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.533798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5469f-515c-4a86-9193-68d4c8f17354 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f0e5469f-515c-4a86-9193-68d4c8f17354 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:48.550738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:48.551720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:48.552655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:48.552655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:48.552655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:48.552655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:48.552655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:48.552655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:48.552655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:48.552655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:48.552655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 16:55:48.552655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:48.555302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 344/685] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:55:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:48.562177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5469f-515c-4a86-9193-68d4c8f17354 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.598444 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6ec7b-4545-4d09-a9a6-0338b1da5e3c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.615121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:48.638112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdeb4c9-cf3a-4a76-aae6-bce9ad0d2cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.639178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeb4c9-cf3a-4a76-aae6-bce9ad0d2cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.639618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeb4c9-cf3a-4a76-aae6-bce9ad0d2cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.640123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeb4c9-cf3a-4a76-aae6-bce9ad0d2cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.650967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdeb4c9-cf3a-4a76-aae6-bce9ad0d2cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.652636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdeb4c9-cf3a-4a76-aae6-bce9ad0d2cc6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-bfdeb4c9-cf3a-4a76-aae6-bce9ad0d2cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:48.672246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:48.673404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:48.674555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:48.674555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:48.674555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:48.674555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:48.676495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 342/686] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:48.680295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5469f-515c-4a86-9193-68d4c8f17354 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.683008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdeb4c9-cf3a-4a76-aae6-bce9ad0d2cc6 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.727101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf0db2-ce46-45eb-b2b4-4e55fb8b1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.728258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf0db2-ce46-45eb-b2b4-4e55fb8b1d94 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.728774 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf0db2-ce46-45eb-b2b4-4e55fb8b1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.729316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf0db2-ce46-45eb-b2b4-4e55fb8b1d94 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.730416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf0db2-ce46-45eb-b2b4-4e55fb8b1d94 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:48.730974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf0db2-ce46-45eb-b2b4-4e55fb8b1d94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.732668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf0db2-ce46-45eb-b2b4-4e55fb8b1d94 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.754758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 345/687] 10.222.0.49 () {56 vars in 1135 bytes} [Mon May 23 16:55:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:48.763708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf0db2-ce46-45eb-b2b4-4e55fb8b1d94 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.821182 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:48.828305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdeb4c9-cf3a-4a76-aae6-bce9ad0d2cc6 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.869406 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c39bd-c523-4f51-a53c-159f5fea68a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.870233 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c39bd-c523-4f51-a53c-159f5fea68a9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.870544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c39bd-c523-4f51-a53c-159f5fea68a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.870889 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c39bd-c523-4f51-a53c-159f5fea68a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.871688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c39bd-c523-4f51-a53c-159f5fea68a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:48.871996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c39bd-c523-4f51-a53c-159f5fea68a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.873369 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c39bd-c523-4f51-a53c-159f5fea68a9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.886700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf0db2-ce46-45eb-b2b4-4e55fb8b1d94 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.888092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 343/688] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:48.895553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c39bd-c523-4f51-a53c-159f5fea68a9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.923994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f59f5-6810-4877-9949-31026cadeed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.924766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f59f5-6810-4877-9949-31026cadeed0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.925056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f59f5-6810-4877-9949-31026cadeed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.925334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f59f5-6810-4877-9949-31026cadeed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.937674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:48.999722 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f59f5-6810-4877-9949-31026cadeed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.001525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f59f5-6810-4877-9949-31026cadeed0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.042817 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:49.094534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c39bd-c523-4f51-a53c-159f5fea68a9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.112815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 346/689] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:49.114084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f59f5-6810-4877-9949-31026cadeed0 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.170529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8512f-99b0-406d-9d69-e043efd1b612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.171856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8512f-99b0-406d-9d69-e043efd1b612 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.172147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8512f-99b0-406d-9d69-e043efd1b612 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.172425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8512f-99b0-406d-9d69-e043efd1b612 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.173284 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8512f-99b0-406d-9d69-e043efd1b612 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.174775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8512f-99b0-406d-9d69-e043efd1b612 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.211254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 344/690] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:55:48 2022] POST /identity/v3/users => generated 254 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:49.254787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f59f5-6810-4877-9949-31026cadeed0 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.317313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfbfe0-886a-4667-9d6f-6ab53e92a58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.318049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfbfe0-886a-4667-9d6f-6ab53e92a58c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.318330 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfbfe0-886a-4667-9d6f-6ab53e92a58c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.318628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfbfe0-886a-4667-9d6f-6ab53e92a58c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.333786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:49.344848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfbfe0-886a-4667-9d6f-6ab53e92a58c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.346752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfbfe0-886a-4667-9d6f-6ab53e92a58c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-eabfbfe0-886a-4667-9d6f-6ab53e92a58c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:49.368493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:49.369478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:49.370429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:49.370429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:49.370429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:49.370429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:49.370429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 347/691] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:49.376035 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8512f-99b0-406d-9d69-e043efd1b612 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.497317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:49.523355 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8512f-99b0-406d-9d69-e043efd1b612 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.559243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d15ac-7714-41c2-aa7d-f532bae369a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.560281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d15ac-7714-41c2-aa7d-f532bae369a3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.560775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d15ac-7714-41c2-aa7d-f532bae369a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.561278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d15ac-7714-41c2-aa7d-f532bae369a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.563057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d15ac-7714-41c2-aa7d-f532bae369a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:49.563591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d15ac-7714-41c2-aa7d-f532bae369a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.565201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d15ac-7714-41c2-aa7d-f532bae369a3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.579579 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 345/692] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:49.584689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfbfe0-886a-4667-9d6f-6ab53e92a58c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.694181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfbfe0-886a-4667-9d6f-6ab53e92a58c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.732410 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfa1df-c538-45c7-a0eb-9643b4e5a560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.734091 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfa1df-c538-45c7-a0eb-9643b4e5a560 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.734689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfa1df-c538-45c7-a0eb-9643b4e5a560 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.735341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfa1df-c538-45c7-a0eb-9643b4e5a560 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.742816 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfa1df-c538-45c7-a0eb-9643b4e5a560 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.744525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfa1df-c538-45c7-a0eb-9643b4e5a560 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-05cfa1df-c538-45c7-a0eb-9643b4e5a560 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:49.759391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:49.760745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:49.761628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:49.761628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:49.761628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:49.761628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:49.761628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:49.761628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:49.761628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:49.761628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:49.764211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 348/693] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:49.772946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d15ac-7714-41c2-aa7d-f532bae369a3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.884042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d15ac-7714-41c2-aa7d-f532bae369a3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.924567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7340c-0432-4e16-ad22-fab60f3e99bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.925257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7340c-0432-4e16-ad22-fab60f3e99bc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.925602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7340c-0432-4e16-ad22-fab60f3e99bc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.925887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7340c-0432-4e16-ad22-fab60f3e99bc None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.926743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7340c-0432-4e16-ad22-fab60f3e99bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:49.927061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7340c-0432-4e16-ad22-fab60f3e99bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.928547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7340c-0432-4e16-ad22-fab60f3e99bc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.943019 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:49.943345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 346/694] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:49.950528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfa1df-c538-45c7-a0eb-9643b4e5a560 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:50.006793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:50.060496 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfa1df-c538-45c7-a0eb-9643b4e5a560 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:50.093664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8fce-36b8-4c52-b329-f36e56cb7777 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:50.093973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8fce-36b8-4c52-b329-f36e56cb7777 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:50.094234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8fce-36b8-4c52-b329-f36e56cb7777 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:50.096816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 347/695] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:50.101249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cdcba-657f-4c5b-a161-4562c59a2c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:50.102121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc113a-c40d-431e-a484-a6c09678b111 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:50.102394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cdcba-657f-4c5b-a161-4562c59a2c58 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:50.102498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc113a-c40d-431e-a484-a6c09678b111 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:50.102718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc113a-c40d-431e-a484-a6c09678b111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:50.103184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cdcba-657f-4c5b-a161-4562c59a2c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:50.103651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cdcba-657f-4c5b-a161-4562c59a2c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:50.104789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cdcba-657f-4c5b-a161-4562c59a2c58 None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=c22f94b1abe248c3969b68e17755f113) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:50.105399 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cdcba-657f-4c5b-a161-4562c59a2c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:50.107139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cdcba-657f-4c5b-a161-4562c59a2c58 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:50.119371 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 349/696] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:49 2022] GET /identity/v3/role_assignments?user.id=c22f94b1abe248c3969b68e17755f113&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:50.121079 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f4cc113a-c40d-431e-a484-a6c09678b111 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:50.122309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f4cc113a-c40d-431e-a484-a6c09678b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:50.202495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 348/697] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:55:50.227194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cdcba-657f-4c5b-a161-4562c59a2c58 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:50.386684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cdcba-657f-4c5b-a161-4562c59a2c58 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:50.402438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:50.424786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064ccc7-c1eb-406d-9640-4f764fe59513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:50.425638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064ccc7-c1eb-406d-9640-4f764fe59513 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:50.426023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064ccc7-c1eb-406d-9640-4f764fe59513 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:50.426306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064ccc7-c1eb-406d-9640-4f764fe59513 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:50.437680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064ccc7-c1eb-406d-9640-4f764fe59513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-1064ccc7-c1eb-406d-9640-4f764fe59513 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:50.445670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:50.446647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:50.447494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 350/698] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:55:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:50.454303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc113a-c40d-431e-a484-a6c09678b111 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:50.587894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc113a-c40d-431e-a484-a6c09678b111 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:50.619132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:50.632973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5500208-196a-4f73-81a8-ae941dea7ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:50.633670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5500208-196a-4f73-81a8-ae941dea7ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:50.633962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5500208-196a-4f73-81a8-ae941dea7ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:50.634244 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5500208-196a-4f73-81a8-ae941dea7ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:50.635047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5500208-196a-4f73-81a8-ae941dea7ed3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:50.635362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5500208-196a-4f73-81a8-ae941dea7ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:50.636799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5500208-196a-4f73-81a8-ae941dea7ed3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:50.646533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 349/699] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:50.651768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064ccc7-c1eb-406d-9640-4f764fe59513 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:50.775140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064ccc7-c1eb-406d-9640-4f764fe59513 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:50.828467 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cc363-d684-4b32-95f3-a676dcf86e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:50.829307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc363-d684-4b32-95f3-a676dcf86e61 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:50.829596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc363-d684-4b32-95f3-a676dcf86e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:50.829879 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc363-d684-4b32-95f3-a676dcf86e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:50.848744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cc363-d684-4b32-95f3-a676dcf86e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:50.850193 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cc363-d684-4b32-95f3-a676dcf86e61 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-bc2cc363-d684-4b32-95f3-a676dcf86e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:50.876393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:50.877360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:50.878727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:50.878727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:50.878727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:50.878727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:50.878727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 351/700] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:50.883124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5500208-196a-4f73-81a8-ae941dea7ed3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:51.006554 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f9bce-afa1-43c4-9d99-a644d24bc50c None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:51.006886 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f9bce-afa1-43c4-9d99-a644d24bc50c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:51.007218 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f9bce-afa1-43c4-9d99-a644d24bc50c None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:51.009040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 352/701] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:55:51.018395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f1685-a1ee-4001-b7d0-0f4d7a1b510d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:51.018395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f1685-a1ee-4001-b7d0-0f4d7a1b510d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:51.018395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f1685-a1ee-4001-b7d0-0f4d7a1b510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:51.032820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7d4f1685-a1ee-4001-b7d0-0f4d7a1b510d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:51.033869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7d4f1685-a1ee-4001-b7d0-0f4d7a1b510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:51.035203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5500208-196a-4f73-81a8-ae941dea7ed3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:51.070812 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:51.096603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c90a7-f9cb-4f87-aca5-f7ed3471285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:51.097275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c90a7-f9cb-4f87-aca5-f7ed3471285c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:51.097557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c90a7-f9cb-4f87-aca5-f7ed3471285c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:51.097829 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c90a7-f9cb-4f87-aca5-f7ed3471285c None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:51.098632 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c90a7-f9cb-4f87-aca5-f7ed3471285c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:51.098941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c90a7-f9cb-4f87-aca5-f7ed3471285c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:51.103063 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c90a7-f9cb-4f87-aca5-f7ed3471285c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:51.123789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 350/702] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:51.127971 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 353/703] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:55:51.135433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c90a7-f9cb-4f87-aca5-f7ed3471285c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:51.183689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f1685-a1ee-4001-b7d0-0f4d7a1b510d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:51.220694 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:51.297199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f1685-a1ee-4001-b7d0-0f4d7a1b510d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:51.308377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c90a7-f9cb-4f87-aca5-f7ed3471285c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:51.351418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20884f4e-04c6-423a-922e-bc42010f23db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:51.352223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20884f4e-04c6-423a-922e-bc42010f23db None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:51.352514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20884f4e-04c6-423a-922e-bc42010f23db None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:51.352788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20884f4e-04c6-423a-922e-bc42010f23db None admin] PATH_INFO: `/v3/users/nova` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:51.361071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08294e55-911d-45ba-9cdd-85125ad0042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:51.361875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08294e55-911d-45ba-9cdd-85125ad0042b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:51.362156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08294e55-911d-45ba-9cdd-85125ad0042b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:51.362452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08294e55-911d-45ba-9cdd-85125ad0042b None admin] PATH_INFO: `/v3/services/network` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:51.363112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08294e55-911d-45ba-9cdd-85125ad0042b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:51.364473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08294e55-911d-45ba-9cdd-85125ad0042b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:51.365919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20884f4e-04c6-423a-922e-bc42010f23db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:51.367356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20884f4e-04c6-423a-922e-bc42010f23db None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-08294e55-911d-45ba-9cdd-85125ad0042b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:51.382612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:51.383853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:55:51.384906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:51.385636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 354/704] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:51 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:51.395863 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08294e55-911d-45ba-9cdd-85125ad0042b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-20884f4e-04c6-423a-922e-bc42010f23db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:51.401522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:51.403021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 351/705] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 23 16:55:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d5342-492b-4b6d-8980-837eba077e4d None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:51.405005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d5342-492b-4b6d-8980-837eba077e4d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:51.406556 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d5342-492b-4b6d-8980-837eba077e4d None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:51.406556 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 352/706] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:51.408285 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d5342-492b-4b6d-8980-837eba077e4d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:51.428095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:51.529244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08294e55-911d-45ba-9cdd-85125ad0042b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:51.541046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d5342-492b-4b6d-8980-837eba077e4d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:51.563855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:51.574555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc26b8d-8125-42d1-8ba6-c5edb92dcc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:51.575365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc26b8d-8125-42d1-8ba6-c5edb92dcc35 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:51.575753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc26b8d-8125-42d1-8ba6-c5edb92dcc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:51.576128 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc26b8d-8125-42d1-8ba6-c5edb92dcc35 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:51.576955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc26b8d-8125-42d1-8ba6-c5edb92dcc35 None admin] RBAC: Adding query filter params (name=network) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:51.577413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc26b8d-8125-42d1-8ba6-c5edb92dcc35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:51.579126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc26b8d-8125-42d1-8ba6-c5edb92dcc35 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:51.584517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 355/707] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:55:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:51.586273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2f374-50fc-4329-afcb-1b9a457a872f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:51.586533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2f374-50fc-4329-afcb-1b9a457a872f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:51.586911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2f374-50fc-4329-afcb-1b9a457a872f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:51.591761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f8634-529a-4847-beef-fb6bb605a041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:51.593406 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f8634-529a-4847-beef-fb6bb605a041 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:51.594618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f8634-529a-4847-beef-fb6bb605a041 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:51.594925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f8634-529a-4847-beef-fb6bb605a041 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:51.595790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f8634-529a-4847-beef-fb6bb605a041 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:51.596109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f8634-529a-4847-beef-fb6bb605a041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:51.597559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f8634-529a-4847-beef-fb6bb605a041 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:51.612231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-cde2f374-50fc-4329-afcb-1b9a457a872f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:51.614226 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cde2f374-50fc-4329-afcb-1b9a457a872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:51.621270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 353/708] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 23 16:55:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:51.621270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f8634-529a-4847-beef-fb6bb605a041 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:51.690104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 356/709] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:51.691233 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2f374-50fc-4329-afcb-1b9a457a872f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:51.706705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:51.750374 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f8634-529a-4847-beef-fb6bb605a041 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:51.798152 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2f374-50fc-4329-afcb-1b9a457a872f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:51.801590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f87423-4619-4d76-96dc-7d8ac29675e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:51.802824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f87423-4619-4d76-96dc-7d8ac29675e1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:51.802824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f87423-4619-4d76-96dc-7d8ac29675e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:51.803236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f87423-4619-4d76-96dc-7d8ac29675e1 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:51.804106 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f87423-4619-4d76-96dc-7d8ac29675e1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:51.804559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f87423-4619-4d76-96dc-7d8ac29675e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:51.806028 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f87423-4619-4d76-96dc-7d8ac29675e1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:51.814292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 354/710] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:55:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:51.815490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f87423-4619-4d76-96dc-7d8ac29675e1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:51.839937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc3a3c-2670-4323-8698-8bc3ddee2f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:51.840881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc3a3c-2670-4323-8698-8bc3ddee2f33 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:51.841323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc3a3c-2670-4323-8698-8bc3ddee2f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:51.841783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc3a3c-2670-4323-8698-8bc3ddee2f33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:51.877171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:51.931113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc3a3c-2670-4323-8698-8bc3ddee2f33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:51.933140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc3a3c-2670-4323-8698-8bc3ddee2f33 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:51.951610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:52.063396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 357/711] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:52.064658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc3a3c-2670-4323-8698-8bc3ddee2f33 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:52.084390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f87423-4619-4d76-96dc-7d8ac29675e1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:52.146435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794dcd9-1d9f-449c-9842-e1f81a4615d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:52.147596 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794dcd9-1d9f-449c-9842-e1f81a4615d6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:52.148076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794dcd9-1d9f-449c-9842-e1f81a4615d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:52.148516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794dcd9-1d9f-449c-9842-e1f81a4615d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:52.149323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794dcd9-1d9f-449c-9842-e1f81a4615d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:52.150960 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794dcd9-1d9f-449c-9842-e1f81a4615d6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-0794dcd9-1d9f-449c-9842-e1f81a4615d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:52.177152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:52.178379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:55:52.179471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:52.182218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 355/712] 10.222.0.49 () {56 vars in 1129 bytes} [Mon May 23 16:55:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:52.201376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794dcd9-1d9f-449c-9842-e1f81a4615d6 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:52.218507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc3a3c-2670-4323-8698-8bc3ddee2f33 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:52.251708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:52.319740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05f0be-c75e-48cf-97e9-2c4336e63348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:52.320474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05f0be-c75e-48cf-97e9-2c4336e63348 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:52.320757 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05f0be-c75e-48cf-97e9-2c4336e63348 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:52.321031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05f0be-c75e-48cf-97e9-2c4336e63348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:52.340014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05f0be-c75e-48cf-97e9-2c4336e63348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:52.340635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:52.341458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05f0be-c75e-48cf-97e9-2c4336e63348 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:52.344770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794dcd9-1d9f-449c-9842-e1f81a4615d6 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-cb05f0be-c75e-48cf-97e9-2c4336e63348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:52.364008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:52.364962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:52.365931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:52.365931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:52.365931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:52.365931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:52.365931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 358/713] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:52.371978 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05f0be-c75e-48cf-97e9-2c4336e63348 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:52.420094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e559195-9895-415f-a968-861334459279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:52.420771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e559195-9895-415f-a968-861334459279 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:52.421136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e559195-9895-415f-a968-861334459279 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:52.421423 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e559195-9895-415f-a968-861334459279 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:52.422236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e559195-9895-415f-a968-861334459279 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:52.422570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e559195-9895-415f-a968-861334459279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:52.423949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e559195-9895-415f-a968-861334459279 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:52.436267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 356/714] 10.222.0.49 () {56 vars in 1124 bytes} [Mon May 23 16:55:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:52.440706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e559195-9895-415f-a968-861334459279 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:52.529990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05f0be-c75e-48cf-97e9-2c4336e63348 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:52.571503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e559195-9895-415f-a968-861334459279 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:52.572016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698002e-4721-494c-9043-2b394f45aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:52.572586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698002e-4721-494c-9043-2b394f45aefa None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:52.573149 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698002e-4721-494c-9043-2b394f45aefa None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:52.573431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698002e-4721-494c-9043-2b394f45aefa None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:52.575481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698002e-4721-494c-9043-2b394f45aefa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:52.575965 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698002e-4721-494c-9043-2b394f45aefa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:52.578728 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698002e-4721-494c-9043-2b394f45aefa None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:52.598857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 359/715] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:52.598857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f317e88-0d1f-4bcb-82fb-a7df14c0c58c None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:52.598857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f317e88-0d1f-4bcb-82fb-a7df14c0c58c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:52.598857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f317e88-0d1f-4bcb-82fb-a7df14c0c58c None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:52.602795 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 360/716] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:52.603910 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f317e88-0d1f-4bcb-82fb-a7df14c0c58c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:52.617376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86c1ad-8168-4dac-9d5f-876809646e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:52.618413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c1ad-8168-4dac-9d5f-876809646e19 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:52.618925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c1ad-8168-4dac-9d5f-876809646e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:52.619433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c1ad-8168-4dac-9d5f-876809646e19 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:52.620372 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86c1ad-8168-4dac-9d5f-876809646e19 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:52.620865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86c1ad-8168-4dac-9d5f-876809646e19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:52.622475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86c1ad-8168-4dac-9d5f-876809646e19 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:52.628738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 357/717] 10.222.0.49 () {56 vars in 1124 bytes} [Mon May 23 16:55:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:52.630200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ba651-6159-45bf-b4af-c14f87f6d493 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:52.630649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ba651-6159-45bf-b4af-c14f87f6d493 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:52.631065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ba651-6159-45bf-b4af-c14f87f6d493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:52.651543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e33ba651-6159-45bf-b4af-c14f87f6d493 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:52.653127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e33ba651-6159-45bf-b4af-c14f87f6d493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:52.654265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:52.678121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:52.735092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 358/718] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:52.767584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ba651-6159-45bf-b4af-c14f87f6d493 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:52.861743 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f317e88-0d1f-4bcb-82fb-a7df14c0c58c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:52.931738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078912f-3158-4771-aa19-4809d5e6956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:52.932540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078912f-3158-4771-aa19-4809d5e6956e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:52.932826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078912f-3158-4771-aa19-4809d5e6956e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:52.933103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078912f-3158-4771-aa19-4809d5e6956e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:52.942093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078912f-3158-4771-aa19-4809d5e6956e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:52.944754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078912f-3158-4771-aa19-4809d5e6956e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-1078912f-3158-4771-aa19-4809d5e6956e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:52.964162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:52.965080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:52.965964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:52.965964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:52.965964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:52.965964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:52.965964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:52.965964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:52.965964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:52.965964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:52.966417 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ba651-6159-45bf-b4af-c14f87f6d493 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:52.969397 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 361/719] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:52.975594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078912f-3158-4771-aa19-4809d5e6956e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:53.009569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bb75d-7292-42b5-b6aa-52f55cda223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:53.010546 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bb75d-7292-42b5-b6aa-52f55cda223b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:53.010976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bb75d-7292-42b5-b6aa-52f55cda223b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:53.011350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bb75d-7292-42b5-b6aa-52f55cda223b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:53.025380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bb75d-7292-42b5-b6aa-52f55cda223b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-173bb75d-7292-42b5-b6aa-52f55cda223b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:53.034677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:53.035643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:53.036532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:53.036532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:53.036532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:53.036532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:53.036532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:53.036532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:53.036532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:53.036532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:53.036532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:53.036532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:53.036532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:53.036532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:53.041273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 359/720] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:53.042778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c56beb-db49-43a5-a5f8-a1b0b93a0892 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:53.043076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c56beb-db49-43a5-a5f8-a1b0b93a0892 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:53.043361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c56beb-db49-43a5-a5f8-a1b0b93a0892 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:53.045001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 360/721] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:53.045723 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c56beb-db49-43a5-a5f8-a1b0b93a0892 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:53.074025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:53.102758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:53.114462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078912f-3158-4771-aa19-4809d5e6956e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:53.148381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67619076-3e07-4e01-b77c-382d764b61ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:53.149055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67619076-3e07-4e01-b77c-382d764b61ff None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:53.149342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67619076-3e07-4e01-b77c-382d764b61ff None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:53.149620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67619076-3e07-4e01-b77c-382d764b61ff None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:53.150467 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67619076-3e07-4e01-b77c-382d764b61ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:53.150777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67619076-3e07-4e01-b77c-382d764b61ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:53.152248 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67619076-3e07-4e01-b77c-382d764b61ff None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:53.167312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 362/722] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:53.168928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2be55-9f01-4035-9d01-5bf8f685b117 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:53.169226 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2be55-9f01-4035-9d01-5bf8f685b117 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:53.169571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2be55-9f01-4035-9d01-5bf8f685b117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:53.191651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-05f2be55-9f01-4035-9d01-5bf8f685b117 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:53.192989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-05f2be55-9f01-4035-9d01-5bf8f685b117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:53.276052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 363/723] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:53.276942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2be55-9f01-4035-9d01-5bf8f685b117 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:53.344364 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c56beb-db49-43a5-a5f8-a1b0b93a0892 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:53.360304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:53.384375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf0310-dad5-4eb3-a497-b84e8a2c69b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:53.384979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf0310-dad5-4eb3-a497-b84e8a2c69b4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:53.385268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf0310-dad5-4eb3-a497-b84e8a2c69b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:53.385547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf0310-dad5-4eb3-a497-b84e8a2c69b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:53.386041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2be55-9f01-4035-9d01-5bf8f685b117 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:53.386307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf0310-dad5-4eb3-a497-b84e8a2c69b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:53.386652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf0310-dad5-4eb3-a497-b84e8a2c69b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:53.388039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf0310-dad5-4eb3-a497-b84e8a2c69b4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:53.401824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 361/724] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:53.402898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf0310-dad5-4eb3-a497-b84e8a2c69b4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:53.425281 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3aadc-53e5-4e98-bdc0-89497a4ac269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:53.425948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3aadc-53e5-4e98-bdc0-89497a4ac269 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:53.426239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3aadc-53e5-4e98-bdc0-89497a4ac269 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:53.426628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3aadc-53e5-4e98-bdc0-89497a4ac269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:53.427465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3aadc-53e5-4e98-bdc0-89497a4ac269 None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=9884780c88aa48ffa92a696740761387) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:53.427783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3aadc-53e5-4e98-bdc0-89497a4ac269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:53.429223 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3aadc-53e5-4e98-bdc0-89497a4ac269 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:53.435428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 364/725] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:53 2022] GET /identity/v3/role_assignments?user.id=9884780c88aa48ffa92a696740761387&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:53.436301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3aadc-53e5-4e98-bdc0-89497a4ac269 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:53.494438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:53.522294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf0310-dad5-4eb3-a497-b84e8a2c69b4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:53.564869 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782e866-efd6-47d5-825f-d424a8f0440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:53.565735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782e866-efd6-47d5-825f-d424a8f0440b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:53.566023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782e866-efd6-47d5-825f-d424a8f0440b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:53.566349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782e866-efd6-47d5-825f-d424a8f0440b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:53.579242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782e866-efd6-47d5-825f-d424a8f0440b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c782e866-efd6-47d5-825f-d424a8f0440b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:53.587201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:53.588211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:53.589036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 362/726] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:55:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:53.596145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782e866-efd6-47d5-825f-d424a8f0440b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:53.677435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3aadc-53e5-4e98-bdc0-89497a4ac269 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:53.742273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782e866-efd6-47d5-825f-d424a8f0440b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:53.751087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b253e6-fc1f-48c2-a33c-eb6d1912f696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:53.751904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b253e6-fc1f-48c2-a33c-eb6d1912f696 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:53.752194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b253e6-fc1f-48c2-a33c-eb6d1912f696 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:53.752474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b253e6-fc1f-48c2-a33c-eb6d1912f696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:53.774517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:53.785528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774c54-fe26-4899-95fc-1356bfa6f67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:53.786482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774c54-fe26-4899-95fc-1356bfa6f67f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:53.786949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774c54-fe26-4899-95fc-1356bfa6f67f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:53.787400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774c54-fe26-4899-95fc-1356bfa6f67f None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:53.787752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b253e6-fc1f-48c2-a33c-eb6d1912f696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:53.788520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c774c54-fe26-4899-95fc-1356bfa6f67f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:53.789025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c774c54-fe26-4899-95fc-1356bfa6f67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:53.789280 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b253e6-fc1f-48c2-a33c-eb6d1912f696 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:53.790897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c774c54-fe26-4899-95fc-1356bfa6f67f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:53.797719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:53.803174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 363/727] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:53.809842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774c54-fe26-4899-95fc-1356bfa6f67f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-56b253e6-fc1f-48c2-a33c-eb6d1912f696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:53.818535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:53.819422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:53.820318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:53.820318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:53.820318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:53.820318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:53.824606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 365/728] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:53.825895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b253e6-fc1f-48c2-a33c-eb6d1912f696 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:53.991045 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b253e6-fc1f-48c2-a33c-eb6d1912f696 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:54.007632 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774c54-fe26-4899-95fc-1356bfa6f67f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:54.026694 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c7b43-adb4-427a-abd0-b835b0f82143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:54.027633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c7b43-adb4-427a-abd0-b835b0f82143 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:54.028067 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c7b43-adb4-427a-abd0-b835b0f82143 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:54.028504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c7b43-adb4-427a-abd0-b835b0f82143 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:54.029372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c7b43-adb4-427a-abd0-b835b0f82143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:54.029828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c7b43-adb4-427a-abd0-b835b0f82143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:54.031897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c7b43-adb4-427a-abd0-b835b0f82143 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:54.044841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 366/729] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:54.050935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c7b43-adb4-427a-abd0-b835b0f82143 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:54.070672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f96d7c-8a9c-4774-856c-886aadc531e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:54.071480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f96d7c-8a9c-4774-856c-886aadc531e9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:54.071774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f96d7c-8a9c-4774-856c-886aadc531e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:54.072058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f96d7c-8a9c-4774-856c-886aadc531e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:54.097349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f96d7c-8a9c-4774-856c-886aadc531e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:54.098959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f96d7c-8a9c-4774-856c-886aadc531e9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:54.111871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-a9f96d7c-8a9c-4774-856c-886aadc531e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:54.150888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:54.151867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:54.152747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:54.152747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:54.152747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:54.152747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:54.152747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 364/730] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:54.163358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f96d7c-8a9c-4774-856c-886aadc531e9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:54.166118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c7b43-adb4-427a-abd0-b835b0f82143 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:54.217122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcf17f-d780-4358-92fb-1fd2945db1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:54.219564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcf17f-d780-4358-92fb-1fd2945db1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:54.220117 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcf17f-d780-4358-92fb-1fd2945db1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:54.221793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcf17f-d780-4358-92fb-1fd2945db1c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:54.237331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcf17f-d780-4358-92fb-1fd2945db1c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:54.239830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcf17f-d780-4358-92fb-1fd2945db1c6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-8ebcf17f-d780-4358-92fb-1fd2945db1c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:54.269474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:54.270491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:54.271597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:54.271597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:54.271597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:54.271597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:54.271597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:54.271597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:54.271597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:54.271597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:54.271597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:55:54.271597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:54.277856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 367/731] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 23 16:55:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:54.284858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcf17f-d780-4358-92fb-1fd2945db1c6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:54.290084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:54.397724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f96d7c-8a9c-4774-856c-886aadc531e9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:54.452711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28cea-b241-4e16-bdc5-1a184e51f61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:54.453910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28cea-b241-4e16-bdc5-1a184e51f61b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:54.454200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28cea-b241-4e16-bdc5-1a184e51f61b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:54.454522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28cea-b241-4e16-bdc5-1a184e51f61b None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:54.455313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc28cea-b241-4e16-bdc5-1a184e51f61b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:54.455628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc28cea-b241-4e16-bdc5-1a184e51f61b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:54.456643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcf17f-d780-4358-92fb-1fd2945db1c6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:54.457039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc28cea-b241-4e16-bdc5-1a184e51f61b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:54.473300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 365/732] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:54.482091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd6e2b-08c0-40d3-a64a-d1a00dbb5531 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:54.482091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd6e2b-08c0-40d3-a64a-d1a00dbb5531 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:54.482091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd6e2b-08c0-40d3-a64a-d1a00dbb5531 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:54.482402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:54.482484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 366/733] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:54.482484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd6e2b-08c0-40d3-a64a-d1a00dbb5531 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:54.504653 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c67225-9abd-40e5-be1d-92d75d34a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:54.505339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c67225-9abd-40e5-be1d-92d75d34a021 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:54.505606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c67225-9abd-40e5-be1d-92d75d34a021 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:54.505881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c67225-9abd-40e5-be1d-92d75d34a021 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:54.506754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c67225-9abd-40e5-be1d-92d75d34a021 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:54.507065 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c67225-9abd-40e5-be1d-92d75d34a021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:54.508479 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c67225-9abd-40e5-be1d-92d75d34a021 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:54.531360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 368/734] 10.222.0.49 () {56 vars in 1149 bytes} [Mon May 23 16:55:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:54.531360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac699cd0-d037-47a7-9976-66160d37eb40 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:54.531360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac699cd0-d037-47a7-9976-66160d37eb40 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:54.531360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac699cd0-d037-47a7-9976-66160d37eb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:54.548379 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ac699cd0-d037-47a7-9976-66160d37eb40 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:54.549561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ac699cd0-d037-47a7-9976-66160d37eb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:54.618936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd6e2b-08c0-40d3-a64a-d1a00dbb5531 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:54.638008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 369/735] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:54.638008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac699cd0-d037-47a7-9976-66160d37eb40 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:54.639617 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:54.676569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a4c34-3bca-4a81-848d-48cc5161e4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:54.678338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a4c34-3bca-4a81-848d-48cc5161e4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:54.678853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a4c34-3bca-4a81-848d-48cc5161e4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:54.679530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a4c34-3bca-4a81-848d-48cc5161e4c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:54.690022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a4c34-3bca-4a81-848d-48cc5161e4c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:54.692208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a4c34-3bca-4a81-848d-48cc5161e4c7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-5c6a4c34-3bca-4a81-848d-48cc5161e4c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:54.712749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:54.713907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:54.715088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:54.715088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:54.715088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:54.715088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:54.715088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:54.715088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:54.715088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:54.715088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:54.715088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 16:55:54.715088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:54.718290 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 367/736] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:55:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:54.719683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a4c34-3bca-4a81-848d-48cc5161e4c7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:54.763297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:54.769097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac699cd0-d037-47a7-9976-66160d37eb40 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:54.817787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5242993-f70c-4c04-8e84-5b5efcedec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:54.819039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5242993-f70c-4c04-8e84-5b5efcedec80 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:54.819487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5242993-f70c-4c04-8e84-5b5efcedec80 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:54.820414 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5242993-f70c-4c04-8e84-5b5efcedec80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:54.850872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a4c34-3bca-4a81-848d-48cc5161e4c7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:54.899705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5242993-f70c-4c04-8e84-5b5efcedec80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:54.901387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5242993-f70c-4c04-8e84-5b5efcedec80 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:54.902017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62864d2-cfe3-45f0-a884-035bfb39f343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:54.902911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62864d2-cfe3-45f0-a884-035bfb39f343 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:54.903584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62864d2-cfe3-45f0-a884-035bfb39f343 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:54.904007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62864d2-cfe3-45f0-a884-035bfb39f343 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:54.906078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62864d2-cfe3-45f0-a884-035bfb39f343 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:54.907909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62864d2-cfe3-45f0-a884-035bfb39f343 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:54.936735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 368/737] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:55:54 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:54.936735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62864d2-cfe3-45f0-a884-035bfb39f343 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:55.007658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:55.105840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:55.113560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 370/738] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:55.121645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5242993-f70c-4c04-8e84-5b5efcedec80 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:55.196133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62864d2-cfe3-45f0-a884-035bfb39f343 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:55.242957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96087b9-3b7b-4b30-9b2f-16ceea4fa839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:55.243662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96087b9-3b7b-4b30-9b2f-16ceea4fa839 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:55.243941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96087b9-3b7b-4b30-9b2f-16ceea4fa839 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:55.244221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96087b9-3b7b-4b30-9b2f-16ceea4fa839 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:55.245076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96087b9-3b7b-4b30-9b2f-16ceea4fa839 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:55.245511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96087b9-3b7b-4b30-9b2f-16ceea4fa839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:55.247097 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96087b9-3b7b-4b30-9b2f-16ceea4fa839 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:55.269721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 369/739] 10.222.0.49 () {56 vars in 1135 bytes} [Mon May 23 16:55:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:55.275177 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96087b9-3b7b-4b30-9b2f-16ceea4fa839 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:55.276224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5242993-f70c-4c04-8e84-5b5efcedec80 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:55.315997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f3d20-1f70-428f-ab08-1e5fd1d54654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:55.317050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f3d20-1f70-428f-ab08-1e5fd1d54654 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:55.317512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f3d20-1f70-428f-ab08-1e5fd1d54654 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:55.317964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f3d20-1f70-428f-ab08-1e5fd1d54654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:55.331985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f3d20-1f70-428f-ab08-1e5fd1d54654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:55.333455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f3d20-1f70-428f-ab08-1e5fd1d54654 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b40f3d20-1f70-428f-ab08-1e5fd1d54654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:55.355331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:55.356351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:55.357308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:55.357308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:55.357308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:55.357308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:55.357308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 371/740] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:55.359478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc8e25-c85d-4570-a6ad-dbf90a9ea659 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:55.359915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc8e25-c85d-4570-a6ad-dbf90a9ea659 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:55.360342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc8e25-c85d-4570-a6ad-dbf90a9ea659 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:55.363119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 372/741] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:55.367577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc8e25-c85d-4570-a6ad-dbf90a9ea659 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:55.413105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:55.430468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96087b9-3b7b-4b30-9b2f-16ceea4fa839 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:55.436082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:55.476362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1c557-acb7-4392-bdfd-a6044253ccd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:55.477520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1c557-acb7-4392-bdfd-a6044253ccd6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:55.478007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1c557-acb7-4392-bdfd-a6044253ccd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:55.478571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1c557-acb7-4392-bdfd-a6044253ccd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:55.494649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc8e25-c85d-4570-a6ad-dbf90a9ea659 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:55.537713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f3c33-66ef-45de-8f76-8ff4c4364d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:55.538627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f3c33-66ef-45de-8f76-8ff4c4364d4c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:55.539017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f3c33-66ef-45de-8f76-8ff4c4364d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:55.539317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f3c33-66ef-45de-8f76-8ff4c4364d4c None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:55.540126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f3c33-66ef-45de-8f76-8ff4c4364d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:55.540505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f3c33-66ef-45de-8f76-8ff4c4364d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:55.542086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f3c33-66ef-45de-8f76-8ff4c4364d4c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:55.557629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 373/742] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:55.559107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1401c7c-450c-4eaa-ab1b-43563b202edf None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:55.559465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1401c7c-450c-4eaa-ab1b-43563b202edf None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:55.559816 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1401c7c-450c-4eaa-ab1b-43563b202edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:55.567148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1c557-acb7-4392-bdfd-a6044253ccd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:55.568877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1c557-acb7-4392-bdfd-a6044253ccd6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:55.580629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a1401c7c-450c-4eaa-ab1b-43563b202edf None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:55.581981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a1401c7c-450c-4eaa-ab1b-43563b202edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:55.666807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 374/743] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:55 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:55:55.667946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1401c7c-450c-4eaa-ab1b-43563b202edf None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:55.673134 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:55.693810 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 370/744] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:55:55 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:55:55.702389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1c557-acb7-4392-bdfd-a6044253ccd6 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:55.746874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:55.812344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1401c7c-450c-4eaa-ab1b-43563b202edf None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:55.833279 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1c557-acb7-4392-bdfd-a6044253ccd6 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:55.849667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16347e-9876-4705-b62e-8d9a08015d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:55.850667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16347e-9876-4705-b62e-8d9a08015d6b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:55.850950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16347e-9876-4705-b62e-8d9a08015d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:55.851223 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16347e-9876-4705-b62e-8d9a08015d6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:55.858897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16347e-9876-4705-b62e-8d9a08015d6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:55.860481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16347e-9876-4705-b62e-8d9a08015d6b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-cd16347e-9876-4705-b62e-8d9a08015d6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:55.876530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:55.877488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:55.878800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:55.878800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:55.878800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:55.878800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:55.878800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:55.878800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:55.878800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:55.878800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:55.882540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 375/745] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:55.883548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16347e-9876-4705-b62e-8d9a08015d6b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:55.884740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119176ba-203d-40a8-822f-a069e4058802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:55.886216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119176ba-203d-40a8-822f-a069e4058802 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:55.886924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119176ba-203d-40a8-822f-a069e4058802 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:55.887638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119176ba-203d-40a8-822f-a069e4058802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:55.900884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119176ba-203d-40a8-822f-a069e4058802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:55.902911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119176ba-203d-40a8-822f-a069e4058802 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-119176ba-203d-40a8-822f-a069e4058802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:55.926310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:55.927263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:55.928292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:55.928292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:55.928292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:55.928292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:55.934808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 371/746] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:55.936023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119176ba-203d-40a8-822f-a069e4058802 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:55.999365 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:56.000414 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16347e-9876-4705-b62e-8d9a08015d6b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:56.002263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:56.038744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa47ce-fcaa-499c-ad4f-3edb7ff880dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:56.039434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa47ce-fcaa-499c-ad4f-3edb7ff880dd None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:56.039723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa47ce-fcaa-499c-ad4f-3edb7ff880dd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:56.040003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa47ce-fcaa-499c-ad4f-3edb7ff880dd None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:56.040729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa47ce-fcaa-499c-ad4f-3edb7ff880dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:56.042099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa47ce-fcaa-499c-ad4f-3edb7ff880dd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:56.067259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 376/747] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:55:55 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:56.076188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa47ce-fcaa-499c-ad4f-3edb7ff880dd None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:56.082447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119176ba-203d-40a8-822f-a069e4058802 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:56.171668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426c560-d253-4158-84c7-c31e1d401310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:56.173962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c560-d253-4158-84c7-c31e1d401310 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:56.174704 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c560-d253-4158-84c7-c31e1d401310 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:56.176637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c560-d253-4158-84c7-c31e1d401310 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:56.177716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426c560-d253-4158-84c7-c31e1d401310 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:56.178517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426c560-d253-4158-84c7-c31e1d401310 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:56.181210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426c560-d253-4158-84c7-c31e1d401310 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:56.208766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 372/748] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:56.213009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116b4d4-8b7a-47fb-96f1-87a32de9c6c2 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:56.213302 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116b4d4-8b7a-47fb-96f1-87a32de9c6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:56.213577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116b4d4-8b7a-47fb-96f1-87a32de9c6c2 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:56.215181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 373/749] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:56.216721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116b4d4-8b7a-47fb-96f1-87a32de9c6c2 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:56.267032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa47ce-fcaa-499c-ad4f-3edb7ff880dd None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:56.313030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e8a2a-8d0e-4476-9aa1-58c5ddaf7459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:56.314086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e8a2a-8d0e-4476-9aa1-58c5ddaf7459 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:56.314766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e8a2a-8d0e-4476-9aa1-58c5ddaf7459 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:56.315272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e8a2a-8d0e-4476-9aa1-58c5ddaf7459 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:56.316208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e8a2a-8d0e-4476-9aa1-58c5ddaf7459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:56.316823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e8a2a-8d0e-4476-9aa1-58c5ddaf7459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:56.318425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e8a2a-8d0e-4476-9aa1-58c5ddaf7459 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:56.334482 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 377/750] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:56.336889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64489300-53de-4847-9bc6-4d00d1cc34a6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:56.338537 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64489300-53de-4847-9bc6-4d00d1cc34a6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:56.339036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64489300-53de-4847-9bc6-4d00d1cc34a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:56.342082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:56.355097 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116b4d4-8b7a-47fb-96f1-87a32de9c6c2 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:56.359314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-64489300-53de-4847-9bc6-4d00d1cc34a6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:56.360596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-64489300-53de-4847-9bc6-4d00d1cc34a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:56.386189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:56.401409 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95951c53-451b-4f80-9afb-0b87caa0a628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:56.402073 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95951c53-451b-4f80-9afb-0b87caa0a628 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:56.402378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95951c53-451b-4f80-9afb-0b87caa0a628 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:56.402671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95951c53-451b-4f80-9afb-0b87caa0a628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:56.403535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95951c53-451b-4f80-9afb-0b87caa0a628 None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=96230dd16acb4cdfa43b892b2b747282) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:56.403830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95951c53-451b-4f80-9afb-0b87caa0a628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:56.405726 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95951c53-451b-4f80-9afb-0b87caa0a628 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:56.412196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 374/751] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:56 2022] GET /identity/v3/role_assignments?user.id=96230dd16acb4cdfa43b892b2b747282&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:56.414435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95951c53-451b-4f80-9afb-0b87caa0a628 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:56.489097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 378/752] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:55:56.514225 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64489300-53de-4847-9bc6-4d00d1cc34a6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:56.629234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95951c53-451b-4f80-9afb-0b87caa0a628 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:56.653994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64489300-53de-4847-9bc6-4d00d1cc34a6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:56.669816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467af30-ade5-46de-876c-d7e049a09e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:56.672748 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467af30-ade5-46de-876c-d7e049a09e71 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:56.672748 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467af30-ade5-46de-876c-d7e049a09e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:56.672923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467af30-ade5-46de-876c-d7e049a09e71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:56.681440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467af30-ade5-46de-876c-d7e049a09e71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:56.683718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467af30-ade5-46de-876c-d7e049a09e71 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-4467af30-ade5-46de-876c-d7e049a09e71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:56.701479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:56.702481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:56.703383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:56.703383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:56.703383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:56.703383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:56.703383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:56.703383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:56.703383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:56.703383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:56.703383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 375/753] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:56.709882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467af30-ade5-46de-876c-d7e049a09e71 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:56.722310 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161d320-f6f4-4282-9040-e955cb08c546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:56.723143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161d320-f6f4-4282-9040-e955cb08c546 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:56.723420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161d320-f6f4-4282-9040-e955cb08c546 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:56.723694 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161d320-f6f4-4282-9040-e955cb08c546 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:56.740158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161d320-f6f4-4282-9040-e955cb08c546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f161d320-f6f4-4282-9040-e955cb08c546 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:56.747652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:56.748582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:56.749994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:56.749994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:56.749994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:56.749994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:56.749994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:56.749994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:56.749994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:56.749994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:56.749994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:56.749994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:56.749994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:55:56.749994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:56.751322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 379/754] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:55:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:56.756998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161d320-f6f4-4282-9040-e955cb08c546 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:56.757563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:56.781277 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:56.901377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467af30-ade5-46de-876c-d7e049a09e71 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:56.953127 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161d320-f6f4-4282-9040-e955cb08c546 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:56.963788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6c3da-1a9a-4e27-996d-7657aec1ac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:56.964479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6c3da-1a9a-4e27-996d-7657aec1ac15 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:56.964763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6c3da-1a9a-4e27-996d-7657aec1ac15 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:56.965036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6c3da-1a9a-4e27-996d-7657aec1ac15 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:56.965839 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6c3da-1a9a-4e27-996d-7657aec1ac15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:56.966151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6c3da-1a9a-4e27-996d-7657aec1ac15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:56.967636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6c3da-1a9a-4e27-996d-7657aec1ac15 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:56.993614 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e50520-ad44-4a34-a434-359204ded4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:56.994203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e50520-ad44-4a34-a434-359204ded4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:56.994515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e50520-ad44-4a34-a434-359204ded4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:56.994789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e50520-ad44-4a34-a434-359204ded4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:56.995537 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e50520-ad44-4a34-a434-359204ded4d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:56.995842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e50520-ad44-4a34-a434-359204ded4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:56.997190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e50520-ad44-4a34-a434-359204ded4d6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:57.001738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 376/755] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:57.007458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6c3da-1a9a-4e27-996d-7657aec1ac15 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:57.007718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 380/756] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:55:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:57.013957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e50520-ad44-4a34-a434-359204ded4d6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:57.159653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6c3da-1a9a-4e27-996d-7657aec1ac15 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:57.162705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:57.195510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:57.225458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490c081-ac99-440b-a187-8045f536b3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:57.226681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490c081-ac99-440b-a187-8045f536b3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:57.226982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490c081-ac99-440b-a187-8045f536b3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:57.227256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490c081-ac99-440b-a187-8045f536b3a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:57.228106 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490c081-ac99-440b-a187-8045f536b3a3 None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=c22f94b1abe248c3969b68e17755f113) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:57.228415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490c081-ac99-440b-a187-8045f536b3a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:57.229842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490c081-ac99-440b-a187-8045f536b3a3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:57.237672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 377/757] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:55:57 2022] GET /identity/v3/role_assignments?user.id=c22f94b1abe248c3969b68e17755f113&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:57.247853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e50520-ad44-4a34-a434-359204ded4d6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:57.289012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5f85e-9271-4582-b758-c8b4be1be71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:57.289821 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5f85e-9271-4582-b758-c8b4be1be71d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:57.290107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5f85e-9271-4582-b758-c8b4be1be71d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:57.290402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5f85e-9271-4582-b758-c8b4be1be71d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:57.304260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5f85e-9271-4582-b758-c8b4be1be71d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:57.305716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5f85e-9271-4582-b758-c8b4be1be71d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-1fd5f85e-9271-4582-b758-c8b4be1be71d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:57.324524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:57.325459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:57.326391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:57.326391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:57.326391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:57.326391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:57.326391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 381/758] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:55:57.332365 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490c081-ac99-440b-a187-8045f536b3a3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:57.485627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490c081-ac99-440b-a187-8045f536b3a3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:57.531584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c73b0-8a54-4c11-ac55-c7a478cf142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:57.532179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c73b0-8a54-4c11-ac55-c7a478cf142c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:57.532466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c73b0-8a54-4c11-ac55-c7a478cf142c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:57.532806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c73b0-8a54-4c11-ac55-c7a478cf142c None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:57.533539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c73b0-8a54-4c11-ac55-c7a478cf142c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:57.533848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c73b0-8a54-4c11-ac55-c7a478cf142c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:57.535328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c73b0-8a54-4c11-ac55-c7a478cf142c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:57.548907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 378/759] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:57.554538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5f85e-9271-4582-b758-c8b4be1be71d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:57.683258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5f85e-9271-4582-b758-c8b4be1be71d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:57.714779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:57.720518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083549b7-cfff-4b65-b63e-880cf14eca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:57.721331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083549b7-cfff-4b65-b63e-880cf14eca4c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:57.721619 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083549b7-cfff-4b65-b63e-880cf14eca4c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:57.721897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083549b7-cfff-4b65-b63e-880cf14eca4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:57.730224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083549b7-cfff-4b65-b63e-880cf14eca4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:57.731694 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083549b7-cfff-4b65-b63e-880cf14eca4c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-083549b7-cfff-4b65-b63e-880cf14eca4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:55:57.747316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:57.748347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:57.750034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:57.750034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:57.750034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:55:57.750034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:55:57.750034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:55:57.750034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:55:57.750034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:55:57.750034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:55:57.750034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:55:57.750034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:57.753294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 382/760] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 23 16:55:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:57.754090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90326a4-afef-4c94-9335-2d6c463f93d8 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:57.754972 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90326a4-afef-4c94-9335-2d6c463f93d8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:57.755447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90326a4-afef-4c94-9335-2d6c463f93d8 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:57.757232 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 379/761] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:57.761259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083549b7-cfff-4b65-b63e-880cf14eca4c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:57.762851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23258973-7f65-4c27-8ba5-7ab945e69fb0 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:57.763431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23258973-7f65-4c27-8ba5-7ab945e69fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:57.763911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23258973-7f65-4c27-8ba5-7ab945e69fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:57.770329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:57.804779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-23258973-7f65-4c27-8ba5-7ab945e69fb0 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:57.806021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-23258973-7f65-4c27-8ba5-7ab945e69fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:57.908301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083549b7-cfff-4b65-b63e-880cf14eca4c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:57.956786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 380/762] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:55:57.958954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d310f7-7b4e-49f8-9cc3-6c3a8f7caba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:57.959631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d310f7-7b4e-49f8-9cc3-6c3a8f7caba9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:57.959920 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d310f7-7b4e-49f8-9cc3-6c3a8f7caba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:57.960205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d310f7-7b4e-49f8-9cc3-6c3a8f7caba9 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:57.961050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d310f7-7b4e-49f8-9cc3-6c3a8f7caba9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:57.961368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d310f7-7b4e-49f8-9cc3-6c3a8f7caba9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:57.962830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d310f7-7b4e-49f8-9cc3-6c3a8f7caba9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:57.981878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 383/763] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 23 16:55:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:57.987885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23258973-7f65-4c27-8ba5-7ab945e69fb0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:57.989376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d310f7-7b4e-49f8-9cc3-6c3a8f7caba9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:58.037914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:58.097865 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d310f7-7b4e-49f8-9cc3-6c3a8f7caba9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:58.137587 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd814f-3ddc-4c74-a5b0-3caebed232ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:58.138408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd814f-3ddc-4c74-a5b0-3caebed232ac None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:58.138701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd814f-3ddc-4c74-a5b0-3caebed232ac None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:58.138984 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd814f-3ddc-4c74-a5b0-3caebed232ac None admin] PATH_INFO: `/v3/services/network` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:58.139757 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd814f-3ddc-4c74-a5b0-3caebed232ac None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:58.141339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd814f-3ddc-4c74-a5b0-3caebed232ac None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-0ecd814f-3ddc-4c74-a5b0-3caebed232ac None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:58.154007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:58.155118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:55:58.156926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 384/764] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:57 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:58.161509 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd814f-3ddc-4c74-a5b0-3caebed232ac None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:58.227458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23258973-7f65-4c27-8ba5-7ab945e69fb0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:58.275714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd814f-3ddc-4c74-a5b0-3caebed232ac None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:58.286706 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:58.315661 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44d814-f40c-47a6-b952-43fff6f10346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:58.317024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44d814-f40c-47a6-b952-43fff6f10346 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:58.317462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44d814-f40c-47a6-b952-43fff6f10346 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:58.318340 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44d814-f40c-47a6-b952-43fff6f10346 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:58.319437 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44d814-f40c-47a6-b952-43fff6f10346 None admin] RBAC: Adding query filter params (name=network) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:58.320034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44d814-f40c-47a6-b952-43fff6f10346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:58.321543 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44d814-f40c-47a6-b952-43fff6f10346 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:58.328304 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:58.333545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 385/765] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:55:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:58.334691 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44d814-f40c-47a6-b952-43fff6f10346 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:58.348379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03230e-af36-4e35-9758-43fc2535b1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:58.349448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03230e-af36-4e35-9758-43fc2535b1ee None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:58.349925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03230e-af36-4e35-9758-43fc2535b1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:58.350440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03230e-af36-4e35-9758-43fc2535b1ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:58.382514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03230e-af36-4e35-9758-43fc2535b1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:58.384247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03230e-af36-4e35-9758-43fc2535b1ee None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-0d03230e-af36-4e35-9758-43fc2535b1ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:55:58.414377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:58.415482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:58.416657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:55:58.416657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:55:58.416657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:55:58.416657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:58.427757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 381/766] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:58.433537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03230e-af36-4e35-9758-43fc2535b1ee None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:58.444274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44d814-f40c-47a6-b952-43fff6f10346 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:58.483242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197d20c-c5e6-4fa6-a375-89974a65f19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:58.484102 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197d20c-c5e6-4fa6-a375-89974a65f19c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:58.484404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197d20c-c5e6-4fa6-a375-89974a65f19c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:58.484687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197d20c-c5e6-4fa6-a375-89974a65f19c None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:58.485407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197d20c-c5e6-4fa6-a375-89974a65f19c None admin] RBAC: Adding query filter params (type=network) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:58.485719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197d20c-c5e6-4fa6-a375-89974a65f19c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:58.489258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197d20c-c5e6-4fa6-a375-89974a65f19c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:58.494739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 386/767] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:55:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:58.502251 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197d20c-c5e6-4fa6-a375-89974a65f19c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:58.553827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:58.617786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197d20c-c5e6-4fa6-a375-89974a65f19c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:58.659546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dea480-556f-42aa-9057-fa518b5bb7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:58.660219 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dea480-556f-42aa-9057-fa518b5bb7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:58.660512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dea480-556f-42aa-9057-fa518b5bb7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:58.660795 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dea480-556f-42aa-9057-fa518b5bb7f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:58.661594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dea480-556f-42aa-9057-fa518b5bb7f3 None admin] RBAC: Adding query filter params (interface=public, service_id=233aeae4f8b84f1494f2db34e9549f54, region_id=RegionOne) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:58.662172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dea480-556f-42aa-9057-fa518b5bb7f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:58.664086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dea480-556f-42aa-9057-fa518b5bb7f3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:58.679141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 387/768] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 23 16:55:58 2022] GET /identity/v3/endpoints?service_id=233aeae4f8b84f1494f2db34e9549f54&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:58.680571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dea480-556f-42aa-9057-fa518b5bb7f3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:58.706660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03230e-af36-4e35-9758-43fc2535b1ee None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:58.771046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee87c9-d43c-44f6-afc9-121af9faa520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:58.773457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee87c9-d43c-44f6-afc9-121af9faa520 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:58.774666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee87c9-d43c-44f6-afc9-121af9faa520 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:58.775082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee87c9-d43c-44f6-afc9-121af9faa520 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:58.781277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee87c9-d43c-44f6-afc9-121af9faa520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:58.781809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee87c9-d43c-44f6-afc9-121af9faa520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:58.783450 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee87c9-d43c-44f6-afc9-121af9faa520 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:58.805603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 382/769] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:58.811175 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee87c9-d43c-44f6-afc9-121af9faa520 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:58.841723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:58.846594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dea480-556f-42aa-9057-fa518b5bb7f3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:58.910111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:58.912989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fa230-405c-4c4d-9043-1b3130ae71fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:58.914898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fa230-405c-4c4d-9043-1b3130ae71fd None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:58.915321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fa230-405c-4c4d-9043-1b3130ae71fd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:58.915607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fa230-405c-4c4d-9043-1b3130ae71fd None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:58.916324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fa230-405c-4c4d-9043-1b3130ae71fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:58.917833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fa230-405c-4c4d-9043-1b3130ae71fd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:58.933538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 388/770] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 23 16:55:58 2022] GET /identity/v3/services => generated 772 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:58.981861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee87c9-d43c-44f6-afc9-121af9faa520 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:59.014198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78a254-db2f-44ca-9292-9985d9750b06 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:59.014990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78a254-db2f-44ca-9292-9985d9750b06 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:59.015505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78a254-db2f-44ca-9292-9985d9750b06 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:59.018426 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 389/771] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:55:59.019862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502c35f-41a9-40d9-b464-bc0a60059e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:59.020625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502c35f-41a9-40d9-b464-bc0a60059e31 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:59.020904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502c35f-41a9-40d9-b464-bc0a60059e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:59.021176 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502c35f-41a9-40d9-b464-bc0a60059e31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:59.023760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2888f-73e8-4be6-9b26-b3734919368e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:59.024311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2888f-73e8-4be6-9b26-b3734919368e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:59.024815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2888f-73e8-4be6-9b26-b3734919368e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:59.028965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502c35f-41a9-40d9-b464-bc0a60059e31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:59.032015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502c35f-41a9-40d9-b464-bc0a60059e31 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:59.044734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-cfc2888f-73e8-4be6-9b26-b3734919368e None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:59.046441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cfc2888f-73e8-4be6-9b26-b3734919368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-8502c35f-41a9-40d9-b464-bc0a60059e31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:55:59.051662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:59.052595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:59.058721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:55:59.058721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:55:59.058721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:55:59.058721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:55:59.058721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:55:59.058721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:55:59.058721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:55:59.058721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:59.058721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 383/772] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:55:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:59.064671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502c35f-41a9-40d9-b464-bc0a60059e31 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:59.188310 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 390/773] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:55:59.190825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e98241-3168-4f3f-981b-921fed1f09ae None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:59.191338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e98241-3168-4f3f-981b-921fed1f09ae None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:59.191820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e98241-3168-4f3f-981b-921fed1f09ae None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:59.193665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 391/774] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:55:59.198175 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502c35f-41a9-40d9-b464-bc0a60059e31 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:59.199595 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05805153-abc3-4401-8a27-3e1756375580 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:59.200360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05805153-abc3-4401-8a27-3e1756375580 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:59.201662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:59.203650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05805153-abc3-4401-8a27-3e1756375580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:59.227652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-05805153-abc3-4401-8a27-3e1756375580 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:59.229179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-05805153-abc3-4401-8a27-3e1756375580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:59.243856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80846808-419d-4a7b-8f44-7690e2579524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:59.244836 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80846808-419d-4a7b-8f44-7690e2579524 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:59.245314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80846808-419d-4a7b-8f44-7690e2579524 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:59.245778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80846808-419d-4a7b-8f44-7690e2579524 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:59.246817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80846808-419d-4a7b-8f44-7690e2579524 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:59.247317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80846808-419d-4a7b-8f44-7690e2579524 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:59.249505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80846808-419d-4a7b-8f44-7690e2579524 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:59.262521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 384/775] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:55:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:59.263725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80846808-419d-4a7b-8f44-7690e2579524 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:59.308558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 392/776] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:55:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:55:59.309683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05805153-abc3-4401-8a27-3e1756375580 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:59.343367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:59.403280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80846808-419d-4a7b-8f44-7690e2579524 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:59.440224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5807b-22bb-489f-8fe2-9566e017c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:59.440956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5807b-22bb-489f-8fe2-9566e017c946 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:59.441225 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5807b-22bb-489f-8fe2-9566e017c946 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:59.441548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5807b-22bb-489f-8fe2-9566e017c946 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:59.442148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5807b-22bb-489f-8fe2-9566e017c946 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:59.443541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5807b-22bb-489f-8fe2-9566e017c946 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:59.444045 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05805153-abc3-4401-8a27-3e1756375580 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-7eb5807b-22bb-489f-8fe2-9566e017c946 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:59.457325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:59.458517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:55:59.459583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:59.465751 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 385/777] 10.222.0.49 () {56 vars in 1129 bytes} [Mon May 23 16:55:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:59.465751 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5807b-22bb-489f-8fe2-9566e017c946 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:59.495731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:59.498049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa007-203c-4311-b61b-ce5e77b3471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:59.499801 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa007-203c-4311-b61b-ce5e77b3471f None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:59.500477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa007-203c-4311-b61b-ce5e77b3471f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:59.500955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa007-203c-4311-b61b-ce5e77b3471f None admin] PATH_INFO: `/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/9884780c88aa48ffa92a696740761387/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:59.503845 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aa007-203c-4311-b61b-ce5e77b3471f None admin] RBAC: Authorizing `identity:create_grant(project_id=733d8651e4a74a2ab694091d9fd83e49, user_id=9884780c88aa48ffa92a696740761387, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:59.506427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aa007-203c-4311-b61b-ce5e77b3471f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:59.530513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 393/778] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:55:59 2022] PUT /identity/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/9884780c88aa48ffa92a696740761387/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:59.532035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa007-203c-4311-b61b-ce5e77b3471f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:59.586088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5807b-22bb-489f-8fe2-9566e017c946 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:59.624712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:59.626554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b1681-f5e5-434f-bfae-8d8e49ce70e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:59.627713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b1681-f5e5-434f-bfae-8d8e49ce70e8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:59.628185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b1681-f5e5-434f-bfae-8d8e49ce70e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:59.628671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b1681-f5e5-434f-bfae-8d8e49ce70e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:59.644018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b1681-f5e5-434f-bfae-8d8e49ce70e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:55:59.652026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa007-203c-4311-b61b-ce5e77b3471f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ec1b1681-f5e5-434f-bfae-8d8e49ce70e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:55:59.652950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:55:59.653937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:55:59.654804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:55:59.654804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:55:59.654804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:55:59.654804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:55:59.654804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:55:59.654804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:55:59.654804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:55:59.654804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:55:59.654804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:55:59.654804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:55:59.654804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:55:59.654804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:55:59.658263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 386/779] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:55:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:55:59.664321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b1681-f5e5-434f-bfae-8d8e49ce70e8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:59.694591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d2e9e-d8c4-49ff-9ba6-b2735821cdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:59.695121 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d2e9e-d8c4-49ff-9ba6-b2735821cdab None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:59.695409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d2e9e-d8c4-49ff-9ba6-b2735821cdab None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:59.695690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d2e9e-d8c4-49ff-9ba6-b2735821cdab None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:59.696407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d2e9e-d8c4-49ff-9ba6-b2735821cdab None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:59.696782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d2e9e-d8c4-49ff-9ba6-b2735821cdab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:59.698125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d2e9e-d8c4-49ff-9ba6-b2735821cdab None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:59.704363 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 394/780] 10.222.0.49 () {56 vars in 1124 bytes} [Mon May 23 16:55:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:59.715462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d2e9e-d8c4-49ff-9ba6-b2735821cdab None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:59.774779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:59.791059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b1681-f5e5-434f-bfae-8d8e49ce70e8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:59.836539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e576e-bdc9-4bbc-abd2-99164e268305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:59.837653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e576e-bdc9-4bbc-abd2-99164e268305 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:59.838158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e576e-bdc9-4bbc-abd2-99164e268305 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:59.838705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e576e-bdc9-4bbc-abd2-99164e268305 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:59.839646 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e576e-bdc9-4bbc-abd2-99164e268305 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:59.840140 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e576e-bdc9-4bbc-abd2-99164e268305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:59.841912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e576e-bdc9-4bbc-abd2-99164e268305 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:59.852327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 387/781] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:55:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:55:59.858246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e576e-bdc9-4bbc-abd2-99164e268305 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:59.919785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d2e9e-d8c4-49ff-9ba6-b2735821cdab None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:59.955989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd1dfd-1d85-47b8-bc1f-83c94e9f8bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:59.956675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd1dfd-1d85-47b8-bc1f-83c94e9f8bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:59.957039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd1dfd-1d85-47b8-bc1f-83c94e9f8bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:59.957400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd1dfd-1d85-47b8-bc1f-83c94e9f8bf0 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:59.958179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd1dfd-1d85-47b8-bc1f-83c94e9f8bf0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:59.958594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd1dfd-1d85-47b8-bc1f-83c94e9f8bf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:59.960042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd1dfd-1d85-47b8-bc1f-83c94e9f8bf0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:59.970429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 395/782] 10.222.0.49 () {56 vars in 1124 bytes} [Mon May 23 16:55:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:59.972519 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd1dfd-1d85-47b8-bc1f-83c94e9f8bf0 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:59.982767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e576e-bdc9-4bbc-abd2-99164e268305 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:59.990777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:00.025809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1e5e7-d262-4b60-802a-026055e6953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:00.027156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1e5e7-d262-4b60-802a-026055e6953c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:00.028709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1e5e7-d262-4b60-802a-026055e6953c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:00.028709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1e5e7-d262-4b60-802a-026055e6953c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:00.042340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1e5e7-d262-4b60-802a-026055e6953c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:00.044497 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1e5e7-d262-4b60-802a-026055e6953c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-5ef1e5e7-d262-4b60-802a-026055e6953c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:00.068368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:00.069328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:00.070270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:00.070270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:00.070270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:00.070270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:00.070962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 388/783] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:00.072170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de54d8d-eb81-4080-86c7-70438d7ea4b3 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:00.074606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de54d8d-eb81-4080-86c7-70438d7ea4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:00.074925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de54d8d-eb81-4080-86c7-70438d7ea4b3 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:00.078457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 389/784] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:00.079251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de54d8d-eb81-4080-86c7-70438d7ea4b3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:00.083897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:00.102740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd1dfd-1d85-47b8-bc1f-83c94e9f8bf0 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:00.148868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c30cd-2fec-4588-b134-6f15bd1eee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:00.150158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c30cd-2fec-4588-b134-6f15bd1eee82 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:00.150630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c30cd-2fec-4588-b134-6f15bd1eee82 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:00.151086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c30cd-2fec-4588-b134-6f15bd1eee82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:00.152029 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c30cd-2fec-4588-b134-6f15bd1eee82 None admin] RBAC: Adding query filter params (interface=public, service_id=af833468cf9f4943ae309e935a9e897f, region_id=RegionOne) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:00.153038 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c30cd-2fec-4588-b134-6f15bd1eee82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:00.154869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c30cd-2fec-4588-b134-6f15bd1eee82 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:00.165186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 396/785] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 23 16:55:59 2022] GET /identity/v3/endpoints?service_id=af833468cf9f4943ae309e935a9e897f&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:00.167729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5bbb3-b261-4116-9b15-5816cd909488 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:00.168406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5bbb3-b261-4116-9b15-5816cd909488 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:00.169427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5bbb3-b261-4116-9b15-5816cd909488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:00.194748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e1f5bbb3-b261-4116-9b15-5816cd909488 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:00.196958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e1f5bbb3-b261-4116-9b15-5816cd909488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:00.221746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de54d8d-eb81-4080-86c7-70438d7ea4b3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:00.259558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9dd1b-6eb8-4a1d-8a08-3d39c4e51341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:00.260533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9dd1b-6eb8-4a1d-8a08-3d39c4e51341 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:00.261034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9dd1b-6eb8-4a1d-8a08-3d39c4e51341 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:00.261472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9dd1b-6eb8-4a1d-8a08-3d39c4e51341 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:00.262435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9dd1b-6eb8-4a1d-8a08-3d39c4e51341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:00.262897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9dd1b-6eb8-4a1d-8a08-3d39c4e51341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:00.264569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9dd1b-6eb8-4a1d-8a08-3d39c4e51341 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:00.277899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 390/786] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:00.279013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9dd1b-6eb8-4a1d-8a08-3d39c4e51341 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:00.306382 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 397/787] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:00.306382 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5bbb3-b261-4116-9b15-5816cd909488 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:00.311771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:00.372387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:00.421408 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9dd1b-6eb8-4a1d-8a08-3d39c4e51341 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:00.425836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5bbb3-b261-4116-9b15-5816cd909488 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:00.460734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cc8db-6b61-4725-9617-843a03977889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:00.461860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cc8db-6b61-4725-9617-843a03977889 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:00.462447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cc8db-6b61-4725-9617-843a03977889 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:00.462890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cc8db-6b61-4725-9617-843a03977889 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:00.463820 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cc8db-6b61-4725-9617-843a03977889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:00.464175 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b97a08-8657-4eda-95bf-98ac062cb81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:00.464988 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b97a08-8657-4eda-95bf-98ac062cb81c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:00.465278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b97a08-8657-4eda-95bf-98ac062cb81c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:00.465559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b97a08-8657-4eda-95bf-98ac062cb81c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:00.466198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cc8db-6b61-4725-9617-843a03977889 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:00.472992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 391/788] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 23 16:56:00 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:00.474038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cc8db-6b61-4725-9617-843a03977889 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:00.483992 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b97a08-8657-4eda-95bf-98ac062cb81c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:00.485481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b97a08-8657-4eda-95bf-98ac062cb81c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b3b97a08-8657-4eda-95bf-98ac062cb81c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:56:00.521471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:00.522741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:00.524109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:00.524109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:00.524109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:56:00.524109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:56:00.524109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:56:00.524109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:56:00.524109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:56:00.524109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:56:00.524109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:56:00.524109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:00.524109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 398/789] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 23 16:56:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:00.528536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b97a08-8657-4eda-95bf-98ac062cb81c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:00.591907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cc8db-6b61-4725-9617-843a03977889 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:00.649733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:00.670493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258a3f1-b970-402f-bce9-b29e57cc3510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:00.671672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258a3f1-b970-402f-bce9-b29e57cc3510 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:00.672111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258a3f1-b970-402f-bce9-b29e57cc3510 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:00.672534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258a3f1-b970-402f-bce9-b29e57cc3510 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:00.691942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:00.700244 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258a3f1-b970-402f-bce9-b29e57cc3510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-3258a3f1-b970-402f-bce9-b29e57cc3510 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:00.716771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:00.718170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:00.719255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:00.719255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:00.719255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:00.719255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:00.719255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:00.719255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:00.719255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:00.719255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:00.719255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:00.719255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:00.719255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:56:00.719255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:00.726190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 392/790] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:56:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:00.729957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258a3f1-b970-402f-bce9-b29e57cc3510 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:00.761698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b97a08-8657-4eda-95bf-98ac062cb81c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:00.804535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1e225-6606-44a6-afa6-a817664ac335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:00.805367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1e225-6606-44a6-afa6-a817664ac335 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:00.805737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1e225-6606-44a6-afa6-a817664ac335 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:00.806132 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1e225-6606-44a6-afa6-a817664ac335 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:00.807209 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1e225-6606-44a6-afa6-a817664ac335 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:00.807625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1e225-6606-44a6-afa6-a817664ac335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:00.809271 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1e225-6606-44a6-afa6-a817664ac335 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:00.831081 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 399/791] 10.222.0.49 () {56 vars in 1149 bytes} [Mon May 23 16:56:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:00.836454 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1e225-6606-44a6-afa6-a817664ac335 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:00.859462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258a3f1-b970-402f-bce9-b29e57cc3510 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:00.901389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f22f78-43d3-4753-b4fa-e84aed5b2dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:00.902405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f22f78-43d3-4753-b4fa-e84aed5b2dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:00.902846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f22f78-43d3-4753-b4fa-e84aed5b2dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:00.903275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f22f78-43d3-4753-b4fa-e84aed5b2dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:00.904175 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f22f78-43d3-4753-b4fa-e84aed5b2dc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:00.904764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f22f78-43d3-4753-b4fa-e84aed5b2dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:00.906555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f22f78-43d3-4753-b4fa-e84aed5b2dc0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:00.916345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 393/792] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:56:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:00.923461 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f22f78-43d3-4753-b4fa-e84aed5b2dc0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:00.981731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:01.008442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1e225-6606-44a6-afa6-a817664ac335 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:01.043709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f22f78-43d3-4753-b4fa-e84aed5b2dc0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:01.083755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd191c-797e-4524-ac8d-79ed2a24d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:01.085332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:01.086051 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd191c-797e-4524-ac8d-79ed2a24d20c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.086546 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd191c-797e-4524-ac8d-79ed2a24d20c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.087220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd191c-797e-4524-ac8d-79ed2a24d20c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.100596 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd191c-797e-4524-ac8d-79ed2a24d20c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:01.102699 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd191c-797e-4524-ac8d-79ed2a24d20c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-84bd191c-797e-4524-ac8d-79ed2a24d20c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:01.122164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:01.123326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:01.124567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:01.124567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:01.124567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:01.124567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:01.125607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9c56c-16a1-44b6-be11-582d8f0abb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:01.126516 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c56c-16a1-44b6-be11-582d8f0abb05 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.126877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c56c-16a1-44b6-be11-582d8f0abb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.127031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 394/793] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:01.127272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c56c-16a1-44b6-be11-582d8f0abb05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.132387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd191c-797e-4524-ac8d-79ed2a24d20c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:01.159294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9c56c-16a1-44b6-be11-582d8f0abb05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:01.160860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9c56c-16a1-44b6-be11-582d8f0abb05 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-6cb9c56c-16a1-44b6-be11-582d8f0abb05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:01.207131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:01.208311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:01.209466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:01.209466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:01.209466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:01.209466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:01.210541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 400/794] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:01.216448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9c56c-16a1-44b6-be11-582d8f0abb05 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:01.254810 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:01.258914 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd191c-797e-4524-ac8d-79ed2a24d20c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:01.302515 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44f8e6-6915-461f-8920-cc16b6cc8b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:01.303512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44f8e6-6915-461f-8920-cc16b6cc8b0f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.303952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44f8e6-6915-461f-8920-cc16b6cc8b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.304738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44f8e6-6915-461f-8920-cc16b6cc8b0f None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.306234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44f8e6-6915-461f-8920-cc16b6cc8b0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:01.306737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44f8e6-6915-461f-8920-cc16b6cc8b0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:01.308471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44f8e6-6915-461f-8920-cc16b6cc8b0f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:01.322706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 395/795] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:01.328796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44f8e6-6915-461f-8920-cc16b6cc8b0f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:01.400462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9c56c-16a1-44b6-be11-582d8f0abb05 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:01.443275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44f8e6-6915-461f-8920-cc16b6cc8b0f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:01.481504 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a89f3-5a1d-4213-b3ba-9c0bc790a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:01.482856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a89f3-5a1d-4213-b3ba-9c0bc790a799 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.484083 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a89f3-5a1d-4213-b3ba-9c0bc790a799 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.484606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a89f3-5a1d-4213-b3ba-9c0bc790a799 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.493558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a89f3-5a1d-4213-b3ba-9c0bc790a799 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:01.495656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a89f3-5a1d-4213-b3ba-9c0bc790a799 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-054a89f3-5a1d-4213-b3ba-9c0bc790a799 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:56:01.511505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:01.512470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:01.513438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:01.513438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:01.513438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:56:01.513438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:56:01.513438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:56:01.513438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:56:01.513438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:56:01.513438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:56:01.513438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 16:56:01.513438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:01.516246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 396/796] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:56:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:01.521935 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a89f3-5a1d-4213-b3ba-9c0bc790a799 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:01.522487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee76288-0b35-4241-aa8c-6dc72a0eee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:01.523226 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee76288-0b35-4241-aa8c-6dc72a0eee6f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.523511 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee76288-0b35-4241-aa8c-6dc72a0eee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.523796 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee76288-0b35-4241-aa8c-6dc72a0eee6f None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.524533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee76288-0b35-4241-aa8c-6dc72a0eee6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:01.524844 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee76288-0b35-4241-aa8c-6dc72a0eee6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:01.526208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee76288-0b35-4241-aa8c-6dc72a0eee6f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:01.549731 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 401/797] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:01.555452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41f0a-fff9-4544-98f0-23faa6b1c441 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.555758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41f0a-fff9-4544-98f0-23faa6b1c441 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.556042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41f0a-fff9-4544-98f0-23faa6b1c441 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.557592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 402/798] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:01.558324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41f0a-fff9-4544-98f0-23faa6b1c441 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:01.558733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:01.598887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:01.658734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a89f3-5a1d-4213-b3ba-9c0bc790a799 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:01.669169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41f0a-fff9-4544-98f0-23faa6b1c441 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:01.711095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2440681-e638-45d7-a645-542a2a006dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:01.711897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2440681-e638-45d7-a645-542a2a006dcf None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.712173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2440681-e638-45d7-a645-542a2a006dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.712450 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2440681-e638-45d7-a645-542a2a006dcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.717241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63425e-7d0f-4fac-a4a6-db050738a50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:01.721992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63425e-7d0f-4fac-a4a6-db050738a50f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.721992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63425e-7d0f-4fac-a4a6-db050738a50f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.721992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63425e-7d0f-4fac-a4a6-db050738a50f None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.721992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63425e-7d0f-4fac-a4a6-db050738a50f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:01.721992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63425e-7d0f-4fac-a4a6-db050738a50f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:01.721992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63425e-7d0f-4fac-a4a6-db050738a50f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:01.723917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2440681-e638-45d7-a645-542a2a006dcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:01.725347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2440681-e638-45d7-a645-542a2a006dcf None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:01.743149 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 397/799] 10.222.0.49 () {56 vars in 1135 bytes} [Mon May 23 16:56:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-c2440681-e638-45d7-a645-542a2a006dcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:56:01.743338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:01.744161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:01.745075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:56:01.745075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:56:01.745075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:56:01.745075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:56:01.745075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:56:01.745075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:56:01.745075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:01.745075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:01.747499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d86f2-b9c5-45aa-9b7f-fbeb4f32268f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.748066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d86f2-b9c5-45aa-9b7f-fbeb4f32268f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.748546 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d86f2-b9c5-45aa-9b7f-fbeb4f32268f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.749184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 403/800] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:01.750388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2440681-e638-45d7-a645-542a2a006dcf None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:01.767573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3e0d86f2-b9c5-45aa-9b7f-fbeb4f32268f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:01.769073 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3e0d86f2-b9c5-45aa-9b7f-fbeb4f32268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:01.840230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 398/801] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:01.841522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d86f2-b9c5-45aa-9b7f-fbeb4f32268f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:01.858855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:01.873363 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:01.884291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2440681-e638-45d7-a645-542a2a006dcf None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:01.923137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea709065-4e32-4228-853f-a5b3b0e3e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:01.923966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea709065-4e32-4228-853f-a5b3b0e3e052 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.924254 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea709065-4e32-4228-853f-a5b3b0e3e052 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.924527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea709065-4e32-4228-853f-a5b3b0e3e052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.935447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea709065-4e32-4228-853f-a5b3b0e3e052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:01.937083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea709065-4e32-4228-853f-a5b3b0e3e052 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:01.953880 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d86f2-b9c5-45aa-9b7f-fbeb4f32268f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-ea709065-4e32-4228-853f-a5b3b0e3e052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:01.955296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:01.956148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:01.957036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:01.957036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:01.957036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:01.957036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:01.957036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 404/802] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:01.957309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea709065-4e32-4228-853f-a5b3b0e3e052 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:01.996378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c9ef7-3a6e-4a60-823b-5a9ca2b5c931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:01.997523 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c9ef7-3a6e-4a60-823b-5a9ca2b5c931 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.998066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c9ef7-3a6e-4a60-823b-5a9ca2b5c931 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.998585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c9ef7-3a6e-4a60-823b-5a9ca2b5c931 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.000159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c9ef7-3a6e-4a60-823b-5a9ca2b5c931 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:02.000813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c9ef7-3a6e-4a60-823b-5a9ca2b5c931 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:02.002739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c9ef7-3a6e-4a60-823b-5a9ca2b5c931 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:02.017725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 399/803] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:56:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:02.018959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c9ef7-3a6e-4a60-823b-5a9ca2b5c931 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:02.073529 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea709065-4e32-4228-853f-a5b3b0e3e052 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:02.096658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:02.110489 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84253c8f-3e28-40d3-8310-51a62b42c07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:02.111304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84253c8f-3e28-40d3-8310-51a62b42c07c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.111594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84253c8f-3e28-40d3-8310-51a62b42c07c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.111875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84253c8f-3e28-40d3-8310-51a62b42c07c None admin] PATH_INFO: `/v3/services/network` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.112533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84253c8f-3e28-40d3-8310-51a62b42c07c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:02.113894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84253c8f-3e28-40d3-8310-51a62b42c07c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-84253c8f-3e28-40d3-8310-51a62b42c07c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:02.129021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:02.130073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:02.130953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 405/804] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:01 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:02.131762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84253c8f-3e28-40d3-8310-51a62b42c07c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:02.140878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c9ef7-3a6e-4a60-823b-5a9ca2b5c931 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:02.150257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:02.181200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b645701-7ecc-4b5b-a23e-384b756b2cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:02.182307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b645701-7ecc-4b5b-a23e-384b756b2cdc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.182872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b645701-7ecc-4b5b-a23e-384b756b2cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.183349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b645701-7ecc-4b5b-a23e-384b756b2cdc None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.184278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b645701-7ecc-4b5b-a23e-384b756b2cdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:02.184893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b645701-7ecc-4b5b-a23e-384b756b2cdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:02.187617 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b645701-7ecc-4b5b-a23e-384b756b2cdc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:02.200876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 400/805] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:02.202091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b645701-7ecc-4b5b-a23e-384b756b2cdc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:02.260375 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84253c8f-3e28-40d3-8310-51a62b42c07c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:02.297105 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d251ee-ede2-40db-86a9-59194752d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:02.297921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d251ee-ede2-40db-86a9-59194752d8fc None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.298227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d251ee-ede2-40db-86a9-59194752d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.298515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d251ee-ede2-40db-86a9-59194752d8fc None admin] PATH_INFO: `/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/96230dd16acb4cdfa43b892b2b747282/roles/3d6cf7264f664a20a5a635d4d11c3e1a` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.313671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d251ee-ede2-40db-86a9-59194752d8fc None admin] RBAC: Authorizing `identity:create_grant(project_id=733d8651e4a74a2ab694091d9fd83e49, user_id=96230dd16acb4cdfa43b892b2b747282, role_id=3d6cf7264f664a20a5a635d4d11c3e1a)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:02.314237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b645701-7ecc-4b5b-a23e-384b756b2cdc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:02.315139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d251ee-ede2-40db-86a9-59194752d8fc None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:02.338593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 406/806] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:56:02 2022] PUT /identity/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/96230dd16acb4cdfa43b892b2b747282/roles/3d6cf7264f664a20a5a635d4d11c3e1a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:02.341178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81b3e6-bb13-4d15-8342-55061dd1b79c None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.341487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81b3e6-bb13-4d15-8342-55061dd1b79c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.342047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81b3e6-bb13-4d15-8342-55061dd1b79c None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.344650 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:02.345594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 407/807] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:02.347074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81b3e6-bb13-4d15-8342-55061dd1b79c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:02.355318 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db4ebb-b53b-44d8-988b-79b81c0f38d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:02.356006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db4ebb-b53b-44d8-988b-79b81c0f38d8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.356307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db4ebb-b53b-44d8-988b-79b81c0f38d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.356622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db4ebb-b53b-44d8-988b-79b81c0f38d8 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.357351 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db4ebb-b53b-44d8-988b-79b81c0f38d8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:02.357711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db4ebb-b53b-44d8-988b-79b81c0f38d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:02.360113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db4ebb-b53b-44d8-988b-79b81c0f38d8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:02.370774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 401/808] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:56:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:02.372387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd14733-4835-49be-b23f-ebdc1db3d175 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.372685 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd14733-4835-49be-b23f-ebdc1db3d175 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.372969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd14733-4835-49be-b23f-ebdc1db3d175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.393162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ecd14733-4835-49be-b23f-ebdc1db3d175 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:02.394386 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ecd14733-4835-49be-b23f-ebdc1db3d175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:02.431992 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:02.482225 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81b3e6-bb13-4d15-8342-55061dd1b79c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:02.499831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 402/809] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:02.500839 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd14733-4835-49be-b23f-ebdc1db3d175 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:02.525145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f46d61-77dd-4e40-acb4-be43fc6e9557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:02.526155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f46d61-77dd-4e40-acb4-be43fc6e9557 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.526849 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f46d61-77dd-4e40-acb4-be43fc6e9557 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.526964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f46d61-77dd-4e40-acb4-be43fc6e9557 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.536304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f46d61-77dd-4e40-acb4-be43fc6e9557 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:02.537755 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f46d61-77dd-4e40-acb4-be43fc6e9557 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f0f46d61-77dd-4e40-acb4-be43fc6e9557 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:56:02.557366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:02.558289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:02.559263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:56:02.559263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:56:02.559263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:56:02.559263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:56:02.559263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:56:02.559263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:56:02.559263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:02.559263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:02.559263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 408/810] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:02.559754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f46d61-77dd-4e40-acb4-be43fc6e9557 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:02.628169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd14733-4835-49be-b23f-ebdc1db3d175 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:02.653045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:02.673504 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f1798-e809-4bc6-8745-b9421a0ad6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:02.675254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f1798-e809-4bc6-8745-b9421a0ad6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.675779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f1798-e809-4bc6-8745-b9421a0ad6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.676679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f1798-e809-4bc6-8745-b9421a0ad6a2 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.677902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f1798-e809-4bc6-8745-b9421a0ad6a2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:02.678462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f1798-e809-4bc6-8745-b9421a0ad6a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:02.682504 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f1798-e809-4bc6-8745-b9421a0ad6a2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:02.690946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 403/811] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:56:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:02.691847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f1798-e809-4bc6-8745-b9421a0ad6a2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:02.706592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f46d61-77dd-4e40-acb4-be43fc6e9557 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:02.742564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:02.760860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76da6dc-5f92-4c43-9a7a-ac8f54ae6543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:02.762758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da6dc-5f92-4c43-9a7a-ac8f54ae6543 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.763536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da6dc-5f92-4c43-9a7a-ac8f54ae6543 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.764025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da6dc-5f92-4c43-9a7a-ac8f54ae6543 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.778131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76da6dc-5f92-4c43-9a7a-ac8f54ae6543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-a76da6dc-5f92-4c43-9a7a-ac8f54ae6543 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:02.787831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:02.788764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:02.789610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:02.789610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:02.789610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:02.789610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:02.789610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:02.789610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:02.789610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:02.789610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:02.789610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:02.789610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:02.789610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:56:02.789610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:02.796874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 409/812] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:56:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:02.796874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76da6dc-5f92-4c43-9a7a-ac8f54ae6543 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:02.832833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f1798-e809-4bc6-8745-b9421a0ad6a2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:02.881908 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4ba82-3b1c-4f3f-9620-9b06b1210f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:02.883128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4ba82-3b1c-4f3f-9620-9b06b1210f97 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.883416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4ba82-3b1c-4f3f-9620-9b06b1210f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.883697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4ba82-3b1c-4f3f-9620-9b06b1210f97 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.884499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4ba82-3b1c-4f3f-9620-9b06b1210f97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:02.884814 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4ba82-3b1c-4f3f-9620-9b06b1210f97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:02.886255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4ba82-3b1c-4f3f-9620-9b06b1210f97 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:02.905964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 404/813] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:56:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:02.905964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4ba82-3b1c-4f3f-9620-9b06b1210f97 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:02.925120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76da6dc-5f92-4c43-9a7a-ac8f54ae6543 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:02.953984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:02.975623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef74563-48b8-423a-878d-d6b39c81c178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:02.977239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef74563-48b8-423a-878d-d6b39c81c178 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.977968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef74563-48b8-423a-878d-d6b39c81c178 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.978463 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef74563-48b8-423a-878d-d6b39c81c178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.980736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef74563-48b8-423a-878d-d6b39c81c178 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:02.982307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef74563-48b8-423a-878d-d6b39c81c178 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:03.012736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 410/814] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 23 16:56:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:03.014050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef74563-48b8-423a-878d-d6b39c81c178 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:03.026056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4ba82-3b1c-4f3f-9620-9b06b1210f97 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:03.084834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e52554-f90c-4db6-9f03-2e86cab89e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:03.085714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e52554-f90c-4db6-9f03-2e86cab89e6f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.086071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e52554-f90c-4db6-9f03-2e86cab89e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.086509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e52554-f90c-4db6-9f03-2e86cab89e6f None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.087373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e52554-f90c-4db6-9f03-2e86cab89e6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:03.087788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e52554-f90c-4db6-9f03-2e86cab89e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:03.089555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e52554-f90c-4db6-9f03-2e86cab89e6f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:03.101091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 405/815] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:56:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:03.112675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e52554-f90c-4db6-9f03-2e86cab89e6f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:03.118099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:03.200822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef74563-48b8-423a-878d-d6b39c81c178 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:03.242512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764be1ed-5a9f-460e-8c6f-d45b5fa42388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:03.242725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e52554-f90c-4db6-9f03-2e86cab89e6f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:03.243890 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764be1ed-5a9f-460e-8c6f-d45b5fa42388 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.244449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764be1ed-5a9f-460e-8c6f-d45b5fa42388 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.245054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:03.245758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764be1ed-5a9f-460e-8c6f-d45b5fa42388 None admin] PATH_INFO: `/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/c22f94b1abe248c3969b68e17755f113/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.248449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764be1ed-5a9f-460e-8c6f-d45b5fa42388 None admin] RBAC: Authorizing `identity:create_grant(project_id=733d8651e4a74a2ab694091d9fd83e49, user_id=c22f94b1abe248c3969b68e17755f113, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:03.251464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764be1ed-5a9f-460e-8c6f-d45b5fa42388 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:03.268220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 411/816] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:56:03 2022] PUT /identity/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/c22f94b1abe248c3969b68e17755f113/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:03.287028 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ba57d-faee-4a79-b6f3-f42ecb77d4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:03.288299 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ba57d-faee-4a79-b6f3-f42ecb77d4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.288841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ba57d-faee-4a79-b6f3-f42ecb77d4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.289327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ba57d-faee-4a79-b6f3-f42ecb77d4a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.292157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1486-0965-4d8b-8daf-4c32cc4f2cac None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.292449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1486-0965-4d8b-8daf-4c32cc4f2cac None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.292721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1486-0965-4d8b-8daf-4c32cc4f2cac None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.294409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 412/817] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:03.303225 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39633e8-9cbf-478d-8f18-2df9a554f33f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.303647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39633e8-9cbf-478d-8f18-2df9a554f33f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.303914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39633e8-9cbf-478d-8f18-2df9a554f33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.313221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ba57d-faee-4a79-b6f3-f42ecb77d4a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:03.315253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ba57d-faee-4a79-b6f3-f42ecb77d4a5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:03.325974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e39633e8-9cbf-478d-8f18-2df9a554f33f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:03.327286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e39633e8-9cbf-478d-8f18-2df9a554f33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-0e0ba57d-faee-4a79-b6f3-f42ecb77d4a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:03.341472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:03.343170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:03.344346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:03.344346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:03.344346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:03.344346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:03.347304 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 406/818] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:03.353707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ba57d-faee-4a79-b6f3-f42ecb77d4a5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:03.427209 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 413/819] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:03.453590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39633e8-9cbf-478d-8f18-2df9a554f33f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:03.493934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:03.507895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ba57d-faee-4a79-b6f3-f42ecb77d4a5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:03.552970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c7318-d636-459c-9262-76ddd6587536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:03.553816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c7318-d636-459c-9262-76ddd6587536 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.554111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c7318-d636-459c-9262-76ddd6587536 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.554534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c7318-d636-459c-9262-76ddd6587536 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.555298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c7318-d636-459c-9262-76ddd6587536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:03.555609 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c7318-d636-459c-9262-76ddd6587536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:03.556987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c7318-d636-459c-9262-76ddd6587536 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:03.570429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 407/820] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:03.575671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c7318-d636-459c-9262-76ddd6587536 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:03.591194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39633e8-9cbf-478d-8f18-2df9a554f33f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:03.599577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:03.634548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3c714-1c4c-4c92-a164-4de4e233bfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:03.635389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3c714-1c4c-4c92-a164-4de4e233bfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.635667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3c714-1c4c-4c92-a164-4de4e233bfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.635942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3c714-1c4c-4c92-a164-4de4e233bfd0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.636786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3c714-1c4c-4c92-a164-4de4e233bfd0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:03.638254 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3c714-1c4c-4c92-a164-4de4e233bfd0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-1ca3c714-1c4c-4c92-a164-4de4e233bfd0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:03.653082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:03.654107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:03.655538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 414/821] 10.222.0.49 () {56 vars in 1129 bytes} [Mon May 23 16:56:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:03.663335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3c714-1c4c-4c92-a164-4de4e233bfd0 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:03.703421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c7318-d636-459c-9262-76ddd6587536 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:03.739644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1faa4-e67f-4c7f-8b3c-f0768480f7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:03.740731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1faa4-e67f-4c7f-8b3c-f0768480f7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.741171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1faa4-e67f-4c7f-8b3c-f0768480f7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.741625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1faa4-e67f-4c7f-8b3c-f0768480f7a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.749902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1faa4-e67f-4c7f-8b3c-f0768480f7a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:03.751620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1faa4-e67f-4c7f-8b3c-f0768480f7a1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-35a1faa4-e67f-4c7f-8b3c-f0768480f7a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:56:03.767007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:03.768200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:03.769350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:03.769350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:03.769350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:56:03.769350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:56:03.769350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:56:03.769350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:56:03.769350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:56:03.769350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:56:03.769350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:56:03.769350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:03.771678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 408/822] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 23 16:56:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:03.779316 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1faa4-e67f-4c7f-8b3c-f0768480f7a1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:03.785375 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:03.795896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3c714-1c4c-4c92-a164-4de4e233bfd0 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:03.833065 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f7c5f-36fb-4f2e-bb44-8e0d9eafe792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:03.833814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f7c5f-36fb-4f2e-bb44-8e0d9eafe792 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.834017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f7c5f-36fb-4f2e-bb44-8e0d9eafe792 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.834294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f7c5f-36fb-4f2e-bb44-8e0d9eafe792 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.835744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f7c5f-36fb-4f2e-bb44-8e0d9eafe792 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:03.835744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f7c5f-36fb-4f2e-bb44-8e0d9eafe792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:03.836675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f7c5f-36fb-4f2e-bb44-8e0d9eafe792 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:03.842037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 415/823] 10.222.0.49 () {56 vars in 1124 bytes} [Mon May 23 16:56:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:03.847889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f7c5f-36fb-4f2e-bb44-8e0d9eafe792 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:03.887013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:03.914251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1faa4-e67f-4c7f-8b3c-f0768480f7a1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:03.951075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669953d-e3ab-4833-952e-cd79eaa6c354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:03.952640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669953d-e3ab-4833-952e-cd79eaa6c354 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.953130 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669953d-e3ab-4833-952e-cd79eaa6c354 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.953610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669953d-e3ab-4833-952e-cd79eaa6c354 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.954673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669953d-e3ab-4833-952e-cd79eaa6c354 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:03.955677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669953d-e3ab-4833-952e-cd79eaa6c354 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:03.957308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669953d-e3ab-4833-952e-cd79eaa6c354 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:03.979887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f7c5f-36fb-4f2e-bb44-8e0d9eafe792 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:03.980248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 409/824] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 23 16:56:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:03.981652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669953d-e3ab-4833-952e-cd79eaa6c354 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.024887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df658a-b43e-48c4-a5ad-f8d9b821ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.025557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df658a-b43e-48c4-a5ad-f8d9b821ef8c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.025847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df658a-b43e-48c4-a5ad-f8d9b821ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.026126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df658a-b43e-48c4-a5ad-f8d9b821ef8c None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.027294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df658a-b43e-48c4-a5ad-f8d9b821ef8c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:04.027614 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df658a-b43e-48c4-a5ad-f8d9b821ef8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.028991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df658a-b43e-48c4-a5ad-f8d9b821ef8c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.038507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 416/825] 10.222.0.49 () {56 vars in 1124 bytes} [Mon May 23 16:56:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:04.041342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df658a-b43e-48c4-a5ad-f8d9b821ef8c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.066674 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:04.112017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669953d-e3ab-4833-952e-cd79eaa6c354 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:04.148879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983837c7-2652-40e2-b20c-ba1bf965257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.149584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983837c7-2652-40e2-b20c-ba1bf965257f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.149926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983837c7-2652-40e2-b20c-ba1bf965257f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.150212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983837c7-2652-40e2-b20c-ba1bf965257f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.153129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:04.173891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df658a-b43e-48c4-a5ad-f8d9b821ef8c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:04.217530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602899b-9685-42ba-b8cf-6a86000c02b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.218382 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602899b-9685-42ba-b8cf-6a86000c02b3 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.218883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602899b-9685-42ba-b8cf-6a86000c02b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.219168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602899b-9685-42ba-b8cf-6a86000c02b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.220078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602899b-9685-42ba-b8cf-6a86000c02b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.222255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602899b-9685-42ba-b8cf-6a86000c02b3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.243387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983837c7-2652-40e2-b20c-ba1bf965257f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.250388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 417/826] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 23 16:56:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:04.251941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983837c7-2652-40e2-b20c-ba1bf965257f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.379933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 410/827] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:56:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 16:56:04.385624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602899b-9685-42ba-b8cf-6a86000c02b3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.478203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:04.519314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602899b-9685-42ba-b8cf-6a86000c02b3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:04.556956 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac1127-dfad-4969-8322-f3c03e034f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.558137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac1127-dfad-4969-8322-f3c03e034f3d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.558663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac1127-dfad-4969-8322-f3c03e034f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.559167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac1127-dfad-4969-8322-f3c03e034f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.570474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac1127-dfad-4969-8322-f3c03e034f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.572224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac1127-dfad-4969-8322-f3c03e034f3d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-7aac1127-dfad-4969-8322-f3c03e034f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:04.591524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:04.593483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:04.594407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:04.594407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:04.594407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:04.594407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:04.596841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 418/828] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:04.602425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983837c7-2652-40e2-b20c-ba1bf965257f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.641819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:04.712323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983837c7-2652-40e2-b20c-ba1bf965257f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:04.748587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea70114-79ab-4b13-8903-326735efd593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.749442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea70114-79ab-4b13-8903-326735efd593 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.749864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea70114-79ab-4b13-8903-326735efd593 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.750144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea70114-79ab-4b13-8903-326735efd593 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.750896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea70114-79ab-4b13-8903-326735efd593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:04.751202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea70114-79ab-4b13-8903-326735efd593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.752566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea70114-79ab-4b13-8903-326735efd593 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.765280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 411/829] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:04.775828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac1127-dfad-4969-8322-f3c03e034f3d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.801546 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558949-8f33-40dd-9664-d70f77adc419 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.801864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558949-8f33-40dd-9664-d70f77adc419 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.802120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558949-8f33-40dd-9664-d70f77adc419 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.803754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 412/830] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:04.811764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305230f-8d11-46b1-96f4-45c44a54ae3d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.812245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305230f-8d11-46b1-96f4-45c44a54ae3d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.812693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305230f-8d11-46b1-96f4-45c44a54ae3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.832214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9305230f-8d11-46b1-96f4-45c44a54ae3d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:04.833439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9305230f-8d11-46b1-96f4-45c44a54ae3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:04.899416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac1127-dfad-4969-8322-f3c03e034f3d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:04.924985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 413/831] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:04.925391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:04.942900 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a94f1-77fb-40d4-bcee-b9c3bb2b8984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.943923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a94f1-77fb-40d4-bcee-b9c3bb2b8984 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.944500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a94f1-77fb-40d4-bcee-b9c3bb2b8984 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.944937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a94f1-77fb-40d4-bcee-b9c3bb2b8984 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.948185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305230f-8d11-46b1-96f4-45c44a54ae3d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.953700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a94f1-77fb-40d4-bcee-b9c3bb2b8984 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.955203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a94f1-77fb-40d4-bcee-b9c3bb2b8984 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-302a94f1-77fb-40d4-bcee-b9c3bb2b8984 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:56:04.970921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:04.971842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:04.972759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:56:04.972759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:56:04.972759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:56:04.972759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:56:04.972759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:56:04.972759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:56:04.972759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:04.972759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:04.972759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 419/832] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:04.977763 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a94f1-77fb-40d4-bcee-b9c3bb2b8984 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.979975 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:05.085998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a94f1-77fb-40d4-bcee-b9c3bb2b8984 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.090957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305230f-8d11-46b1-96f4-45c44a54ae3d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.124052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb14041-c1a2-4553-a1e0-e85e67a11d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.125120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb14041-c1a2-4553-a1e0-e85e67a11d04 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.125527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb14041-c1a2-4553-a1e0-e85e67a11d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.125909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb14041-c1a2-4553-a1e0-e85e67a11d04 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.126955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb14041-c1a2-4553-a1e0-e85e67a11d04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:05.127373 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb14041-c1a2-4553-a1e0-e85e67a11d04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.129015 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb14041-c1a2-4553-a1e0-e85e67a11d04 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.137145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c39bc-7e3d-46a0-b9f3-468e319f7498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.138173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c39bc-7e3d-46a0-b9f3-468e319f7498 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.139191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c39bc-7e3d-46a0-b9f3-468e319f7498 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.139702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c39bc-7e3d-46a0-b9f3-468e319f7498 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.146560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 420/833] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:56:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:05.149261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb14041-c1a2-4553-a1e0-e85e67a11d04 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.151666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c39bc-7e3d-46a0-b9f3-468e319f7498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-b11c39bc-7e3d-46a0-b9f3-468e319f7498 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:05.162407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:05.163566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:05.164607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:05.164607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:05.164607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:05.164607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:05.164607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:05.164607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:05.164607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:05.164607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:05.164607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:05.164607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:05.164607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:56:05.164607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:05.173009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 414/834] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:56:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:05.174734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c39bc-7e3d-46a0-b9f3-468e319f7498 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.209752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:05.283799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb14041-c1a2-4553-a1e0-e85e67a11d04 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.287923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:05.305689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c39bc-7e3d-46a0-b9f3-468e319f7498 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.329173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab430d-c93b-4648-9994-4e27d4f42bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.330505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab430d-c93b-4648-9994-4e27d4f42bab None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.331014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab430d-c93b-4648-9994-4e27d4f42bab None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.331593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab430d-c93b-4648-9994-4e27d4f42bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.333044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab430d-c93b-4648-9994-4e27d4f42bab None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=9884780c88aa48ffa92a696740761387) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:05.333655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab430d-c93b-4648-9994-4e27d4f42bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.335723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab430d-c93b-4648-9994-4e27d4f42bab None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.343699 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83659b90-af37-447f-b6ec-ef18dbf790ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.344144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 421/835] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:56:05 2022] GET /identity/v3/role_assignments?user.id=9884780c88aa48ffa92a696740761387&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:05.344778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83659b90-af37-447f-b6ec-ef18dbf790ef None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.345849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83659b90-af37-447f-b6ec-ef18dbf790ef None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.350835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83659b90-af37-447f-b6ec-ef18dbf790ef None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.351940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83659b90-af37-447f-b6ec-ef18dbf790ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:05.352469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83659b90-af37-447f-b6ec-ef18dbf790ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.354127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83659b90-af37-447f-b6ec-ef18dbf790ef None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.365098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 415/836] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:56:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:05.371183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab430d-c93b-4648-9994-4e27d4f42bab None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.499870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab430d-c93b-4648-9994-4e27d4f42bab None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.510938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:05.548494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569c37d-0fb4-4f3a-993c-f7a8e3cdd7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.549316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c37d-0fb4-4f3a-993c-f7a8e3cdd7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.549668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c37d-0fb4-4f3a-993c-f7a8e3cdd7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.549952 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c37d-0fb4-4f3a-993c-f7a8e3cdd7f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.561756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569c37d-0fb4-4f3a-993c-f7a8e3cdd7f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.563243 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569c37d-0fb4-4f3a-993c-f7a8e3cdd7f2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-0569c37d-0fb4-4f3a-993c-f7a8e3cdd7f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:05.582660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:05.583687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:05.584656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:05.584656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:05.584656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:05.584656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:05.584656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 422/837] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:05.589700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83659b90-af37-447f-b6ec-ef18dbf790ef None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.648460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4482e6-fde9-44e9-8cf5-6e747d3e0348 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.649011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4482e6-fde9-44e9-8cf5-6e747d3e0348 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.649490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4482e6-fde9-44e9-8cf5-6e747d3e0348 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.651194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 423/838] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:56:05.657254 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615a62-f97a-444f-9e9c-be323b7c33f7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.657552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615a62-f97a-444f-9e9c-be323b7c33f7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.657842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615a62-f97a-444f-9e9c-be323b7c33f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.675504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-fe615a62-f97a-444f-9e9c-be323b7c33f7 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:05.676695 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fe615a62-f97a-444f-9e9c-be323b7c33f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:05.698080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83659b90-af37-447f-b6ec-ef18dbf790ef None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.733585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264ac5d-35c2-4e42-8b61-ea375fc8122c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.734354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264ac5d-35c2-4e42-8b61-ea375fc8122c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.734677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264ac5d-35c2-4e42-8b61-ea375fc8122c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.734958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264ac5d-35c2-4e42-8b61-ea375fc8122c None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.735801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264ac5d-35c2-4e42-8b61-ea375fc8122c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:05.736113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264ac5d-35c2-4e42-8b61-ea375fc8122c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.737536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264ac5d-35c2-4e42-8b61-ea375fc8122c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.751653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 416/840] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:05.751840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 424/840] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:05.757001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264ac5d-35c2-4e42-8b61-ea375fc8122c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.766067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:05.776134 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe615a62-f97a-444f-9e9c-be323b7c33f7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.876183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:05.885789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264ac5d-35c2-4e42-8b61-ea375fc8122c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.887100 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe615a62-f97a-444f-9e9c-be323b7c33f7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.923103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bfbad-3cf6-46ef-87e1-fe766e5ecaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.923438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa041cc9-0067-4b28-a790-1006dcee4374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.924333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bfbad-3cf6-46ef-87e1-fe766e5ecaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.924455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa041cc9-0067-4b28-a790-1006dcee4374 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.924805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa041cc9-0067-4b28-a790-1006dcee4374 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.925054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bfbad-3cf6-46ef-87e1-fe766e5ecaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.925279 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa041cc9-0067-4b28-a790-1006dcee4374 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.925648 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bfbad-3cf6-46ef-87e1-fe766e5ecaa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.933669 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa041cc9-0067-4b28-a790-1006dcee4374 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.935438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa041cc9-0067-4b28-a790-1006dcee4374 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.937829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bfbad-3cf6-46ef-87e1-fe766e5ecaa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-556bfbad-3cf6-46ef-87e1-fe766e5ecaa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:05.945701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:05.946753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:05.947692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:05.947692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:05.947692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:05.947692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:05.947692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:05.947692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:05.947692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:05.947692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:05.947692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:05.947692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:05.947692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:56:05.947692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-aa041cc9-0067-4b28-a790-1006dcee4374 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:56:05.954947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:05.956219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:05.957228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:05.957228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:05.957228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:56:05.957228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:56:05.957228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:56:05.957228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:56:05.957228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:56:05.957228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:56:05.957228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:56:05.957228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:05.958192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 425/842] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:56:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:05.959645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 417/842] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 23 16:56:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:05.960779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bfbad-3cf6-46ef-87e1-fe766e5ecaa5 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.962520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa041cc9-0067-4b28-a790-1006dcee4374 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:06.033492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:06.068483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bfbad-3cf6-46ef-87e1-fe766e5ecaa5 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:06.075216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa041cc9-0067-4b28-a790-1006dcee4374 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:06.110726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d825b-0be0-4569-8c3b-2d74ff12e7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:06.111410 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d825b-0be0-4569-8c3b-2d74ff12e7ef None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:06.111701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d825b-0be0-4569-8c3b-2d74ff12e7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:06.111981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d825b-0be0-4569-8c3b-2d74ff12e7ef None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:06.112295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7310e6-8e14-4e3d-9e7d-4b98e800473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:06.112831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d825b-0be0-4569-8c3b-2d74ff12e7ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:06.113145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d825b-0be0-4569-8c3b-2d74ff12e7ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:06.113584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7310e6-8e14-4e3d-9e7d-4b98e800473d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:06.114066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7310e6-8e14-4e3d-9e7d-4b98e800473d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:06.114555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7310e6-8e14-4e3d-9e7d-4b98e800473d None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:06.114673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d825b-0be0-4569-8c3b-2d74ff12e7ef None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:06.115598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7310e6-8e14-4e3d-9e7d-4b98e800473d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:06.116099 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7310e6-8e14-4e3d-9e7d-4b98e800473d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:06.117655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7310e6-8e14-4e3d-9e7d-4b98e800473d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:06.127512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 418/843] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:56:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:06.133574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7310e6-8e14-4e3d-9e7d-4b98e800473d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:06.136852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 426/844] 10.222.0.49 () {56 vars in 1149 bytes} [Mon May 23 16:56:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:06.146402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d825b-0be0-4569-8c3b-2d74ff12e7ef None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:06.156220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:06.271264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d825b-0be0-4569-8c3b-2d74ff12e7ef None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:06.271622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7310e6-8e14-4e3d-9e7d-4b98e800473d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:06.307243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:06.309858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146328b1-181c-4385-9713-e5a5088fbd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:06.310644 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146328b1-181c-4385-9713-e5a5088fbd2d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:06.311363 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146328b1-181c-4385-9713-e5a5088fbd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:06.311363 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146328b1-181c-4385-9713-e5a5088fbd2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:06.318055 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc4af1-07ce-418f-bef4-835b0d427f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:06.319093 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4af1-07ce-418f-bef4-835b0d427f90 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:06.319554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4af1-07ce-418f-bef4-835b0d427f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:06.320001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4af1-07ce-418f-bef4-835b0d427f90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:06.335165 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc4af1-07ce-418f-bef4-835b0d427f90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:06.337289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc4af1-07ce-418f-bef4-835b0d427f90 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-13fc4af1-07ce-418f-bef4-835b0d427f90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:06.360539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:06.361695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:06.362753 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:06.362753 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:06.362753 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:06.362753 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:06.363710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 419/845] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:06.369958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc4af1-07ce-418f-bef4-835b0d427f90 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:06.394022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146328b1-181c-4385-9713-e5a5088fbd2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:06.395509 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146328b1-181c-4385-9713-e5a5088fbd2d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:06.406909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:06.495046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc4af1-07ce-418f-bef4-835b0d427f90 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:06.540649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998da4a-5688-40be-b622-a1a6718970ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:06.541766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998da4a-5688-40be-b622-a1a6718970ff None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:06.542266 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998da4a-5688-40be-b622-a1a6718970ff None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:06.542802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998da4a-5688-40be-b622-a1a6718970ff None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:06.543816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998da4a-5688-40be-b622-a1a6718970ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:06.544363 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998da4a-5688-40be-b622-a1a6718970ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:06.544990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 427/846] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:56:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:56:06.546571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146328b1-181c-4385-9713-e5a5088fbd2d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:06.547260 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998da4a-5688-40be-b622-a1a6718970ff None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:06.564050 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 420/847] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:06.570690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998da4a-5688-40be-b622-a1a6718970ff None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:06.630104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:06.667584 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146328b1-181c-4385-9713-e5a5088fbd2d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:06.678504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:06.709649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998da4a-5688-40be-b622-a1a6718970ff None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:06.713862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f2032-075f-44ba-9dc0-cf63b3f41a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:06.714946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f2032-075f-44ba-9dc0-cf63b3f41a93 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:06.715443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f2032-075f-44ba-9dc0-cf63b3f41a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:06.715927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f2032-075f-44ba-9dc0-cf63b3f41a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:06.727588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f2032-075f-44ba-9dc0-cf63b3f41a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:06.729342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f2032-075f-44ba-9dc0-cf63b3f41a93 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:06.745959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bc290-5cdf-4de5-9994-01808f657a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:06.746782 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bc290-5cdf-4de5-9994-01808f657a38 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:06.747071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bc290-5cdf-4de5-9994-01808f657a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:06.747343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bc290-5cdf-4de5-9994-01808f657a38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e23f2032-075f-44ba-9dc0-cf63b3f41a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:06.748129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:06.749524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:06.750997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:06.750997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:06.750997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:06.750997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:06.750997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 428/848] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:06.751409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f29f29-f416-4bc8-b6dd-d806810b1209 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:06.751664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f29f29-f416-4bc8-b6dd-d806810b1209 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:06.751948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f29f29-f416-4bc8-b6dd-d806810b1209 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:06.757748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 429/849] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:06.757748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f29f29-f416-4bc8-b6dd-d806810b1209 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:06.762566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3bc290-5cdf-4de5-9994-01808f657a38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:06.764006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3bc290-5cdf-4de5-9994-01808f657a38 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6c3bc290-5cdf-4de5-9994-01808f657a38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:56:06.781956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:06.783169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 421/850] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:56:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79bce0-f308-4984-8af5-b537fcde38f4 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:06.784212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79bce0-f308-4984-8af5-b537fcde38f4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:06.784941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79bce0-f308-4984-8af5-b537fcde38f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:06.802176 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6b79bce0-f308-4984-8af5-b537fcde38f4 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:06.803320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6b79bce0-f308-4984-8af5-b537fcde38f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:06.870404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 422/851] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:06.871001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79bce0-f308-4984-8af5-b537fcde38f4 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:06.891402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f29f29-f416-4bc8-b6dd-d806810b1209 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:06.905396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:06.931681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0dc27-252e-4af1-ba43-d56a5569652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:06.932344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0dc27-252e-4af1-ba43-d56a5569652a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:06.932630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0dc27-252e-4af1-ba43-d56a5569652a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:06.932908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0dc27-252e-4af1-ba43-d56a5569652a None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:06.933627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0dc27-252e-4af1-ba43-d56a5569652a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:06.933942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0dc27-252e-4af1-ba43-d56a5569652a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:06.935325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0dc27-252e-4af1-ba43-d56a5569652a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:06.956971 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 430/852] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:06.956971 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0dc27-252e-4af1-ba43-d56a5569652a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:06.977510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:07.007187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79bce0-f308-4984-8af5-b537fcde38f4 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:07.041844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abd8df-b106-4261-a0fa-e45c90cedee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:07.042541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abd8df-b106-4261-a0fa-e45c90cedee5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.042844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abd8df-b106-4261-a0fa-e45c90cedee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.043108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abd8df-b106-4261-a0fa-e45c90cedee5 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:07.043949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abd8df-b106-4261-a0fa-e45c90cedee5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:07.044261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abd8df-b106-4261-a0fa-e45c90cedee5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:07.046214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abd8df-b106-4261-a0fa-e45c90cedee5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:07.064815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0dc27-252e-4af1-ba43-d56a5569652a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:07.066516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 423/853] 10.222.0.49 () {56 vars in 1135 bytes} [Mon May 23 16:56:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:07.067353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abd8df-b106-4261-a0fa-e45c90cedee5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:07.103086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907dd44-d1c5-47da-a520-a8e278d5b076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:07.103880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907dd44-d1c5-47da-a520-a8e278d5b076 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.104164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907dd44-d1c5-47da-a520-a8e278d5b076 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.104561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907dd44-d1c5-47da-a520-a8e278d5b076 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:07.105169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907dd44-d1c5-47da-a520-a8e278d5b076 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:07.106536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907dd44-d1c5-47da-a520-a8e278d5b076 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-c907dd44-d1c5-47da-a520-a8e278d5b076 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:07.119203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:07.120287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:07.121163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 431/854] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:56:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:07.122784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907dd44-d1c5-47da-a520-a8e278d5b076 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:07.163422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:07.177902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abd8df-b106-4261-a0fa-e45c90cedee5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:07.215184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e4447-12c8-4126-a978-be8854bda008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:07.215990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e4447-12c8-4126-a978-be8854bda008 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.216588 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e4447-12c8-4126-a978-be8854bda008 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.216877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e4447-12c8-4126-a978-be8854bda008 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:07.222688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:07.224950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e4447-12c8-4126-a978-be8854bda008 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:07.226830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e4447-12c8-4126-a978-be8854bda008 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:07.239293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907dd44-d1c5-47da-a520-a8e278d5b076 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-056e4447-12c8-4126-a978-be8854bda008 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:56:07.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:07.244416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:07.245295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:56:07.245295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:56:07.245295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:56:07.245295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:56:07.245295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:56:07.245295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:56:07.245295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:07.245295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:07.245295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 424/855] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:07.245295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e4447-12c8-4126-a978-be8854bda008 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:07.284343 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018cce4-19c4-428e-8f36-b3783b17e7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:07.285265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018cce4-19c4-428e-8f36-b3783b17e7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.285553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018cce4-19c4-428e-8f36-b3783b17e7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.285833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018cce4-19c4-428e-8f36-b3783b17e7f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:07.354305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e4447-12c8-4126-a978-be8854bda008 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:07.372259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018cce4-19c4-428e-8f36-b3783b17e7f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:07.374376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018cce4-19c4-428e-8f36-b3783b17e7f9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:07.396128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc81409-81fa-4e25-8501-9602cc0855a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:07.396796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc81409-81fa-4e25-8501-9602cc0855a0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.397473 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc81409-81fa-4e25-8501-9602cc0855a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.397780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc81409-81fa-4e25-8501-9602cc0855a0 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:07.398532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc81409-81fa-4e25-8501-9602cc0855a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:07.398840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc81409-81fa-4e25-8501-9602cc0855a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:07.400196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc81409-81fa-4e25-8501-9602cc0855a0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:07.409619 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 425/856] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:56:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:07.409619 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc81409-81fa-4e25-8501-9602cc0855a0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:07.423668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:07.468774 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:07.493397 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 432/857] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:56:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:56:07.493397 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018cce4-19c4-428e-8f36-b3783b17e7f9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:07.526245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc81409-81fa-4e25-8501-9602cc0855a0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:07.562939 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ebac5-faed-46c2-abb6-8742bb222dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:07.563622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ebac5-faed-46c2-abb6-8742bb222dba None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.563908 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ebac5-faed-46c2-abb6-8742bb222dba None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.564192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ebac5-faed-46c2-abb6-8742bb222dba None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:07.565007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ebac5-faed-46c2-abb6-8742bb222dba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:07.565320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ebac5-faed-46c2-abb6-8742bb222dba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:07.566873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ebac5-faed-46c2-abb6-8742bb222dba None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:07.587323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 426/858] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:56:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:07.587323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ebac5-faed-46c2-abb6-8742bb222dba None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:07.610577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018cce4-19c4-428e-8f36-b3783b17e7f9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:07.645960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af43b8e-cb52-4f5a-9ded-74797a7f6e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:07.646665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af43b8e-cb52-4f5a-9ded-74797a7f6e27 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.646951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af43b8e-cb52-4f5a-9ded-74797a7f6e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.647234 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af43b8e-cb52-4f5a-9ded-74797a7f6e27 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:07.648004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af43b8e-cb52-4f5a-9ded-74797a7f6e27 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:07.648314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af43b8e-cb52-4f5a-9ded-74797a7f6e27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:07.649730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af43b8e-cb52-4f5a-9ded-74797a7f6e27 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:07.662393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 433/859] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:56:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:07.662393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af43b8e-cb52-4f5a-9ded-74797a7f6e27 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:07.677599 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:07.705746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ebac5-faed-46c2-abb6-8742bb222dba None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:07.727944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:07.755663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258f5e2-a8ff-4c28-aad4-d0e0e8323e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:07.756849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258f5e2-a8ff-4c28-aad4-d0e0e8323e2c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.758194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258f5e2-a8ff-4c28-aad4-d0e0e8323e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.758527 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258f5e2-a8ff-4c28-aad4-d0e0e8323e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:07.771964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258f5e2-a8ff-4c28-aad4-d0e0e8323e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:07.773465 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258f5e2-a8ff-4c28-aad4-d0e0e8323e2c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-4258f5e2-a8ff-4c28-aad4-d0e0e8323e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:07.793470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:07.794459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:07.795840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:07.795840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:07.795840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:07.795840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:07.799611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 427/860] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:07.801126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6b8b3-be9c-4a94-8561-fdf93d129ffa None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.801422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6b8b3-be9c-4a94-8561-fdf93d129ffa None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.801702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6b8b3-be9c-4a94-8561-fdf93d129ffa None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:07.803133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 428/861] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:07.803864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6b8b3-be9c-4a94-8561-fdf93d129ffa None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:07.805135 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af43b8e-cb52-4f5a-9ded-74797a7f6e27 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:07.847675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1aac8-ee2e-4f12-ad36-b8a54e946582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:07.848346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1aac8-ee2e-4f12-ad36-b8a54e946582 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.848636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1aac8-ee2e-4f12-ad36-b8a54e946582 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.848916 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1aac8-ee2e-4f12-ad36-b8a54e946582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:07.849754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1aac8-ee2e-4f12-ad36-b8a54e946582 None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=96230dd16acb4cdfa43b892b2b747282) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:07.850071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1aac8-ee2e-4f12-ad36-b8a54e946582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:07.851549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1aac8-ee2e-4f12-ad36-b8a54e946582 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:07.859365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 434/862] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:56:07 2022] GET /identity/v3/role_assignments?user.id=96230dd16acb4cdfa43b892b2b747282&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:07.860837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30b771-9640-4440-a717-b8652d2494b2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.861075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30b771-9640-4440-a717-b8652d2494b2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.861354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30b771-9640-4440-a717-b8652d2494b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:07.880353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0d30b771-9640-4440-a717-b8652d2494b2 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:07.881590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0d30b771-9640-4440-a717-b8652d2494b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:07.946033 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6b8b3-be9c-4a94-8561-fdf93d129ffa None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:07.967279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 435/863] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:07.989873 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30b771-9640-4440-a717-b8652d2494b2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:07.991183 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:07.996495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca37587-2757-43ab-9901-11cc89842c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:07.997605 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca37587-2757-43ab-9901-11cc89842c17 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.998169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca37587-2757-43ab-9901-11cc89842c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.999213 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca37587-2757-43ab-9901-11cc89842c17 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.000951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca37587-2757-43ab-9901-11cc89842c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:08.001567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca37587-2757-43ab-9901-11cc89842c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:08.004277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca37587-2757-43ab-9901-11cc89842c17 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:08.020047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 429/864] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:08.025784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca37587-2757-43ab-9901-11cc89842c17 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:08.044652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:08.121917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30b771-9640-4440-a717-b8652d2494b2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:08.158472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962f8ec-ebf3-4715-8bd8-6104e03ce58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:08.159059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca37587-2757-43ab-9901-11cc89842c17 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:08.159528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962f8ec-ebf3-4715-8bd8-6104e03ce58b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.159888 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962f8ec-ebf3-4715-8bd8-6104e03ce58b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.160263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962f8ec-ebf3-4715-8bd8-6104e03ce58b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.161021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962f8ec-ebf3-4715-8bd8-6104e03ce58b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:08.162525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962f8ec-ebf3-4715-8bd8-6104e03ce58b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-8962f8ec-ebf3-4715-8bd8-6104e03ce58b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:08.175470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:08.176624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:08.177671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 436/865] 10.222.0.49 () {56 vars in 1132 bytes} [Mon May 23 16:56:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:08.185130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962f8ec-ebf3-4715-8bd8-6104e03ce58b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:08.200265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfe86c-8678-4ddf-8707-942092dc1d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:08.201361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe86c-8678-4ddf-8707-942092dc1d7e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.202076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe86c-8678-4ddf-8707-942092dc1d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.202616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe86c-8678-4ddf-8707-942092dc1d7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.210179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfe86c-8678-4ddf-8707-942092dc1d7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:08.211967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfe86c-8678-4ddf-8707-942092dc1d7e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-69dfe86c-8678-4ddf-8707-942092dc1d7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:56:08.231713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:08.232842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:08.234458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:56:08.234458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:56:08.234458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:56:08.234458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:56:08.234458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:56:08.234458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:56:08.234458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:08.234458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:08.234458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 430/866] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:08.239404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfe86c-8678-4ddf-8707-942092dc1d7e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:08.296343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:08.327967 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962f8ec-ebf3-4715-8bd8-6104e03ce58b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:08.337593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:08.360136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfe86c-8678-4ddf-8707-942092dc1d7e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:08.374401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33362731-17d7-486f-9b7b-8194054c014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:08.374866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362731-17d7-486f-9b7b-8194054c014e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.375156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362731-17d7-486f-9b7b-8194054c014e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.375439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362731-17d7-486f-9b7b-8194054c014e None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.376647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33362731-17d7-486f-9b7b-8194054c014e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:08.376963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33362731-17d7-486f-9b7b-8194054c014e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:08.378888 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33362731-17d7-486f-9b7b-8194054c014e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:08.386461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 437/867] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 23 16:56:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:08.398453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33362731-17d7-486f-9b7b-8194054c014e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:08.405773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381385b-6764-40f4-8ab5-c764ca23b256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:08.406966 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381385b-6764-40f4-8ab5-c764ca23b256 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.407360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381385b-6764-40f4-8ab5-c764ca23b256 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.408068 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381385b-6764-40f4-8ab5-c764ca23b256 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.409284 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381385b-6764-40f4-8ab5-c764ca23b256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:08.409703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381385b-6764-40f4-8ab5-c764ca23b256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:08.411922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381385b-6764-40f4-8ab5-c764ca23b256 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:08.429751 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 431/868] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:56:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:08.435319 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381385b-6764-40f4-8ab5-c764ca23b256 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:08.512524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33362731-17d7-486f-9b7b-8194054c014e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:08.548148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381385b-6764-40f4-8ab5-c764ca23b256 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:08.549941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f2b15-61e2-4ee1-b2d8-8b2407c35b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:08.550650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f2b15-61e2-4ee1-b2d8-8b2407c35b47 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.550819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:08.550962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f2b15-61e2-4ee1-b2d8-8b2407c35b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.551259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f2b15-61e2-4ee1-b2d8-8b2407c35b47 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.552325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f2b15-61e2-4ee1-b2d8-8b2407c35b47 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:08.552325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f2b15-61e2-4ee1-b2d8-8b2407c35b47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:08.553630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f2b15-61e2-4ee1-b2d8-8b2407c35b47 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:08.566848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 438/869] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 23 16:56:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:08.593432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917f1d0-a8a2-4256-975f-29732ae4fa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:08.594410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917f1d0-a8a2-4256-975f-29732ae4fa59 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.594850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917f1d0-a8a2-4256-975f-29732ae4fa59 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.595282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917f1d0-a8a2-4256-975f-29732ae4fa59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.596300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917f1d0-a8a2-4256-975f-29732ae4fa59 None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=c22f94b1abe248c3969b68e17755f113) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:08.596811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917f1d0-a8a2-4256-975f-29732ae4fa59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:08.598458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917f1d0-a8a2-4256-975f-29732ae4fa59 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:08.606059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 432/870] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:56:08 2022] GET /identity/v3/role_assignments?user.id=c22f94b1abe248c3969b68e17755f113&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:10.073729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ad63c-5a64-4cdf-903b-a48215b50e56 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:10.075114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ad63c-5a64-4cdf-903b-a48215b50e56 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:10.075639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ad63c-5a64-4cdf-903b-a48215b50e56 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:10.078049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 439/871] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:10.085899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c810b-3a63-4a31-9bca-373a06bdba7c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:10.086831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c810b-3a63-4a31-9bca-373a06bdba7c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:10.087317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c810b-3a63-4a31-9bca-373a06bdba7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:10.108227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-931c810b-3a63-4a31-9bca-373a06bdba7c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:10.109716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-931c810b-3a63-4a31-9bca-373a06bdba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:10.180801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 433/872] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:10.204709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ad63c-5a64-4cdf-903b-a48215b50e56 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:10.217904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36467a-d2a0-49d4-9cf8-0efab211d7d6 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:10.218212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36467a-d2a0-49d4-9cf8-0efab211d7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:10.218530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36467a-d2a0-49d4-9cf8-0efab211d7d6 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:10.220157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 434/873] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:56:10.225134 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a344-5c8f-439c-99cf-24ed6291ad13 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:10.225439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a344-5c8f-439c-99cf-24ed6291ad13 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:10.225695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a344-5c8f-439c-99cf-24ed6291ad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:10.243481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-be39a344-5c8f-439c-99cf-24ed6291ad13 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:10.244690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-be39a344-5c8f-439c-99cf-24ed6291ad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:10.250325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:10.330582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 435/874] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:10.339869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ad63c-5a64-4cdf-903b-a48215b50e56 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:10.346167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39a344-5c8f-439c-99cf-24ed6291ad13 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:10.376485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:10.400579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7941ad-8b60-4607-9c7d-8ea85220484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:10.401865 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7941ad-8b60-4607-9c7d-8ea85220484b None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:10.402389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7941ad-8b60-4607-9c7d-8ea85220484b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:10.403156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7941ad-8b60-4607-9c7d-8ea85220484b None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:10.404127 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7941ad-8b60-4607-9c7d-8ea85220484b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:10.405815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7941ad-8b60-4607-9c7d-8ea85220484b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:10.435461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 440/875] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:56:10 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:10.472443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39a344-5c8f-439c-99cf-24ed6291ad13 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:10.521296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86990e7-04fe-4147-891d-f8877fffee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:10.522231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86990e7-04fe-4147-891d-f8877fffee26 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:10.522550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86990e7-04fe-4147-891d-f8877fffee26 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:10.522828 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86990e7-04fe-4147-891d-f8877fffee26 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:10.535799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86990e7-04fe-4147-891d-f8877fffee26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-a86990e7-04fe-4147-891d-f8877fffee26 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:10.544506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:10.546146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:10.547194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:10.547194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:10.547194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:10.547194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:10.547194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:10.547194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:10.547194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:10.547194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:10.547194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:10.547194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:10.547194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:56:10.547194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:10.550496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 436/876] 10.222.0.49 () {56 vars in 1120 bytes} [Mon May 23 16:56:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:10.552989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7941ad-8b60-4607-9c7d-8ea85220484b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:10.662412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:10.671929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7941ad-8b60-4607-9c7d-8ea85220484b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:10.714069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47923a7-05a4-486c-85af-d09e13c43052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:10.714803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47923a7-05a4-486c-85af-d09e13c43052 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:10.715087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47923a7-05a4-486c-85af-d09e13c43052 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:10.715366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47923a7-05a4-486c-85af-d09e13c43052 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:10.716126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47923a7-05a4-486c-85af-d09e13c43052 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:10.716432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47923a7-05a4-486c-85af-d09e13c43052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:10.718084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47923a7-05a4-486c-85af-d09e13c43052 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:10.730487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 441/877] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 23 16:56:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:10.733319 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86990e7-04fe-4147-891d-f8877fffee26 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:10.830211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:10.847927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86990e7-04fe-4147-891d-f8877fffee26 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:10.881741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019c995-b757-423b-9502-6088b782ef09 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:10.882405 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019c995-b757-423b-9502-6088b782ef09 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:10.882917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019c995-b757-423b-9502-6088b782ef09 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:10.883952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ed4e-7ef3-495f-a7dd-cf83d6f2ef5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:10.884785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ed4e-7ef3-495f-a7dd-cf83d6f2ef5a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:10.885018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ed4e-7ef3-495f-a7dd-cf83d6f2ef5a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:10.885395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ed4e-7ef3-495f-a7dd-cf83d6f2ef5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:10.885600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 442/878] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:10.891858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eda444-e461-4ddb-a5c7-9dc1171fd8b0 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:10.892426 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eda444-e461-4ddb-a5c7-9dc1171fd8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:10.892906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eda444-e461-4ddb-a5c7-9dc1171fd8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:10.899534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8ed4e-7ef3-495f-a7dd-cf83d6f2ef5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:10.901101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8ed4e-7ef3-495f-a7dd-cf83d6f2ef5a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:10.912163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-05eda444-e461-4ddb-a5c7-9dc1171fd8b0 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:10.913731 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-05eda444-e461-4ddb-a5c7-9dc1171fd8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-fce8ed4e-7ef3-495f-a7dd-cf83d6f2ef5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:10.919696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:10.921221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:10.923031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:10.923031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:10.923031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:10.923031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:10.926070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 437/879] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:10.927377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ed4e-7ef3-495f-a7dd-cf83d6f2ef5a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:11.010383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 443/880] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:10 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:11.010383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98decfae-fd44-4029-ac47-ff8063426461 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.010383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98decfae-fd44-4029-ac47-ff8063426461 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.010383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98decfae-fd44-4029-ac47-ff8063426461 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.011760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 444/881] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:11.017710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fd0fa-bb2f-429c-ac33-cbf55da4cbcc None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.018164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fd0fa-bb2f-429c-ac33-cbf55da4cbcc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.018477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fd0fa-bb2f-429c-ac33-cbf55da4cbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.036514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ed4e-7ef3-495f-a7dd-cf83d6f2ef5a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:11.038706 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-696fd0fa-bb2f-429c-ac33-cbf55da4cbcc None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:11.039878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-696fd0fa-bb2f-429c-ac33-cbf55da4cbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:11.072625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a901ff6-c8e7-4401-9a3c-567af492b07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:11.073304 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a901ff6-c8e7-4401-9a3c-567af492b07d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.073595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a901ff6-c8e7-4401-9a3c-567af492b07d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.073877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a901ff6-c8e7-4401-9a3c-567af492b07d None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.075008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a901ff6-c8e7-4401-9a3c-567af492b07d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:11.075401 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a901ff6-c8e7-4401-9a3c-567af492b07d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:11.077344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a901ff6-c8e7-4401-9a3c-567af492b07d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:11.079988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:11.091739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 438/882] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:11.092686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a901ff6-c8e7-4401-9a3c-567af492b07d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:11.115409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 445/883] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:11.127227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fd0fa-bb2f-429c-ac33-cbf55da4cbcc None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:11.147317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:11.200341 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a901ff6-c8e7-4401-9a3c-567af492b07d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:11.237217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fd0fa-bb2f-429c-ac33-cbf55da4cbcc None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:11.239547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08dd2b-ac9f-4493-88f8-4b6c39ad24d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:11.240293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08dd2b-ac9f-4493-88f8-4b6c39ad24d8 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.240586 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08dd2b-ac9f-4493-88f8-4b6c39ad24d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.240866 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08dd2b-ac9f-4493-88f8-4b6c39ad24d8 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.241592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08dd2b-ac9f-4493-88f8-4b6c39ad24d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:11.243000 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08dd2b-ac9f-4493-88f8-4b6c39ad24d8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:11.262457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 439/884] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:56:11 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:11.262457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08dd2b-ac9f-4493-88f8-4b6c39ad24d8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:11.287639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545b981-7a9f-4ecb-b791-a2a7133003c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:11.288955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545b981-7a9f-4ecb-b791-a2a7133003c7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.289502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545b981-7a9f-4ecb-b791-a2a7133003c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.289940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545b981-7a9f-4ecb-b791-a2a7133003c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.299756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545b981-7a9f-4ecb-b791-a2a7133003c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:11.301692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545b981-7a9f-4ecb-b791-a2a7133003c7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b545b981-7a9f-4ecb-b791-a2a7133003c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:56:11.319942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:11.321173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:11.322309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:11.322309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:11.322309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:56:11.322309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:56:11.322309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:56:11.322309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:56:11.322309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:56:11.322309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:56:11.322309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:56:11.322309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:11.325281 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 446/885] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 23 16:56:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:11.326299 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:11.332365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545b981-7a9f-4ecb-b791-a2a7133003c7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:11.381443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08dd2b-ac9f-4493-88f8-4b6c39ad24d8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:11.421453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a960d-d4e4-48ec-b67a-efc11ef93981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:11.422279 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a960d-d4e4-48ec-b67a-efc11ef93981 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.422615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a960d-d4e4-48ec-b67a-efc11ef93981 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.422901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a960d-d4e4-48ec-b67a-efc11ef93981 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.423797 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a960d-d4e4-48ec-b67a-efc11ef93981 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:11.425568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a960d-d4e4-48ec-b67a-efc11ef93981 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:11.435144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-9b3a960d-d4e4-48ec-b67a-efc11ef93981 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:11.447631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:11.449987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:11.451854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:11.456032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 440/886] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 23 16:56:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:11.463934 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a960d-d4e4-48ec-b67a-efc11ef93981 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:11.471558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545b981-7a9f-4ecb-b791-a2a7133003c7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:11.522900 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77a0cc-b78f-491c-86b6-5aee9afcd83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:11.523712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77a0cc-b78f-491c-86b6-5aee9afcd83f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.524009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77a0cc-b78f-491c-86b6-5aee9afcd83f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.524293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77a0cc-b78f-491c-86b6-5aee9afcd83f None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.525142 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77a0cc-b78f-491c-86b6-5aee9afcd83f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:11.525894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77a0cc-b78f-491c-86b6-5aee9afcd83f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:11.527638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77a0cc-b78f-491c-86b6-5aee9afcd83f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:11.552588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 447/887] 10.222.0.49 () {56 vars in 1149 bytes} [Mon May 23 16:56:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:11.560229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77a0cc-b78f-491c-86b6-5aee9afcd83f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:11.580065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a960d-d4e4-48ec-b67a-efc11ef93981 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:11.601427 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:11.617560 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d83e6-bec0-4982-974f-9f47b3fc3417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:11.618321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d83e6-bec0-4982-974f-9f47b3fc3417 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.618711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d83e6-bec0-4982-974f-9f47b3fc3417 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.619068 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d83e6-bec0-4982-974f-9f47b3fc3417 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.619851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d83e6-bec0-4982-974f-9f47b3fc3417 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:11.620229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d83e6-bec0-4982-974f-9f47b3fc3417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:11.621725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d83e6-bec0-4982-974f-9f47b3fc3417 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:11.627635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 441/888] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 23 16:56:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:11.634474 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d83e6-bec0-4982-974f-9f47b3fc3417 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:11.690918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77a0cc-b78f-491c-86b6-5aee9afcd83f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:11.731616 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:11.740448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab2f1c-6ab4-4ad8-a1e2-45eadd546cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:11.741324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab2f1c-6ab4-4ad8-a1e2-45eadd546cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.741718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab2f1c-6ab4-4ad8-a1e2-45eadd546cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.742100 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab2f1c-6ab4-4ad8-a1e2-45eadd546cc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.760653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d83e6-bec0-4982-974f-9f47b3fc3417 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:11.812444 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb7cc6-143f-42a6-9eb5-1e505f4db0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:11.813117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb7cc6-143f-42a6-9eb5-1e505f4db0df None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.813407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb7cc6-143f-42a6-9eb5-1e505f4db0df None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.813687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb7cc6-143f-42a6-9eb5-1e505f4db0df None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.814430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb7cc6-143f-42a6-9eb5-1e505f4db0df None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:11.814747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb7cc6-143f-42a6-9eb5-1e505f4db0df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:11.816129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb7cc6-143f-42a6-9eb5-1e505f4db0df None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:11.826394 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 442/889] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 23 16:56:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:11.838881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab2f1c-6ab4-4ad8-a1e2-45eadd546cc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:11.840368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab2f1c-6ab4-4ad8-a1e2-45eadd546cc7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:11.952591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 448/890] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:56:11 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:56:11.959878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb7cc6-143f-42a6-9eb5-1e505f4db0df None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:12.018184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:12.078102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb7cc6-143f-42a6-9eb5-1e505f4db0df None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:12.116703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c83ed-1502-4a15-832a-395ce45482d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:12.117561 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c83ed-1502-4a15-832a-395ce45482d5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:12.117864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c83ed-1502-4a15-832a-395ce45482d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:12.118030 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c83ed-1502-4a15-832a-395ce45482d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:12.130751 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c83ed-1502-4a15-832a-395ce45482d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:12.132303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c83ed-1502-4a15-832a-395ce45482d5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-786c83ed-1502-4a15-832a-395ce45482d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:12.152309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:12.153278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:12.154202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:12.154202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:12.154202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:12.154202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:12.154202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 443/891] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:12.160997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab2f1c-6ab4-4ad8-a1e2-45eadd546cc7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:12.191858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:12.265073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab2f1c-6ab4-4ad8-a1e2-45eadd546cc7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:12.300861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe3f09-3389-4c49-8b0e-8733a61de6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:12.301460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe3f09-3389-4c49-8b0e-8733a61de6ec None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:12.301748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe3f09-3389-4c49-8b0e-8733a61de6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:12.302026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe3f09-3389-4c49-8b0e-8733a61de6ec None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:12.302784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe3f09-3389-4c49-8b0e-8733a61de6ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:12.303096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe3f09-3389-4c49-8b0e-8733a61de6ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:12.304454 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe3f09-3389-4c49-8b0e-8733a61de6ec None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:12.316846 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 449/892] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:12.322741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c83ed-1502-4a15-832a-395ce45482d5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:12.431016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:12.434613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c83ed-1502-4a15-832a-395ce45482d5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:12.474008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5fd61-39d4-4e26-b51b-f61612ce1c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:12.475269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5fd61-39d4-4e26-b51b-f61612ce1c1e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:12.475789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5fd61-39d4-4e26-b51b-f61612ce1c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:12.476270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5fd61-39d4-4e26-b51b-f61612ce1c1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:12.484577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5fd61-39d4-4e26-b51b-f61612ce1c1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:12.486428 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5fd61-39d4-4e26-b51b-f61612ce1c1e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-7fb5fd61-39d4-4e26-b51b-f61612ce1c1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:56:12.502789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:12.504339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:12.505909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:56:12.505909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:56:12.505909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:56:12.505909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:56:12.505909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:56:12.505909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:56:12.505909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:12.505909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:12.508847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 444/893] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:12.515365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe3f09-3389-4c49-8b0e-8733a61de6ec None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:12.610992 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:12.619530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe3f09-3389-4c49-8b0e-8733a61de6ec None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:12.656442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a35e3-5c27-42bb-a1aa-263f1c8c4488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:12.657271 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a35e3-5c27-42bb-a1aa-263f1c8c4488 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:12.657745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a35e3-5c27-42bb-a1aa-263f1c8c4488 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:12.658212 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a35e3-5c27-42bb-a1aa-263f1c8c4488 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:12.659799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a35e3-5c27-42bb-a1aa-263f1c8c4488 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:12.660338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a35e3-5c27-42bb-a1aa-263f1c8c4488 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:12.663109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a35e3-5c27-42bb-a1aa-263f1c8c4488 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:12.679728 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 450/894] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:56:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:12.685717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5fd61-39d4-4e26-b51b-f61612ce1c1e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:12.807744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5fd61-39d4-4e26-b51b-f61612ce1c1e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:12.843973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987596d-6bab-4c52-ab64-bd4c21c381e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:12.844636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987596d-6bab-4c52-ab64-bd4c21c381e5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:12.844921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987596d-6bab-4c52-ab64-bd4c21c381e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:12.845200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987596d-6bab-4c52-ab64-bd4c21c381e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:12.846039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987596d-6bab-4c52-ab64-bd4c21c381e5 None admin] RBAC: Adding query filter params (role.id=17a702ca9868424f82b0bc9637326a8e, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=96230dd16acb4cdfa43b892b2b747282) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:12.846353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987596d-6bab-4c52-ab64-bd4c21c381e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:12.847801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987596d-6bab-4c52-ab64-bd4c21c381e5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:12.853825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 445/895] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:56:12 2022] GET /identity/v3/role_assignments?user.id=96230dd16acb4cdfa43b892b2b747282&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=17a702ca9868424f82b0bc9637326a8e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:12.869903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb852f05-335f-4357-947b-0eb68500a999 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:12.870199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb852f05-335f-4357-947b-0eb68500a999 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:12.870483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb852f05-335f-4357-947b-0eb68500a999 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:12.872104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 451/896] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:12.877993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e224bd1-d3b7-4f9d-987a-a3c24c58761c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:12.878312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e224bd1-d3b7-4f9d-987a-a3c24c58761c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:12.878584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e224bd1-d3b7-4f9d-987a-a3c24c58761c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:12.897373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0e224bd1-d3b7-4f9d-987a-a3c24c58761c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:12.898613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0e224bd1-d3b7-4f9d-987a-a3c24c58761c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:12.918995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:12.978512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 446/897] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:13.002206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb852f05-335f-4357-947b-0eb68500a999 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.117037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb852f05-335f-4357-947b-0eb68500a999 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:13.153366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce04c0-8e66-447d-8f4f-f319019fbc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:13.154716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce04c0-8e66-447d-8f4f-f319019fbc54 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.155223 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce04c0-8e66-447d-8f4f-f319019fbc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.155695 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce04c0-8e66-447d-8f4f-f319019fbc54 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.156560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce04c0-8e66-447d-8f4f-f319019fbc54 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:13.158171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce04c0-8e66-447d-8f4f-f319019fbc54 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-70ce04c0-8e66-447d-8f4f-f319019fbc54 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:13.171982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:13.173452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:56:13.174295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:13.177265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 452/898] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:56:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:13.183487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e224bd1-d3b7-4f9d-987a-a3c24c58761c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.292110 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e224bd1-d3b7-4f9d-987a-a3c24c58761c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:13.328547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58544b2-7ef7-4017-a45d-956ffef48270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:13.329223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58544b2-7ef7-4017-a45d-956ffef48270 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.329512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58544b2-7ef7-4017-a45d-956ffef48270 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.329791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58544b2-7ef7-4017-a45d-956ffef48270 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.330543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58544b2-7ef7-4017-a45d-956ffef48270 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:13.330852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58544b2-7ef7-4017-a45d-956ffef48270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:13.332220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58544b2-7ef7-4017-a45d-956ffef48270 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:13.337553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 447/899] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:56:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:13.343543 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce04c0-8e66-447d-8f4f-f319019fbc54 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.364447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:13.465025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce04c0-8e66-447d-8f4f-f319019fbc54 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:13.500627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88b1e6-bb22-45b8-8268-871d0b542c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:13.501305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88b1e6-bb22-45b8-8268-871d0b542c51 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.501598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88b1e6-bb22-45b8-8268-871d0b542c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.501889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88b1e6-bb22-45b8-8268-871d0b542c51 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.502630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88b1e6-bb22-45b8-8268-871d0b542c51 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:13.502940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88b1e6-bb22-45b8-8268-871d0b542c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:13.504376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88b1e6-bb22-45b8-8268-871d0b542c51 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:13.509835 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 453/900] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:56:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:13.516253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58544b2-7ef7-4017-a45d-956ffef48270 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.538959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:13.592808 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3074ef-f02a-4ea1-b390-aa03667ffb3f None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.593138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3074ef-f02a-4ea1-b390-aa03667ffb3f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.593378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3074ef-f02a-4ea1-b390-aa03667ffb3f None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.594944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 454/901] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:56:13.599901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788aef2-d796-49bd-bda4-b5a309067dd6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.600195 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788aef2-d796-49bd-bda4-b5a309067dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.600478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788aef2-d796-49bd-bda4-b5a309067dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.619062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6788aef2-d796-49bd-bda4-b5a309067dd6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:13.620260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6788aef2-d796-49bd-bda4-b5a309067dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:13.637034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58544b2-7ef7-4017-a45d-956ffef48270 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:13.675389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd610d-bbd2-4881-a4e6-882e6254fc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:13.676309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd610d-bbd2-4881-a4e6-882e6254fc02 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.676693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd610d-bbd2-4881-a4e6-882e6254fc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.677072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd610d-bbd2-4881-a4e6-882e6254fc02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.678180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd610d-bbd2-4881-a4e6-882e6254fc02 None admin] RBAC: Adding query filter params (interface=public, service_id=ce0cec828e744447b685a9e157412bbe, region_id=RegionOne) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:13.678661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd610d-bbd2-4881-a4e6-882e6254fc02 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:13.680123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd610d-bbd2-4881-a4e6-882e6254fc02 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:13.693026 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 448/902] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 23 16:56:13 2022] GET /identity/v3/endpoints?service_id=ce0cec828e744447b685a9e157412bbe&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:13.694124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd610d-bbd2-4881-a4e6-882e6254fc02 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.702538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 455/903] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:13.727365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788aef2-d796-49bd-bda4-b5a309067dd6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.739377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:13.812289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:13.837584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd610d-bbd2-4881-a4e6-882e6254fc02 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:13.862857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788aef2-d796-49bd-bda4-b5a309067dd6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:13.877032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d886a8d-9fcb-4b6c-a0bc-7a9401cdef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:13.877838 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d886a8d-9fcb-4b6c-a0bc-7a9401cdef02 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.878228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d886a8d-9fcb-4b6c-a0bc-7a9401cdef02 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.878639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d886a8d-9fcb-4b6c-a0bc-7a9401cdef02 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.879533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d886a8d-9fcb-4b6c-a0bc-7a9401cdef02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:13.881140 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d886a8d-9fcb-4b6c-a0bc-7a9401cdef02 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:13.895548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 449/904] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 23 16:56:13 2022] GET /identity/v3/services => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:13.908392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5dd3a-d2b4-4153-bd67-299f8cd62b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:13.909247 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5dd3a-d2b4-4153-bd67-299f8cd62b77 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.909543 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5dd3a-d2b4-4153-bd67-299f8cd62b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.910230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5dd3a-d2b4-4153-bd67-299f8cd62b77 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.911149 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5dd3a-d2b4-4153-bd67-299f8cd62b77 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:13.912585 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5dd3a-d2b4-4153-bd67-299f8cd62b77 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-23d5dd3a-d2b4-4153-bd67-299f8cd62b77 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:13.926141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:13.927204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:13.928073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 456/905] 10.222.0.49 () {56 vars in 1132 bytes} [Mon May 23 16:56:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:13.935537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d886a8d-9fcb-4b6c-a0bc-7a9401cdef02 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:14.052344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d886a8d-9fcb-4b6c-a0bc-7a9401cdef02 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.091252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879b6fc-7cb3-40a9-bfbc-77f8556829e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.091934 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879b6fc-7cb3-40a9-bfbc-77f8556829e3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.092940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879b6fc-7cb3-40a9-bfbc-77f8556829e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.093358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879b6fc-7cb3-40a9-bfbc-77f8556829e3 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.094086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879b6fc-7cb3-40a9-bfbc-77f8556829e3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:14.094425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879b6fc-7cb3-40a9-bfbc-77f8556829e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.095807 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879b6fc-7cb3-40a9-bfbc-77f8556829e3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.100888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 450/906] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 23 16:56:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:14.106505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5dd3a-d2b4-4153-bd67-299f8cd62b77 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:14.191554 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:14.225917 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60e6aa-8616-48f9-8870-5d153be6839f None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.226933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60e6aa-8616-48f9-8870-5d153be6839f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.227419 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60e6aa-8616-48f9-8870-5d153be6839f None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.229283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5dd3a-d2b4-4153-bd67-299f8cd62b77 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.229400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 451/907] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:56:14.235872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9687a-6f41-4665-b8a9-be633bdbf584 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.236452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9687a-6f41-4665-b8a9-be633bdbf584 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.237082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9687a-6f41-4665-b8a9-be633bdbf584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.256316 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-adb9687a-6f41-4665-b8a9-be633bdbf584 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:14.258234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-adb9687a-6f41-4665-b8a9-be633bdbf584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:14.262612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:14.272375 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0281e6-f212-4a79-add6-c1094895640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.273779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0281e6-f212-4a79-add6-c1094895640d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.274591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0281e6-f212-4a79-add6-c1094895640d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.275097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0281e6-f212-4a79-add6-c1094895640d None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.276338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0281e6-f212-4a79-add6-c1094895640d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:14.277314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0281e6-f212-4a79-add6-c1094895640d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.279451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0281e6-f212-4a79-add6-c1094895640d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.292973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 457/908] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 23 16:56:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:14.293856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0281e6-f212-4a79-add6-c1094895640d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:14.346463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 452/909] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:14.365032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9687a-6f41-4665-b8a9-be633bdbf584 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:14.414397 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0281e6-f212-4a79-add6-c1094895640d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.458434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2d39-b613-45a8-aa6e-d06d080ecda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.459089 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2d39-b613-45a8-aa6e-d06d080ecda4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.459379 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2d39-b613-45a8-aa6e-d06d080ecda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.459656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2d39-b613-45a8-aa6e-d06d080ecda4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.460578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2d39-b613-45a8-aa6e-d06d080ecda4 None admin] RBAC: Adding query filter params (interface=public, service_id=20d9940003aa4b3abc1bcb0fe27f504c, region_id=RegionOne) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:14.460974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2d39-b613-45a8-aa6e-d06d080ecda4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.462349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2d39-b613-45a8-aa6e-d06d080ecda4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.465372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:14.470784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 458/910] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 23 16:56:14 2022] GET /identity/v3/endpoints?service_id=20d9940003aa4b3abc1bcb0fe27f504c&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:14.476168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2d39-b613-45a8-aa6e-d06d080ecda4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:14.504855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9687a-6f41-4665-b8a9-be633bdbf584 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.556051 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8054e86-07d7-4132-8d66-1564add61c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.557069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8054e86-07d7-4132-8d66-1564add61c25 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.557505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8054e86-07d7-4132-8d66-1564add61c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.558136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8054e86-07d7-4132-8d66-1564add61c25 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.559923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8054e86-07d7-4132-8d66-1564add61c25 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.561948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8054e86-07d7-4132-8d66-1564add61c25 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.575365 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:14.584656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 453/911] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:56:14 2022] POST /identity/v3/services => generated 241 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:14.600896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2d39-b613-45a8-aa6e-d06d080ecda4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.648120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09815a1e-d187-48bd-acf5-9f44b86cf57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.649221 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815a1e-d187-48bd-acf5-9f44b86cf57c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.649714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815a1e-d187-48bd-acf5-9f44b86cf57c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.650194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815a1e-d187-48bd-acf5-9f44b86cf57c None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.651134 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09815a1e-d187-48bd-acf5-9f44b86cf57c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.652779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09815a1e-d187-48bd-acf5-9f44b86cf57c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.660765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 459/912] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 23 16:56:14 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:15.306580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff68202-aa68-4ba2-96e9-4aba11e241c4 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:15.307103 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff68202-aa68-4ba2-96e9-4aba11e241c4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:15.307210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff68202-aa68-4ba2-96e9-4aba11e241c4 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:15.308757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 454/913] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:15.314720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e6b9b-322f-43b5-93e3-1ab48a43bf7a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:15.315118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e6b9b-322f-43b5-93e3-1ab48a43bf7a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:15.315287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e6b9b-322f-43b5-93e3-1ab48a43bf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:15.334211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3b3e6b9b-322f-43b5-93e3-1ab48a43bf7a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:15.335444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3b3e6b9b-322f-43b5-93e3-1ab48a43bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:15.397104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:15.410072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 460/914] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:15.433098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff68202-aa68-4ba2-96e9-4aba11e241c4 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:15.538804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff68202-aa68-4ba2-96e9-4aba11e241c4 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:15.576877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14d0ad-b1cf-4587-a3f9-d3f5e4320996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:15.577735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d0ad-b1cf-4587-a3f9-d3f5e4320996 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:15.578027 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d0ad-b1cf-4587-a3f9-d3f5e4320996 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:15.578311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d0ad-b1cf-4587-a3f9-d3f5e4320996 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:15.589091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14d0ad-b1cf-4587-a3f9-d3f5e4320996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-0b14d0ad-b1cf-4587-a3f9-d3f5e4320996 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:15.597833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:15.598813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:15.599681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 455/915] 10.222.0.49 () {56 vars in 1120 bytes} [Mon May 23 16:56:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:15.605403 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e6b9b-322f-43b5-93e3-1ab48a43bf7a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:15.705411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e6b9b-322f-43b5-93e3-1ab48a43bf7a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:15.739958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69507e-9bad-4b73-b14d-9e8066bb8864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:15.740639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69507e-9bad-4b73-b14d-9e8066bb8864 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:15.740928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69507e-9bad-4b73-b14d-9e8066bb8864 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:15.741211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69507e-9bad-4b73-b14d-9e8066bb8864 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:15.741965 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69507e-9bad-4b73-b14d-9e8066bb8864 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:15.742278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69507e-9bad-4b73-b14d-9e8066bb8864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:15.743698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69507e-9bad-4b73-b14d-9e8066bb8864 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:15.757487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 461/916] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 23 16:56:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:15.758833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14d0ad-b1cf-4587-a3f9-d3f5e4320996 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:15.833930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:15.880160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14d0ad-b1cf-4587-a3f9-d3f5e4320996 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:15.915723 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfa7f1-b50a-4e10-97ce-82e534fa5ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:15.916703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfa7f1-b50a-4e10-97ce-82e534fa5ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:15.916996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfa7f1-b50a-4e10-97ce-82e534fa5ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:15.917278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfa7f1-b50a-4e10-97ce-82e534fa5ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:15.929705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfa7f1-b50a-4e10-97ce-82e534fa5ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:15.931317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfa7f1-b50a-4e10-97ce-82e534fa5ca5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-7bbfa7f1-b50a-4e10-97ce-82e534fa5ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:15.948949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:15.950132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:15.951070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:15.951070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:15.951070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:15.951070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:15.951070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 456/917] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:15.957335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69507e-9bad-4b73-b14d-9e8066bb8864 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.020705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:16.069746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69507e-9bad-4b73-b14d-9e8066bb8864 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.108538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787092b6-2987-4378-8483-ec6712d0a9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.109532 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787092b6-2987-4378-8483-ec6712d0a9be None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.109996 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787092b6-2987-4378-8483-ec6712d0a9be None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.110469 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787092b6-2987-4378-8483-ec6712d0a9be None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.111349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787092b6-2987-4378-8483-ec6712d0a9be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:16.111805 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787092b6-2987-4378-8483-ec6712d0a9be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.113302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787092b6-2987-4378-8483-ec6712d0a9be None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.125949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 462/918] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:16.131440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfa7f1-b50a-4e10-97ce-82e534fa5ca5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.203852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0391263-0136-4c7a-a801-442c7bf03a33 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.204395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0391263-0136-4c7a-a801-442c7bf03a33 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.204682 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0391263-0136-4c7a-a801-442c7bf03a33 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.206320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 463/919] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:16.211165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e47619-7335-45e8-b67a-bd9f2ce5f656 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.211477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e47619-7335-45e8-b67a-bd9f2ce5f656 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.211760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e47619-7335-45e8-b67a-bd9f2ce5f656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.229227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e1e47619-7335-45e8-b67a-bd9f2ce5f656 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:16.230672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e1e47619-7335-45e8-b67a-bd9f2ce5f656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:16.237492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfa7f1-b50a-4e10-97ce-82e534fa5ca5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.254895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:16.285063 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee17739-2223-49f6-86ec-40fed79f244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.285891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee17739-2223-49f6-86ec-40fed79f244a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.286182 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee17739-2223-49f6-86ec-40fed79f244a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.286518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee17739-2223-49f6-86ec-40fed79f244a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.296462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee17739-2223-49f6-86ec-40fed79f244a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.298201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee17739-2223-49f6-86ec-40fed79f244a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.312754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 464/920] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-aee17739-2223-49f6-86ec-40fed79f244a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:56:16.319211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:16.320690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:16.321883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:16.321883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:16.321883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:56:16.321883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:56:16.321883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:56:16.321883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:56:16.321883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:56:16.321883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:56:16.321883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:56:16.321883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:16.321883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 457/921] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:16.330745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e47619-7335-45e8-b67a-bd9f2ce5f656 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.335533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee17739-2223-49f6-86ec-40fed79f244a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.381000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:16.442064 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e47619-7335-45e8-b67a-bd9f2ce5f656 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.442301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee17739-2223-49f6-86ec-40fed79f244a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.479118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d7fab-c533-4a63-8d40-2a42d6ff01af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.479745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486bf35-5e5f-43d7-96b3-8c8a95e43bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.479916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d7fab-c533-4a63-8d40-2a42d6ff01af None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.480211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d7fab-c533-4a63-8d40-2a42d6ff01af None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.480484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d7fab-c533-4a63-8d40-2a42d6ff01af None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.481041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486bf35-5e5f-43d7-96b3-8c8a95e43bfb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.481163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d7fab-c533-4a63-8d40-2a42d6ff01af None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.481566 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486bf35-5e5f-43d7-96b3-8c8a95e43bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.481993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486bf35-5e5f-43d7-96b3-8c8a95e43bfb None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.482519 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d7fab-c533-4a63-8d40-2a42d6ff01af None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.483201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486bf35-5e5f-43d7-96b3-8c8a95e43bfb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:16.483654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486bf35-5e5f-43d7-96b3-8c8a95e43bfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.485211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486bf35-5e5f-43d7-96b3-8c8a95e43bfb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-122d7fab-c533-4a63-8d40-2a42d6ff01af None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:16.495281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:16.496477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:56:16.497624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:16.503890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 458/922] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:16.505186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d7fab-c533-4a63-8d40-2a42d6ff01af None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.508842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 465/923] 10.222.0.49 () {56 vars in 1149 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:16.514251 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486bf35-5e5f-43d7-96b3-8c8a95e43bfb None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.546982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:16.617756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d7fab-c533-4a63-8d40-2a42d6ff01af None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.621437 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:16.625420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486bf35-5e5f-43d7-96b3-8c8a95e43bfb None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.655506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaaee0-f0c4-4efe-9ffe-cec3044064fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.656211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaaee0-f0c4-4efe-9ffe-cec3044064fe None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.656595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaaee0-f0c4-4efe-9ffe-cec3044064fe None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.656881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaaee0-f0c4-4efe-9ffe-cec3044064fe None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.657658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaaee0-f0c4-4efe-9ffe-cec3044064fe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:16.658222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaaee0-f0c4-4efe-9ffe-cec3044064fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.660357 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaaee0-f0c4-4efe-9ffe-cec3044064fe None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.664216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5be1f-a1a6-4e98-ac5f-8f0b14cd4691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.665249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5be1f-a1a6-4e98-ac5f-8f0b14cd4691 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.665767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5be1f-a1a6-4e98-ac5f-8f0b14cd4691 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.666293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5be1f-a1a6-4e98-ac5f-8f0b14cd4691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.670738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 459/924] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:16.671688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaaee0-f0c4-4efe-9ffe-cec3044064fe None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.686440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5be1f-a1a6-4e98-ac5f-8f0b14cd4691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.686440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5be1f-a1a6-4e98-ac5f-8f0b14cd4691 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e9d5be1f-a1a6-4e98-ac5f-8f0b14cd4691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:16.703829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:16.704705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:16.705607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:16.705607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:16.705607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:16.705607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:16.705607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 466/925] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:16.710840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5be1f-a1a6-4e98-ac5f-8f0b14cd4691 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.778037 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:16.781229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaaee0-f0c4-4efe-9ffe-cec3044064fe None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.823603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648105ad-6513-415f-a0c1-93b8e26cc6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.824720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648105ad-6513-415f-a0c1-93b8e26cc6ef None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.825016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648105ad-6513-415f-a0c1-93b8e26cc6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.825295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648105ad-6513-415f-a0c1-93b8e26cc6ef None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.826052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648105ad-6513-415f-a0c1-93b8e26cc6ef None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:16.826907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648105ad-6513-415f-a0c1-93b8e26cc6ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.828590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648105ad-6513-415f-a0c1-93b8e26cc6ef None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.835230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 460/926] 10.222.0.49 () {56 vars in 1114 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:16.835801 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5be1f-a1a6-4e98-ac5f-8f0b14cd4691 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.844357 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648105ad-6513-415f-a0c1-93b8e26cc6ef None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.883519 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ad248-1f55-4878-9757-5eed0fb26868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.884208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ad248-1f55-4878-9757-5eed0fb26868 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.884771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ad248-1f55-4878-9757-5eed0fb26868 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.884884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ad248-1f55-4878-9757-5eed0fb26868 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.885658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ad248-1f55-4878-9757-5eed0fb26868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:16.885934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ad248-1f55-4878-9757-5eed0fb26868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.887321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ad248-1f55-4878-9757-5eed0fb26868 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.900422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 467/927] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:16.906869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ad248-1f55-4878-9757-5eed0fb26868 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.926642 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:16.970902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648105ad-6513-415f-a0c1-93b8e26cc6ef None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.010805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849708d8-bd54-4eb8-8cc8-88a1c1ca1ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.011801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849708d8-bd54-4eb8-8cc8-88a1c1ca1ea8 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.012277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849708d8-bd54-4eb8-8cc8-88a1c1ca1ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.012729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849708d8-bd54-4eb8-8cc8-88a1c1ca1ea8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.013647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849708d8-bd54-4eb8-8cc8-88a1c1ca1ea8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.015342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849708d8-bd54-4eb8-8cc8-88a1c1ca1ea8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.046418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 461/928] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 23 16:56:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:17.046418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59177b31-61c7-4591-b5bb-9fe9d3c52aff None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.046418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59177b31-61c7-4591-b5bb-9fe9d3c52aff None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.046418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59177b31-61c7-4591-b5bb-9fe9d3c52aff None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.046418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 462/929] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:17.046418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb404f-8d40-4e4a-b71b-e2c7420719ce None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.046418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb404f-8d40-4e4a-b71b-e2c7420719ce None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.047122 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb404f-8d40-4e4a-b71b-e2c7420719ce None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.047122 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 463/930] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:17.049709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ad248-1f55-4878-9757-5eed0fb26868 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.050845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30502b68-3152-4c4b-b1ea-562247100146 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.051236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30502b68-3152-4c4b-b1ea-562247100146 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.051520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30502b68-3152-4c4b-b1ea-562247100146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.069905 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-30502b68-3152-4c4b-b1ea-562247100146 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:17.070906 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-30502b68-3152-4c4b-b1ea-562247100146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:17.087855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:17.097062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab260dfe-99e2-4949-8228-69b7807c5a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.097872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab260dfe-99e2-4949-8228-69b7807c5a29 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.098164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab260dfe-99e2-4949-8228-69b7807c5a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.098481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab260dfe-99e2-4949-8228-69b7807c5a29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.107226 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab260dfe-99e2-4949-8228-69b7807c5a29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.110066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab260dfe-99e2-4949-8228-69b7807c5a29 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-ab260dfe-99e2-4949-8228-69b7807c5a29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:56:17.128138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:17.129144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:17.130887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:56:17.130887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:56:17.130887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:56:17.130887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:56:17.130887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:56:17.130887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:56:17.130887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:17.130887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:17.130887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 468/931] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:17.131384 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ca38-9d2e-4ffd-b81e-0d80a4011bf7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.131453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ca38-9d2e-4ffd-b81e-0d80a4011bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.131750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ca38-9d2e-4ffd-b81e-0d80a4011bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.149946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9543ca38-9d2e-4ffd-b81e-0d80a4011bf7 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:17.151190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9543ca38-9d2e-4ffd-b81e-0d80a4011bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:17.170830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 464/932] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:17.170830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30502b68-3152-4c4b-b1ea-562247100146 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.238048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:17.243635 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 469/933] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:17.244465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543ca38-9d2e-4ffd-b81e-0d80a4011bf7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.280619 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30502b68-3152-4c4b-b1ea-562247100146 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.321179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5b271-606f-4810-92c0-fdc149fa0547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.322313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5b271-606f-4810-92c0-fdc149fa0547 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.322633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5b271-606f-4810-92c0-fdc149fa0547 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.322913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5b271-606f-4810-92c0-fdc149fa0547 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.323864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5b271-606f-4810-92c0-fdc149fa0547 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:17.324175 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5b271-606f-4810-92c0-fdc149fa0547 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.325857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5b271-606f-4810-92c0-fdc149fa0547 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.338275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 465/934] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:56:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:17.339096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5b271-606f-4810-92c0-fdc149fa0547 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.352056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:17.367784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543ca38-9d2e-4ffd-b81e-0d80a4011bf7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.406649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed3435-ad68-43a9-9e0c-788942906d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.407553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed3435-ad68-43a9-9e0c-788942906d60 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.407909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed3435-ad68-43a9-9e0c-788942906d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.408250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed3435-ad68-43a9-9e0c-788942906d60 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.408898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed3435-ad68-43a9-9e0c-788942906d60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.410236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed3435-ad68-43a9-9e0c-788942906d60 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-2eed3435-ad68-43a9-9e0c-788942906d60 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:17.423147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:17.424111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:17.424974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 470/935] 10.222.0.49 () {56 vars in 1132 bytes} [Mon May 23 16:56:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:17.425823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed3435-ad68-43a9-9e0c-788942906d60 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.445552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5b271-606f-4810-92c0-fdc149fa0547 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.480578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b91910-de24-449a-a239-8abe770d95b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.481391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b91910-de24-449a-a239-8abe770d95b4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.481681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b91910-de24-449a-a239-8abe770d95b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.481960 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b91910-de24-449a-a239-8abe770d95b4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.483198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b91910-de24-449a-a239-8abe770d95b4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.484573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b91910-de24-449a-a239-8abe770d95b4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c4b91910-de24-449a-a239-8abe770d95b4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:17.496984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:17.498433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:17.504673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 466/936] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 23 16:56:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:17.505647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b91910-de24-449a-a239-8abe770d95b4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.514764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:17.558020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed3435-ad68-43a9-9e0c-788942906d60 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.584069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:17.596827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b202c-844b-4d33-8a82-309e0358c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.598084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b202c-844b-4d33-8a82-309e0358c5e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.598084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b202c-844b-4d33-8a82-309e0358c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.598310 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b202c-844b-4d33-8a82-309e0358c5e4 None admin] PATH_INFO: `/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/96230dd16acb4cdfa43b892b2b747282/roles/17a702ca9868424f82b0bc9637326a8e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.600522 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b202c-844b-4d33-8a82-309e0358c5e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=733d8651e4a74a2ab694091d9fd83e49, user_id=96230dd16acb4cdfa43b892b2b747282, role_id=17a702ca9868424f82b0bc9637326a8e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.601947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b202c-844b-4d33-8a82-309e0358c5e4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.614729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b91910-de24-449a-a239-8abe770d95b4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.626409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 471/937] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:56:17 2022] PUT /identity/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/96230dd16acb4cdfa43b892b2b747282/roles/17a702ca9868424f82b0bc9637326a8e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:17.626409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b202c-844b-4d33-8a82-309e0358c5e4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.658320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d15bb4-e531-42fe-a984-8c7ce92dbb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.659030 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15bb4-e531-42fe-a984-8c7ce92dbb10 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.659320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15bb4-e531-42fe-a984-8c7ce92dbb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.659735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15bb4-e531-42fe-a984-8c7ce92dbb10 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.660552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d15bb4-e531-42fe-a984-8c7ce92dbb10 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:17.660876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d15bb4-e531-42fe-a984-8c7ce92dbb10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.662288 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d15bb4-e531-42fe-a984-8c7ce92dbb10 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.667988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 467/938] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 23 16:56:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:17.674453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d15bb4-e531-42fe-a984-8c7ce92dbb10 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.767811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b202c-844b-4d33-8a82-309e0358c5e4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.797353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d15bb4-e531-42fe-a984-8c7ce92dbb10 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.801611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:17.818422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dfbe2-f1d6-461d-9ae1-7ff60a50c9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.819144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dfbe2-f1d6-461d-9ae1-7ff60a50c9ee None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.819451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dfbe2-f1d6-461d-9ae1-7ff60a50c9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.819714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dfbe2-f1d6-461d-9ae1-7ff60a50c9ee None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.821091 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dfbe2-f1d6-461d-9ae1-7ff60a50c9ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:17.822075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dfbe2-f1d6-461d-9ae1-7ff60a50c9ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.823762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dfbe2-f1d6-461d-9ae1-7ff60a50c9ee None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.832780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 472/939] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 23 16:56:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:17.838663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dfbe2-f1d6-461d-9ae1-7ff60a50c9ee None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.842843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f64c7-6844-4d7c-b224-c0045167b61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.843983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f64c7-6844-4d7c-b224-c0045167b61e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.844445 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f64c7-6844-4d7c-b224-c0045167b61e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.844867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f64c7-6844-4d7c-b224-c0045167b61e None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.845773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f64c7-6844-4d7c-b224-c0045167b61e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:17.846231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f64c7-6844-4d7c-b224-c0045167b61e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.847842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f64c7-6844-4d7c-b224-c0045167b61e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.856422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 468/940] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 23 16:56:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:17.862848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f64c7-6844-4d7c-b224-c0045167b61e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.867138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:17.969877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dfbe2-f1d6-461d-9ae1-7ff60a50c9ee None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.982281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f64c7-6844-4d7c-b224-c0045167b61e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:18.009242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a1914-9f98-450e-b3fe-fb94d20bfbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:18.010617 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a1914-9f98-450e-b3fe-fb94d20bfbfd None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:18.011296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a1914-9f98-450e-b3fe-fb94d20bfbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:18.011722 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a1914-9f98-450e-b3fe-fb94d20bfbfd None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:18.012827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a1914-9f98-450e-b3fe-fb94d20bfbfd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:18.013702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a1914-9f98-450e-b3fe-fb94d20bfbfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:18.015687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a1914-9f98-450e-b3fe-fb94d20bfbfd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:18.018589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4461dd4-e0f1-43fb-b235-126aa9ca6194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:18.019448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4461dd4-e0f1-43fb-b235-126aa9ca6194 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:18.019801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4461dd4-e0f1-43fb-b235-126aa9ca6194 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:18.020121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4461dd4-e0f1-43fb-b235-126aa9ca6194 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:18.020975 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4461dd4-e0f1-43fb-b235-126aa9ca6194 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:18.022423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 473/941] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 23 16:56:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:18.022603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4461dd4-e0f1-43fb-b235-126aa9ca6194 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:18.031368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a1914-9f98-450e-b3fe-fb94d20bfbfd None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:18.054535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 469/942] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 23 16:56:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:18.093248 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:18.154958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a1914-9f98-450e-b3fe-fb94d20bfbfd None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:18.204507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44debdef-52c2-4252-859c-3e3328e0b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:18.205194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44debdef-52c2-4252-859c-3e3328e0b596 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:18.205483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44debdef-52c2-4252-859c-3e3328e0b596 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:18.205767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44debdef-52c2-4252-859c-3e3328e0b596 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:18.206631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44debdef-52c2-4252-859c-3e3328e0b596 None admin] RBAC: Adding query filter params (interface=public, service_id=a21258539db947df97dcadae79816732, region_id=RegionOne) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:18.206951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44debdef-52c2-4252-859c-3e3328e0b596 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:18.208375 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44debdef-52c2-4252-859c-3e3328e0b596 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:18.215098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 474/943] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 23 16:56:18 2022] GET /identity/v3/endpoints?service_id=a21258539db947df97dcadae79816732&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:18.221525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4461dd4-e0f1-43fb-b235-126aa9ca6194 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:18.290467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:18.338331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4461dd4-e0f1-43fb-b235-126aa9ca6194 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:18.374058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd69db0-7ebd-43c6-bd80-0e42b8216b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:18.374762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd69db0-7ebd-43c6-bd80-0e42b8216b79 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:18.375041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd69db0-7ebd-43c6-bd80-0e42b8216b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:18.375368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd69db0-7ebd-43c6-bd80-0e42b8216b79 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:18.376107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd69db0-7ebd-43c6-bd80-0e42b8216b79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:18.377465 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd69db0-7ebd-43c6-bd80-0e42b8216b79 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:18.384066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 470/944] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 23 16:56:18 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:19.329499 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4088b-2487-496c-8046-6b0bf518b623 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:19.330021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4088b-2487-496c-8046-6b0bf518b623 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:19.330124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4088b-2487-496c-8046-6b0bf518b623 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:19.331564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 475/945] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:19.336998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c766f-1443-4668-88d1-eee2a3285e2f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:19.337292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c766f-1443-4668-88d1-eee2a3285e2f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:19.337573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c766f-1443-4668-88d1-eee2a3285e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:19.355425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-da1c766f-1443-4668-88d1-eee2a3285e2f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:19.356601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-da1c766f-1443-4668-88d1-eee2a3285e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:19.426499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 471/946] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:19.450060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4088b-2487-496c-8046-6b0bf518b623 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:19.561802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4088b-2487-496c-8046-6b0bf518b623 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:19.574144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:19.600476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdfb06-1fd8-494a-b92d-cf7e13ed39cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:19.601138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdfb06-1fd8-494a-b92d-cf7e13ed39cd None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:19.601418 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdfb06-1fd8-494a-b92d-cf7e13ed39cd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:19.601694 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdfb06-1fd8-494a-b92d-cf7e13ed39cd None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:19.602453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdfb06-1fd8-494a-b92d-cf7e13ed39cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:19.603859 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdfb06-1fd8-494a-b92d-cf7e13ed39cd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:19.605230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: WARNING keystone.server.flask.common [None req-6fcdfb06-1fd8-494a-b92d-cf7e13ed39cd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 16:56:19.623631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.sql.core [None req-6fcdfb06-1fd8-494a-b92d-cf7e13ed39cd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 16:56:19.623631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 16:56:19.623631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [parameters: {'id': '70e74fe8f2f54353b4b72985c022f346', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 16:56:19.623631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80412) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-6fcdfb06-1fd8-494a-b92d-cf7e13ed39cd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 70e74fe8f2f54353b4b72985c022f346.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 70e74fe8f2f54353b4b72985c022f346. May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result = self._query(query) May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application conn.query(q) May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 16:56:19.631620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result.read() May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 23 16:56:19.632430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return project_ref.to_dict() May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application next(self.gen) May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application yield resource May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application next(self.gen) May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.session.rollback() May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.force_reraise() May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise self.value May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application session.commit() May 23 16:56:19.633400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._prepare_impl() May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.session.flush() May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._flush(objects) May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application compat.raise_( May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application flush_context.execute() May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 16:56:19.634296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rec.execute(self) May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 16:56:19.635244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result = self._query(query) May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application conn.query(q) May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result.read() May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 16:56:19.636053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [parameters: {'id': '70e74fe8f2f54353b4b72985c022f346', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:19.636938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:19.637723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:19.644386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:19.644386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 23 16:56:19.644386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 23 16:56:19.644386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:19.644386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:19.644386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 23 16:56:19.644386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.Conflict( May 23 16:56:19.644386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 70e74fe8f2f54353b4b72985c022f346. May 23 16:56:19.644386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:19.644386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 476/947] 10.222.0.49 () {60 vars in 1140 bytes} [Mon May 23 16:56:19 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:19.648436 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c766f-1443-4668-88d1-eee2a3285e2f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:19.713393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:19.764498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c766f-1443-4668-88d1-eee2a3285e2f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:19.801746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70be60-701f-4237-964e-e0345ce9779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:19.802608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70be60-701f-4237-964e-e0345ce9779f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:19.802899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70be60-701f-4237-964e-e0345ce9779f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:19.803177 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70be60-701f-4237-964e-e0345ce9779f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:19.811492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70be60-701f-4237-964e-e0345ce9779f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:19.813054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70be60-701f-4237-964e-e0345ce9779f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ee70be60-701f-4237-964e-e0345ce9779f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:56:19.829770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:19.830793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:19.831689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:56:19.831689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:56:19.831689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:56:19.831689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:56:19.831689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:56:19.831689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:56:19.831689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:19.831689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:19.831689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 472/948] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:19.837472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdfb06-1fd8-494a-b92d-cf7e13ed39cd None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:19.950057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdfb06-1fd8-494a-b92d-cf7e13ed39cd None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:19.986355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1fe43-52da-475d-8d7e-62503567752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:19.987048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1fe43-52da-475d-8d7e-62503567752b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:19.987331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1fe43-52da-475d-8d7e-62503567752b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:19.987607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1fe43-52da-475d-8d7e-62503567752b None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:19.988366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1fe43-52da-475d-8d7e-62503567752b None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:19.988673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1fe43-52da-475d-8d7e-62503567752b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:19.990293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1fe43-52da-475d-8d7e-62503567752b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:20.000917 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b947a4-e6b6-4e7a-bc3a-12dbb636741b None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.001282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b947a4-e6b6-4e7a-bc3a-12dbb636741b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.001578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b947a4-e6b6-4e7a-bc3a-12dbb636741b None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.004303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 473/949] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:20.008395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db97371-e573-4d61-9059-992c69d305b1 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.008689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db97371-e573-4d61-9059-992c69d305b1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.008973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db97371-e573-4d61-9059-992c69d305b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.012625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 477/950] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:56:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:20.027491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6db97371-e573-4d61-9059-992c69d305b1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:20.028732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6db97371-e573-4d61-9059-992c69d305b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:20.114526 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 474/951] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:20.131964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1fe43-52da-475d-8d7e-62503567752b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.167860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:20.252386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1fe43-52da-475d-8d7e-62503567752b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.293334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086daadf-b8b2-4292-b1af-5dd8ad430633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.294170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086daadf-b8b2-4292-b1af-5dd8ad430633 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.294485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086daadf-b8b2-4292-b1af-5dd8ad430633 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.294758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086daadf-b8b2-4292-b1af-5dd8ad430633 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.306224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086daadf-b8b2-4292-b1af-5dd8ad430633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-086daadf-b8b2-4292-b1af-5dd8ad430633 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:20.315503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:20.316611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:20.317485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:20.317485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:20.317485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:20.317485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:20.317485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:20.317485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:20.317485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:20.317485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:20.317485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:20.317485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:20.317485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:56:20.317485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:20.321850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 478/952] 10.222.0.49 () {56 vars in 1120 bytes} [Mon May 23 16:56:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:20.323050 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db97371-e573-4d61-9059-992c69d305b1 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.369330 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:20.430402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db97371-e573-4d61-9059-992c69d305b1 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.463738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80389ff0-d72b-47b1-b0ec-9ebf271e3b55 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.464257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80389ff0-d72b-47b1-b0ec-9ebf271e3b55 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.464333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80389ff0-d72b-47b1-b0ec-9ebf271e3b55 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.466027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 479/953] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:20.472075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2fe6-59ee-45dd-9bab-4ef0df34dbef None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.472373 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2fe6-59ee-45dd-9bab-4ef0df34dbef None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.472708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2fe6-59ee-45dd-9bab-4ef0df34dbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.473859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf2349-1952-4bd6-8641-e8c9f185b4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.474781 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf2349-1952-4bd6-8641-e8c9f185b4bc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.475073 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf2349-1952-4bd6-8641-e8c9f185b4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.475356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf2349-1952-4bd6-8641-e8c9f185b4bc None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.476212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf2349-1952-4bd6-8641-e8c9f185b4bc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:20.476531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf2349-1952-4bd6-8641-e8c9f185b4bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:20.478023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf2349-1952-4bd6-8641-e8c9f185b4bc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:20.490454 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 475/954] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 23 16:56:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:20.493201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf2349-1952-4bd6-8641-e8c9f185b4bc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.493325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b6cf2fe6-59ee-45dd-9bab-4ef0df34dbef None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:20.495071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b6cf2fe6-59ee-45dd-9bab-4ef0df34dbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:20.582798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 480/955] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:20.599796 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2fe6-59ee-45dd-9bab-4ef0df34dbef None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.610096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf2349-1952-4bd6-8641-e8c9f185b4bc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.612788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:20.619844 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:20.651029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0f317-5654-4dae-a7ba-8b03467dadb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.651871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0f317-5654-4dae-a7ba-8b03467dadb8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.652161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0f317-5654-4dae-a7ba-8b03467dadb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.652443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0f317-5654-4dae-a7ba-8b03467dadb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.664866 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0f317-5654-4dae-a7ba-8b03467dadb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:20.666512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0f317-5654-4dae-a7ba-8b03467dadb8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-39a0f317-5654-4dae-a7ba-8b03467dadb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:20.685729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:20.687783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:20.689926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:20.689926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:20.689926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:20.689926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:20.694391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 476/956] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:20.694391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0f317-5654-4dae-a7ba-8b03467dadb8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.709176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2fe6-59ee-45dd-9bab-4ef0df34dbef None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.744955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d7141-04c8-4aa9-b38d-985911bbeffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.745756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d7141-04c8-4aa9-b38d-985911bbeffc None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.746097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d7141-04c8-4aa9-b38d-985911bbeffc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.746391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d7141-04c8-4aa9-b38d-985911bbeffc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.747119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d7141-04c8-4aa9-b38d-985911bbeffc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:20.749050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d7141-04c8-4aa9-b38d-985911bbeffc None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b65d7141-04c8-4aa9-b38d-985911bbeffc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:20.763235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:20.766040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:20.772140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 481/957] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:20.773130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e868-76f8-4be7-aae3-1520fe90be17 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.773130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e868-76f8-4be7-aae3-1520fe90be17 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.773130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e868-76f8-4be7-aae3-1520fe90be17 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.773130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 482/958] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:20.773130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0e868-76f8-4be7-aae3-1520fe90be17 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.803729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0f317-5654-4dae-a7ba-8b03467dadb8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.839783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f2fd7-4589-4613-abac-166380f50b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.840369 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f2fd7-4589-4613-abac-166380f50b59 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.840665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f2fd7-4589-4613-abac-166380f50b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.840946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f2fd7-4589-4613-abac-166380f50b59 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.841682 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f2fd7-4589-4613-abac-166380f50b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:20.842069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f2fd7-4589-4613-abac-166380f50b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:20.843475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f2fd7-4589-4613-abac-166380f50b59 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:20.855976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 477/959] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:20.861722 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70cc4e-4043-4ec8-a243-56ebeba0edaf None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.862017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70cc4e-4043-4ec8-a243-56ebeba0edaf None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.862307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70cc4e-4043-4ec8-a243-56ebeba0edaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.865370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:20.879676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2f70cc4e-4043-4ec8-a243-56ebeba0edaf None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:20.880867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2f70cc4e-4043-4ec8-a243-56ebeba0edaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:20.887918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0e868-76f8-4be7-aae3-1520fe90be17 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.893438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:20.929400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dfba2-a846-4eed-bdf8-393966c6988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.930371 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dfba2-a846-4eed-bdf8-393966c6988e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.930836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dfba2-a846-4eed-bdf8-393966c6988e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.931122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dfba2-a846-4eed-bdf8-393966c6988e None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.931838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dfba2-a846-4eed-bdf8-393966c6988e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:20.932154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dfba2-a846-4eed-bdf8-393966c6988e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:20.933511 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dfba2-a846-4eed-bdf8-393966c6988e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:20.939387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 483/960] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:56:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:20.944463 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dfba2-a846-4eed-bdf8-393966c6988e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.958805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 478/961] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:20.958805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70cc4e-4043-4ec8-a243-56ebeba0edaf None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:21.067095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70cc4e-4043-4ec8-a243-56ebeba0edaf None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:21.067423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dfba2-a846-4eed-bdf8-393966c6988e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:21.103580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0f1c-aa17-4a04-88f5-00d2a5b3378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:21.104242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0f1c-aa17-4a04-88f5-00d2a5b3378c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:21.104520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0f1c-aa17-4a04-88f5-00d2a5b3378c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:21.104794 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0f1c-aa17-4a04-88f5-00d2a5b3378c None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:21.105499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c0f1c-aa17-4a04-88f5-00d2a5b3378c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:21.105802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c0f1c-aa17-4a04-88f5-00d2a5b3378c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:21.106308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2187bfb-a86f-439b-9267-88a6c82bc6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:21.107186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c0f1c-aa17-4a04-88f5-00d2a5b3378c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:21.107533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2187bfb-a86f-439b-9267-88a6c82bc6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:21.107966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2187bfb-a86f-439b-9267-88a6c82bc6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:21.108392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2187bfb-a86f-439b-9267-88a6c82bc6e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:21.112023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 479/962] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:56:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:21.112784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0f1c-aa17-4a04-88f5-00d2a5b3378c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:21.117273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2187bfb-a86f-439b-9267-88a6c82bc6e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:21.118781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2187bfb-a86f-439b-9267-88a6c82bc6e4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:21.137552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-d2187bfb-a86f-439b-9267-88a6c82bc6e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:56:21.141291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:21.142294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:21.143283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:21.143283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:21.143283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:56:21.143283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:56:21.143283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:56:21.143283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:56:21.143283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:56:21.143283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:56:21.143283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:56:21.143283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:21.148361 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 484/963] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 23 16:56:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:21.150045 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2187bfb-a86f-439b-9267-88a6c82bc6e4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:21.163563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:21.251129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0f1c-aa17-4a04-88f5-00d2a5b3378c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:21.275286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2187bfb-a86f-439b-9267-88a6c82bc6e4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:21.290532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee1aa6-6ed8-4afb-909b-9b4ec028dcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:21.291508 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee1aa6-6ed8-4afb-909b-9b4ec028dcbc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:21.291832 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee1aa6-6ed8-4afb-909b-9b4ec028dcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:21.292190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee1aa6-6ed8-4afb-909b-9b4ec028dcbc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:21.293397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee1aa6-6ed8-4afb-909b-9b4ec028dcbc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:21.294515 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee1aa6-6ed8-4afb-909b-9b4ec028dcbc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-43ee1aa6-6ed8-4afb-909b-9b4ec028dcbc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:21.308990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:21.310078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:21.311018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 480/964] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 23 16:56:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:21.318450 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee1aa6-6ed8-4afb-909b-9b4ec028dcbc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:21.328047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c3ac3-16af-487e-9dd0-4ced59cd6c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:21.328829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c3ac3-16af-487e-9dd0-4ced59cd6c71 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:21.329188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c3ac3-16af-487e-9dd0-4ced59cd6c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:21.329547 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c3ac3-16af-487e-9dd0-4ced59cd6c71 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:21.330438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c3ac3-16af-487e-9dd0-4ced59cd6c71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:21.330759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c3ac3-16af-487e-9dd0-4ced59cd6c71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:21.332204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c3ac3-16af-487e-9dd0-4ced59cd6c71 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:21.352232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 485/965] 10.222.0.49 () {56 vars in 1149 bytes} [Mon May 23 16:56:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:21.359115 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c3ac3-16af-487e-9dd0-4ced59cd6c71 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:21.408306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:21.436173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee1aa6-6ed8-4afb-909b-9b4ec028dcbc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:21.441001 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:21.486316 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a658b0-7937-4268-ba1a-281ee6149e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:21.487649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a658b0-7937-4268-ba1a-281ee6149e1a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:21.488163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a658b0-7937-4268-ba1a-281ee6149e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:21.488677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a658b0-7937-4268-ba1a-281ee6149e1a None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:21.489901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a658b0-7937-4268-ba1a-281ee6149e1a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:21.490056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c3ac3-16af-487e-9dd0-4ced59cd6c71 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:21.490499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a658b0-7937-4268-ba1a-281ee6149e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:21.493102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a658b0-7937-4268-ba1a-281ee6149e1a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:21.500844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 481/966] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 23 16:56:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:21.508112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a658b0-7937-4268-ba1a-281ee6149e1a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:21.546212 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f9524-453e-4889-a251-d289927fe0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:21.547063 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9524-453e-4889-a251-d289927fe0ec None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:21.547457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9524-453e-4889-a251-d289927fe0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:21.547747 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9524-453e-4889-a251-d289927fe0ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:21.618484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a658b0-7937-4268-ba1a-281ee6149e1a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:21.638054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f9524-453e-4889-a251-d289927fe0ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:21.640145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f9524-453e-4889-a251-d289927fe0ec None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:21.655932 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4693f-898c-4582-9bab-a8d061091bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:21.657012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4693f-898c-4582-9bab-a8d061091bdf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:21.657496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4693f-898c-4582-9bab-a8d061091bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:21.658062 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4693f-898c-4582-9bab-a8d061091bdf None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:21.659035 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4693f-898c-4582-9bab-a8d061091bdf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:21.659585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4693f-898c-4582-9bab-a8d061091bdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:21.661350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4693f-898c-4582-9bab-a8d061091bdf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:21.667204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 482/967] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 23 16:56:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:21.673314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4693f-898c-4582-9bab-a8d061091bdf None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:21.696188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:21.713034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:21.757291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 486/968] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:56:21 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 16:56:21.765064 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f9524-453e-4889-a251-d289927fe0ec None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:21.822390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4693f-898c-4582-9bab-a8d061091bdf None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:21.871603 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f9524-453e-4889-a251-d289927fe0ec None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:21.885241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73bced-6e97-4476-af84-26eff9c83e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:21.887156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73bced-6e97-4476-af84-26eff9c83e2b None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:21.888154 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73bced-6e97-4476-af84-26eff9c83e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:21.888861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73bced-6e97-4476-af84-26eff9c83e2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:21.891374 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73bced-6e97-4476-af84-26eff9c83e2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:21.895000 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73bced-6e97-4476-af84-26eff9c83e2b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:21.913977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052178f-ba50-4870-aa1e-4ee9b32a356b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:21.914936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052178f-ba50-4870-aa1e-4ee9b32a356b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:21.915281 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052178f-ba50-4870-aa1e-4ee9b32a356b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:21.915655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052178f-ba50-4870-aa1e-4ee9b32a356b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:21.934409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052178f-ba50-4870-aa1e-4ee9b32a356b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:21.934409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052178f-ba50-4870-aa1e-4ee9b32a356b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:21.935485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 483/969] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 23 16:56:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-a052178f-ba50-4870-aa1e-4ee9b32a356b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:21.957417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:21.958680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:21.959771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:21.959771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:21.959771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:21.959771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:21.966080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 487/970] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:21.968663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73bced-6e97-4476-af84-26eff9c83e2b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:22.038346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:22.095448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73bced-6e97-4476-af84-26eff9c83e2b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:22.134399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c50e6-7743-4f55-b074-64e4275922af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:22.135006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c50e6-7743-4f55-b074-64e4275922af None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:22.135295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c50e6-7743-4f55-b074-64e4275922af None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:22.135575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c50e6-7743-4f55-b074-64e4275922af None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:22.136323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c50e6-7743-4f55-b074-64e4275922af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:22.136637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c50e6-7743-4f55-b074-64e4275922af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:22.138027 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c50e6-7743-4f55-b074-64e4275922af None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:22.154828 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 484/971] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:22.157699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052178f-ba50-4870-aa1e-4ee9b32a356b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:22.175224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:22.269860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052178f-ba50-4870-aa1e-4ee9b32a356b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:22.312518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770efefe-545a-4cca-becb-6a5f4ef6687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:22.313360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770efefe-545a-4cca-becb-6a5f4ef6687c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:22.313649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770efefe-545a-4cca-becb-6a5f4ef6687c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:22.313932 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770efefe-545a-4cca-becb-6a5f4ef6687c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:22.322077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770efefe-545a-4cca-becb-6a5f4ef6687c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:22.323699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770efefe-545a-4cca-becb-6a5f4ef6687c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-770efefe-545a-4cca-becb-6a5f4ef6687c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:56:22.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:22.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:22.341057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:56:22.341057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:56:22.341057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:56:22.341057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:56:22.341057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:56:22.341057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:56:22.341057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:22.341057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:22.345795 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 488/972] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:22.347197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c50e6-7743-4f55-b074-64e4275922af None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:22.457114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c50e6-7743-4f55-b074-64e4275922af None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:22.472836 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:22.494173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b6821-c42d-4de8-906c-545ad43a5649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:22.494876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b6821-c42d-4de8-906c-545ad43a5649 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:22.495161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b6821-c42d-4de8-906c-545ad43a5649 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:22.495447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b6821-c42d-4de8-906c-545ad43a5649 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:22.496242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b6821-c42d-4de8-906c-545ad43a5649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:22.496555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b6821-c42d-4de8-906c-545ad43a5649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:22.498507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b6821-c42d-4de8-906c-545ad43a5649 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:22.501432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78722ba-dbf8-4a05-bc55-927a43aec69c None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:22.501886 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78722ba-dbf8-4a05-bc55-927a43aec69c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:22.502064 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78722ba-dbf8-4a05-bc55-927a43aec69c None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:22.504852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 489/973] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:22.509279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4ca66-7efa-41c4-afac-7fa10b252ac5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:22.509577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4ca66-7efa-41c4-afac-7fa10b252ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:22.509946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4ca66-7efa-41c4-afac-7fa10b252ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:22.512530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 485/974] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:56:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:22.518852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b6821-c42d-4de8-906c-545ad43a5649 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:22.533836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-41b4ca66-7efa-41c4-afac-7fa10b252ac5 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:22.535886 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-41b4ca66-7efa-41c4-afac-7fa10b252ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:22.633968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 490/975] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:22.640702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b6821-c42d-4de8-906c-545ad43a5649 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:22.659760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4ca66-7efa-41c4-afac-7fa10b252ac5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:22.663686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:22.682166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddd521-3f04-4c59-a296-8638bc58d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:22.682850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddd521-3f04-4c59-a296-8638bc58d250 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:22.683139 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddd521-3f04-4c59-a296-8638bc58d250 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:22.683420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddd521-3f04-4c59-a296-8638bc58d250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:22.684689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddd521-3f04-4c59-a296-8638bc58d250 None admin] RBAC: Adding query filter params (role.id=17a702ca9868424f82b0bc9637326a8e, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=96230dd16acb4cdfa43b892b2b747282) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:22.685274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddd521-3f04-4c59-a296-8638bc58d250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:22.687683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddd521-3f04-4c59-a296-8638bc58d250 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:22.696120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 486/976] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:56:22 2022] GET /identity/v3/role_assignments?user.id=96230dd16acb4cdfa43b892b2b747282&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=17a702ca9868424f82b0bc9637326a8e => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:22.789035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4ca66-7efa-41c4-afac-7fa10b252ac5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:22.828936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c444c66-461a-40c7-a3d9-06b708861d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:22.829703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c444c66-461a-40c7-a3d9-06b708861d36 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:22.830004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c444c66-461a-40c7-a3d9-06b708861d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:22.830287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c444c66-461a-40c7-a3d9-06b708861d36 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:22.831092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c444c66-461a-40c7-a3d9-06b708861d36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:22.832745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c444c66-461a-40c7-a3d9-06b708861d36 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:22.849032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.sql.core [None req-0c444c66-461a-40c7-a3d9-06b708861d36 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 16:56:22.849032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 16:56:22.849032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [parameters: {'user_id': 'aac4ac9012f9413bba128f18b23a5a17', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 16:56:22.849032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80412) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-0c444c66-461a-40c7-a3d9-06b708861d36 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result = self._query(query) May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application conn.query(q) May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result.read() May 23 16:56:22.858428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 16:56:22.859406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application next(self.gen) May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application yield resource May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application next(self.gen) May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.session.rollback() May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.force_reraise() May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise self.value May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application session.commit() May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 16:56:22.860354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._prepare_impl() May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.session.flush() May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._flush(objects) May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application compat.raise_( May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application flush_context.execute() May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rec.execute(self) May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 16:56:22.861263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result = connection._execute_20( May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 16:56:22.862255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result = self._query(query) May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application conn.query(q) May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result.read() May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 16:56:22.863185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [parameters: {'user_id': 'aac4ac9012f9413bba128f18b23a5a17', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:22.864035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 23 16:56:22.864848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 23 16:56:22.865786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 23 16:56:22.865786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 23 16:56:22.865786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 16:56:22.865786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 16:56:22.865786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 16:56:22.865786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:22.865786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 491/977] 10.222.0.49 () {60 vars in 1131 bytes} [Mon May 23 16:56:22 2022] POST /identity/v3/users => generated 160 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:22.868927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddd521-3f04-4c59-a296-8638bc58d250 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:22.918547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:22.985110 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddd521-3f04-4c59-a296-8638bc58d250 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:23.020476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfb99a-66a7-46a3-8e07-425453673f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:23.021280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfb99a-66a7-46a3-8e07-425453673f6e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:23.021598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfb99a-66a7-46a3-8e07-425453673f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:23.021887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfb99a-66a7-46a3-8e07-425453673f6e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:23.030464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfb99a-66a7-46a3-8e07-425453673f6e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:23.031905 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfb99a-66a7-46a3-8e07-425453673f6e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-23dfb99a-66a7-46a3-8e07-425453673f6e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:56:23.046574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:23.047558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:23.048518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:23.048518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:23.048518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:56:23.048518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:56:23.048518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:56:23.048518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:56:23.048518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:56:23.048518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:56:23.048518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:56:23.048518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:23.048518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 487/978] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:56:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:23.055702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c444c66-461a-40c7-a3d9-06b708861d36 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:23.131541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:23.171291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c444c66-461a-40c7-a3d9-06b708861d36 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:23.208477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae1250-8568-4eed-bc66-6b0f95b71050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:23.209162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae1250-8568-4eed-bc66-6b0f95b71050 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:23.209447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae1250-8568-4eed-bc66-6b0f95b71050 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:23.209729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae1250-8568-4eed-bc66-6b0f95b71050 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:23.210562 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae1250-8568-4eed-bc66-6b0f95b71050 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:23.210875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae1250-8568-4eed-bc66-6b0f95b71050 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:23.212548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae1250-8568-4eed-bc66-6b0f95b71050 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:23.258503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 492/979] 10.222.0.49 () {56 vars in 1101 bytes} [Mon May 23 16:56:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:23.448578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0309be-da87-4ca6-9ea6-875caadb323d None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:23.448913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0309be-da87-4ca6-9ea6-875caadb323d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:23.449152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0309be-da87-4ca6-9ea6-875caadb323d None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:23.450977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 488/980] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:23.457048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249b503-f2dc-4366-828f-a009b0fdb1ec None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:23.457351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249b503-f2dc-4366-828f-a009b0fdb1ec None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:23.457639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249b503-f2dc-4366-828f-a009b0fdb1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:23.479017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1249b503-f2dc-4366-828f-a009b0fdb1ec None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:23.480532 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1249b503-f2dc-4366-828f-a009b0fdb1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:23.557530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 493/981] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:23.580694 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0309be-da87-4ca6-9ea6-875caadb323d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:23.682540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:23.689138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0309be-da87-4ca6-9ea6-875caadb323d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:23.725166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631858-823e-4de9-9ad8-b75f392d61d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:23.725747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631858-823e-4de9-9ad8-b75f392d61d2 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:23.726032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631858-823e-4de9-9ad8-b75f392d61d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:23.726307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631858-823e-4de9-9ad8-b75f392d61d2 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:23.727054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58631858-823e-4de9-9ad8-b75f392d61d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:23.728416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58631858-823e-4de9-9ad8-b75f392d61d2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:23.742665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 489/982] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:56:23 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:24.344425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec69517-2de6-4ebc-82db-cb0e6730233a None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:24.344768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec69517-2de6-4ebc-82db-cb0e6730233a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:24.344995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec69517-2de6-4ebc-82db-cb0e6730233a None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:24.346445 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 494/983] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:24.351691 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88e370-8e07-4bde-aa1c-c66569b12d5f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:24.351991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88e370-8e07-4bde-aa1c-c66569b12d5f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:24.352274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88e370-8e07-4bde-aa1c-c66569b12d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:24.369503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9d88e370-8e07-4bde-aa1c-c66569b12d5f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:24.370721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9d88e370-8e07-4bde-aa1c-c66569b12d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:24.446422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 490/984] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:24.469632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec69517-2de6-4ebc-82db-cb0e6730233a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:24.531286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:24.581241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec69517-2de6-4ebc-82db-cb0e6730233a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:24.617966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801fc78-734b-4589-b7e8-ed7a8e171a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:24.618729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801fc78-734b-4589-b7e8-ed7a8e171a7d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:24.619019 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801fc78-734b-4589-b7e8-ed7a8e171a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:24.619299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801fc78-734b-4589-b7e8-ed7a8e171a7d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:24.619957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801fc78-734b-4589-b7e8-ed7a8e171a7d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:24.621316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801fc78-734b-4589-b7e8-ed7a8e171a7d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-4801fc78-734b-4589-b7e8-ed7a8e171a7d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:24.633851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:24.634847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:24.641647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 495/985] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 23 16:56:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:24.643832 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88e370-8e07-4bde-aa1c-c66569b12d5f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:24.730416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:24.747425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88e370-8e07-4bde-aa1c-c66569b12d5f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:24.790676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261518c-5c81-4a8a-be59-878e9dd5ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:24.791349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261518c-5c81-4a8a-be59-878e9dd5ffaf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:24.791638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261518c-5c81-4a8a-be59-878e9dd5ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:24.791918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261518c-5c81-4a8a-be59-878e9dd5ffaf None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:24.792654 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261518c-5c81-4a8a-be59-878e9dd5ffaf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:24.792966 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261518c-5c81-4a8a-be59-878e9dd5ffaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:24.794331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261518c-5c81-4a8a-be59-878e9dd5ffaf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:24.803870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 491/986] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 23 16:56:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:24.804955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801fc78-734b-4589-b7e8-ed7a8e171a7d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:24.913207 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801fc78-734b-4589-b7e8-ed7a8e171a7d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:24.930706 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:24.948940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f673d-68fb-4ad7-90a2-7626d21c80b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:24.949860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f673d-68fb-4ad7-90a2-7626d21c80b0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:24.950143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f673d-68fb-4ad7-90a2-7626d21c80b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:24.950440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f673d-68fb-4ad7-90a2-7626d21c80b0 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:24.951190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f673d-68fb-4ad7-90a2-7626d21c80b0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:24.951632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f673d-68fb-4ad7-90a2-7626d21c80b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:24.952982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f673d-68fb-4ad7-90a2-7626d21c80b0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:24.958125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 496/987] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 23 16:56:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:24.963766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261518c-5c81-4a8a-be59-878e9dd5ffaf None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:25.045505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb60cf1-3022-4ce6-8899-b8b5904f3ada None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:25.045792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb60cf1-3022-4ce6-8899-b8b5904f3ada None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:25.046069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb60cf1-3022-4ce6-8899-b8b5904f3ada None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:25.047471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 497/988] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:56:25.052453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb715a07-3689-4f29-b675-15c4e83098c1 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:25.052743 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb715a07-3689-4f29-b675-15c4e83098c1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:25.053022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb715a07-3689-4f29-b675-15c4e83098c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:25.070411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-fb715a07-3689-4f29-b675-15c4e83098c1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:25.071626 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fb715a07-3689-4f29-b675-15c4e83098c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:25.071745 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261518c-5c81-4a8a-be59-878e9dd5ffaf None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:25.108824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd3d34-beaa-46ca-a7dd-b51b5058a43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:25.109471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd3d34-beaa-46ca-a7dd-b51b5058a43f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:25.109760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd3d34-beaa-46ca-a7dd-b51b5058a43f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:25.110034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd3d34-beaa-46ca-a7dd-b51b5058a43f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:25.110855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd3d34-beaa-46ca-a7dd-b51b5058a43f None admin] RBAC: Adding query filter params (interface=admin, service_id=a21258539db947df97dcadae79816732, region_id=RegionOne) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:25.111167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd3d34-beaa-46ca-a7dd-b51b5058a43f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:25.112517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd3d34-beaa-46ca-a7dd-b51b5058a43f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:25.122095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 492/989] 10.222.0.49 () {56 vars in 1249 bytes} [Mon May 23 16:56:24 2022] GET /identity/v3/endpoints?service_id=a21258539db947df97dcadae79816732&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:25.123683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd3d34-beaa-46ca-a7dd-b51b5058a43f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:25.140054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:25.146598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 498/990] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:25.168071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb715a07-3689-4f29-b675-15c4e83098c1 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:25.237177 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd3d34-beaa-46ca-a7dd-b51b5058a43f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:25.271798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27910241-b283-4b92-b28b-22486edf189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:25.272471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27910241-b283-4b92-b28b-22486edf189f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:25.272760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27910241-b283-4b92-b28b-22486edf189f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:25.273039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27910241-b283-4b92-b28b-22486edf189f None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:25.273731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27910241-b283-4b92-b28b-22486edf189f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:25.275138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27910241-b283-4b92-b28b-22486edf189f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:25.280998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb715a07-3689-4f29-b675-15c4e83098c1 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:25.281948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 493/991] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 23 16:56:25 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:25.297632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:25.323827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89721b-9cb0-4b92-8d86-a64472d31802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:25.325324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89721b-9cb0-4b92-8d86-a64472d31802 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:25.325810 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89721b-9cb0-4b92-8d86-a64472d31802 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:25.326321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89721b-9cb0-4b92-8d86-a64472d31802 None admin] PATH_INFO: `/v3/services/image` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:25.327218 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89721b-9cb0-4b92-8d86-a64472d31802 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:25.328811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89721b-9cb0-4b92-8d86-a64472d31802 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-ad89721b-9cb0-4b92-8d86-a64472d31802 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:25.341550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:25.343198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:25.349449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 499/992] 10.222.0.49 () {56 vars in 1105 bytes} [Mon May 23 16:56:25 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:25.352030 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27910241-b283-4b92-b28b-22486edf189f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:25.439316 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:25.465771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27910241-b283-4b92-b28b-22486edf189f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:25.502630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472b672-d32c-4d23-bfb2-c8a756ee5a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:25.503625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472b672-d32c-4d23-bfb2-c8a756ee5a22 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:25.504090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472b672-d32c-4d23-bfb2-c8a756ee5a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:25.504558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472b672-d32c-4d23-bfb2-c8a756ee5a22 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:25.505438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472b672-d32c-4d23-bfb2-c8a756ee5a22 None admin] RBAC: Adding query filter params (name=image) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:25.505923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472b672-d32c-4d23-bfb2-c8a756ee5a22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:25.507471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472b672-d32c-4d23-bfb2-c8a756ee5a22 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:25.516067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 494/993] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:25.519054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89721b-9cb0-4b92-8d86-a64472d31802 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:25.634651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89721b-9cb0-4b92-8d86-a64472d31802 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:25.673849 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c363e-81b8-45c4-810a-8a1eb343a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:25.674556 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c363e-81b8-45c4-810a-8a1eb343a5ad None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:25.674847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c363e-81b8-45c4-810a-8a1eb343a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:25.675127 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c363e-81b8-45c4-810a-8a1eb343a5ad None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:25.675834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c363e-81b8-45c4-810a-8a1eb343a5ad None admin] RBAC: Adding query filter params (type=image) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:25.676144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c363e-81b8-45c4-810a-8a1eb343a5ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:25.677494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c363e-81b8-45c4-810a-8a1eb343a5ad None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:25.690530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 500/994] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:26.093741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c50578-e073-4ad6-8180-70ebe17e27e6 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.094252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c50578-e073-4ad6-8180-70ebe17e27e6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.094334 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c50578-e073-4ad6-8180-70ebe17e27e6 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.096321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 495/995] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:26.101897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743357-bf83-4633-a9a6-e3c0b3999d46 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.102263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743357-bf83-4633-a9a6-e3c0b3999d46 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.102650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743357-bf83-4633-a9a6-e3c0b3999d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.119783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-89743357-bf83-4633-a9a6-e3c0b3999d46 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:26.120976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-89743357-bf83-4633-a9a6-e3c0b3999d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:26.156471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:26.191724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 501/996] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:26.214904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c50578-e073-4ad6-8180-70ebe17e27e6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:26.330324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c50578-e073-4ad6-8180-70ebe17e27e6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:26.380253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bc2eb-5302-407c-9798-bf37168e4a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:26.381136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bc2eb-5302-407c-9798-bf37168e4a71 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.381387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bc2eb-5302-407c-9798-bf37168e4a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.381673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bc2eb-5302-407c-9798-bf37168e4a71 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.382328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bc2eb-5302-407c-9798-bf37168e4a71 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:26.383736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bc2eb-5302-407c-9798-bf37168e4a71 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-160bc2eb-5302-407c-9798-bf37168e4a71 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:26.397659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:26.398693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:56:26.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:26.401591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 496/997] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:26.414350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89743357-bf83-4633-a9a6-e3c0b3999d46 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:26.555987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89743357-bf83-4633-a9a6-e3c0b3999d46 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:26.591835 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4133765-ebf6-41cb-bb85-2442363afeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:26.593403 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4133765-ebf6-41cb-bb85-2442363afeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.594118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4133765-ebf6-41cb-bb85-2442363afeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.594927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4133765-ebf6-41cb-bb85-2442363afeb2 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.595917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4133765-ebf6-41cb-bb85-2442363afeb2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:26.596436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4133765-ebf6-41cb-bb85-2442363afeb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:26.598266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4133765-ebf6-41cb-bb85-2442363afeb2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:26.604855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 502/998] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:56:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:26.611658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bc2eb-5302-407c-9798-bf37168e4a71 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:26.616018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:26.721629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bc2eb-5302-407c-9798-bf37168e4a71 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:26.762312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d081c8e-41f0-42ad-b902-3eb113ec9c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:26.763023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d081c8e-41f0-42ad-b902-3eb113ec9c14 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.763305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d081c8e-41f0-42ad-b902-3eb113ec9c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.764166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d081c8e-41f0-42ad-b902-3eb113ec9c14 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.765284 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d081c8e-41f0-42ad-b902-3eb113ec9c14 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:26.765592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d081c8e-41f0-42ad-b902-3eb113ec9c14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:26.766989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d081c8e-41f0-42ad-b902-3eb113ec9c14 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:26.782012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 497/999] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:56:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:26.783366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4133765-ebf6-41cb-bb85-2442363afeb2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:26.822567 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:26.895086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4133765-ebf6-41cb-bb85-2442363afeb2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:26.929252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e6ce2-3cef-4c4f-89da-0ba106ec5106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:26.929916 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6ce2-3cef-4c4f-89da-0ba106ec5106 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.930203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6ce2-3cef-4c4f-89da-0ba106ec5106 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.930524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6ce2-3cef-4c4f-89da-0ba106ec5106 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.931321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e6ce2-3cef-4c4f-89da-0ba106ec5106 None admin] RBAC: Adding query filter params (interface=public, service_id=e377cd5a39834580a89c2c2c1d08fa03, region_id=RegionOne) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:26.931640 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e6ce2-3cef-4c4f-89da-0ba106ec5106 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:26.932994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e6ce2-3cef-4c4f-89da-0ba106ec5106 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:26.938857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 503/1000] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 23 16:56:26 2022] GET /identity/v3/endpoints?service_id=e377cd5a39834580a89c2c2c1d08fa03&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:26.944173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d081c8e-41f0-42ad-b902-3eb113ec9c14 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:27.013244 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:27.049471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d081c8e-41f0-42ad-b902-3eb113ec9c14 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:27.083147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6ebcb-827e-4824-9882-50a468e5c842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:27.083812 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6ebcb-827e-4824-9882-50a468e5c842 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.084098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6ebcb-827e-4824-9882-50a468e5c842 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.084375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6ebcb-827e-4824-9882-50a468e5c842 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.085056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6ebcb-827e-4824-9882-50a468e5c842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:27.086445 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6ebcb-827e-4824-9882-50a468e5c842 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:27.093064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 498/1001] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 23 16:56:26 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:56:27.530342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1916f-def7-4f42-a7a1-3e0f1dbc0a9a None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.530705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1916f-def7-4f42-a7a1-3e0f1dbc0a9a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.530954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1916f-def7-4f42-a7a1-3e0f1dbc0a9a None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.532337 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 504/1002] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:27.537564 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a723c81-2e16-43b9-b764-b88ea544690c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.538029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a723c81-2e16-43b9-b764-b88ea544690c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.538112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a723c81-2e16-43b9-b764-b88ea544690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.555174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4a723c81-2e16-43b9-b764-b88ea544690c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:27.556370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4a723c81-2e16-43b9-b764-b88ea544690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:27.627113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 499/1003] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:27.649645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1916f-def7-4f42-a7a1-3e0f1dbc0a9a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:27.773825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:27.782441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1916f-def7-4f42-a7a1-3e0f1dbc0a9a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:27.817209 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776ec11-2dc6-4eb9-a86b-610db0b43e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:27.818100 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776ec11-2dc6-4eb9-a86b-610db0b43e32 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.818351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776ec11-2dc6-4eb9-a86b-610db0b43e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.818651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776ec11-2dc6-4eb9-a86b-610db0b43e32 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.819292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776ec11-2dc6-4eb9-a86b-610db0b43e32 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:27.820640 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776ec11-2dc6-4eb9-a86b-610db0b43e32 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e776ec11-2dc6-4eb9-a86b-610db0b43e32 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:27.833963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:27.835071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:27.835947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 505/1004] 10.222.0.49 () {56 vars in 1126 bytes} [Mon May 23 16:56:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:27.841107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a723c81-2e16-43b9-b764-b88ea544690c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:27.904580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:27.920970 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f05af-d16c-45f1-82f6-1090fa7c71c3 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.921234 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f05af-d16c-45f1-82f6-1090fa7c71c3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.921517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f05af-d16c-45f1-82f6-1090fa7c71c3 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.923069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 506/1005] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:56:27.928095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94200513-10d3-465a-b260-5901304e3331 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.928388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94200513-10d3-465a-b260-5901304e3331 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.928668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94200513-10d3-465a-b260-5901304e3331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.944855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a723c81-2e16-43b9-b764-b88ea544690c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:27.945636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-94200513-10d3-465a-b260-5901304e3331 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:27.946844 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-94200513-10d3-465a-b260-5901304e3331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:27.978491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4c699-cc84-4f7e-b84e-f8824e19a369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:27.979146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4c699-cc84-4f7e-b84e-f8824e19a369 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.979428 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4c699-cc84-4f7e-b84e-f8824e19a369 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.979704 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4c699-cc84-4f7e-b84e-f8824e19a369 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.980411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4c699-cc84-4f7e-b84e-f8824e19a369 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:27.980714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4c699-cc84-4f7e-b84e-f8824e19a369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:27.982061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4c699-cc84-4f7e-b84e-f8824e19a369 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:27.988114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 500/1006] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 23 16:56:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:27.993619 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4c699-cc84-4f7e-b84e-f8824e19a369 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:28.016257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 507/1007] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:28.039304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94200513-10d3-465a-b260-5901304e3331 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:28.111626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4c699-cc84-4f7e-b84e-f8824e19a369 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:28.139400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:28.139562 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:28.149196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428519b1-9676-4a89-b377-8c336467382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:28.149847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428519b1-9676-4a89-b377-8c336467382c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:28.150131 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428519b1-9676-4a89-b377-8c336467382c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:28.150430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428519b1-9676-4a89-b377-8c336467382c None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:28.150544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94200513-10d3-465a-b260-5901304e3331 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:28.151137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428519b1-9676-4a89-b377-8c336467382c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:28.151438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428519b1-9676-4a89-b377-8c336467382c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:28.152793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428519b1-9676-4a89-b377-8c336467382c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:28.163675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 501/1008] 10.222.0.49 () {56 vars in 1122 bytes} [Mon May 23 16:56:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:28.164395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428519b1-9676-4a89-b377-8c336467382c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:28.189638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda759a-70dc-473a-bc8d-4dc3ec22e4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:28.190892 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda759a-70dc-473a-bc8d-4dc3ec22e4c7 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:28.191524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda759a-70dc-473a-bc8d-4dc3ec22e4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:28.192268 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda759a-70dc-473a-bc8d-4dc3ec22e4c7 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:28.193445 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda759a-70dc-473a-bc8d-4dc3ec22e4c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:28.195511 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda759a-70dc-473a-bc8d-4dc3ec22e4c7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:28.222399 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 508/1009] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:56:28 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:28.273056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428519b1-9676-4a89-b377-8c336467382c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:28.318821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b2757-fe72-4c7c-9095-5d0efe4d496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:28.319404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b2757-fe72-4c7c-9095-5d0efe4d496e None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:28.319685 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b2757-fe72-4c7c-9095-5d0efe4d496e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:28.319954 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b2757-fe72-4c7c-9095-5d0efe4d496e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:28.320697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b2757-fe72-4c7c-9095-5d0efe4d496e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:28.322112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b2757-fe72-4c7c-9095-5d0efe4d496e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:28.340315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 502/1010] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 23 16:56:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:29.376216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d718c-b648-4c62-a2a4-538250901d57 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:29.376748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d718c-b648-4c62-a2a4-538250901d57 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:29.376748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d718c-b648-4c62-a2a4-538250901d57 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:29.378198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 509/1011] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:29.383464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3070e-5ee0-4df1-8c4e-f7b6b2251d1b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:29.383909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3070e-5ee0-4df1-8c4e-f7b6b2251d1b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:29.384058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3070e-5ee0-4df1-8c4e-f7b6b2251d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:29.401685 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8ea3070e-5ee0-4df1-8c4e-f7b6b2251d1b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:29.402911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8ea3070e-5ee0-4df1-8c4e-f7b6b2251d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:29.448287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:29.486418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 503/1012] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:29 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:29.508870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d718c-b648-4c62-a2a4-538250901d57 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:29.612405 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d718c-b648-4c62-a2a4-538250901d57 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:29.645979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74172ee4-78b7-4c86-beea-41f0c9e45e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:29.646728 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74172ee4-78b7-4c86-beea-41f0c9e45e9b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:29.647016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74172ee4-78b7-4c86-beea-41f0c9e45e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:29.647295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74172ee4-78b7-4c86-beea-41f0c9e45e9b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:29.647942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74172ee4-78b7-4c86-beea-41f0c9e45e9b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:29.649299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74172ee4-78b7-4c86-beea-41f0c9e45e9b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-74172ee4-78b7-4c86-beea-41f0c9e45e9b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:29.661877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:29.662904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:56:29.663779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:29.666443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 510/1013] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:29.670075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3070e-5ee0-4df1-8c4e-f7b6b2251d1b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:29.773220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3070e-5ee0-4df1-8c4e-f7b6b2251d1b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:29.809892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7843a1d-8f8e-46e5-908d-01d6c64662b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:29.810611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7843a1d-8f8e-46e5-908d-01d6c64662b9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:29.810897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7843a1d-8f8e-46e5-908d-01d6c64662b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:29.811172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7843a1d-8f8e-46e5-908d-01d6c64662b9 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:29.811878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7843a1d-8f8e-46e5-908d-01d6c64662b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:29.812185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7843a1d-8f8e-46e5-908d-01d6c64662b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:29.813545 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7843a1d-8f8e-46e5-908d-01d6c64662b9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:29.823345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 504/1014] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:56:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:29.824864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74172ee4-78b7-4c86-beea-41f0c9e45e9b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:29.845112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:29.931365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74172ee4-78b7-4c86-beea-41f0c9e45e9b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:29.965077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d399b-bca2-4471-8c26-af7bae130ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:29.965746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d399b-bca2-4471-8c26-af7bae130ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:29.966030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d399b-bca2-4471-8c26-af7bae130ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:29.966306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d399b-bca2-4471-8c26-af7bae130ee4 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:29.967808 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d399b-bca2-4471-8c26-af7bae130ee4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:29.968305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d399b-bca2-4471-8c26-af7bae130ee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:29.969665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d399b-bca2-4471-8c26-af7bae130ee4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:29.974991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 511/1015] 10.222.0.49 () {56 vars in 1112 bytes} [Mon May 23 16:56:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:29.980400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7843a1d-8f8e-46e5-908d-01d6c64662b9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:30.017780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:30.087092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7843a1d-8f8e-46e5-908d-01d6c64662b9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:30.121816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721cbb7-1880-40fa-9431-352060716e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:30.122519 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721cbb7-1880-40fa-9431-352060716e76 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:30.122844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721cbb7-1880-40fa-9431-352060716e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:30.123123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721cbb7-1880-40fa-9431-352060716e76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:30.123877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721cbb7-1880-40fa-9431-352060716e76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:30.125325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721cbb7-1880-40fa-9431-352060716e76 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:30.154653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 505/1016] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 23 16:56:29 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:30.490944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a7cb8-ba27-438e-9e58-b9662c305ceb None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:30.491468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a7cb8-ba27-438e-9e58-b9662c305ceb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:30.491577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a7cb8-ba27-438e-9e58-b9662c305ceb None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:30.493014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 512/1017] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:30.498737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4225b6-6da1-4962-8ff2-2b0b401a1046 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:30.499345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4225b6-6da1-4962-8ff2-2b0b401a1046 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:30.499695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4225b6-6da1-4962-8ff2-2b0b401a1046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:30.518021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9a4225b6-6da1-4962-8ff2-2b0b401a1046 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:30.519221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9a4225b6-6da1-4962-8ff2-2b0b401a1046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:30.559394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0633892-a2bf-4646-a20f-6139713614c1 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:30.559701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0633892-a2bf-4646-a20f-6139713614c1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:30.559966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0633892-a2bf-4646-a20f-6139713614c1 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:30.561949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 513/1018] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:30.566875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257da33-1fc7-4bd9-acf6-71cc9f1f26c8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:30.567163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257da33-1fc7-4bd9-acf6-71cc9f1f26c8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:30.567443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257da33-1fc7-4bd9-acf6-71cc9f1f26c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:30.585129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b257da33-1fc7-4bd9-acf6-71cc9f1f26c8 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:30.586313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b257da33-1fc7-4bd9-acf6-71cc9f1f26c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:30.597182 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 506/1019] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:30.619498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4225b6-6da1-4962-8ff2-2b0b401a1046 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:30.639458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:30.660622 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 514/1020] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:30.683522 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257da33-1fc7-4bd9-acf6-71cc9f1f26c8 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:30.695843 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:30.725105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4225b6-6da1-4962-8ff2-2b0b401a1046 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:30.760772 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95d0d-e178-4567-a83c-e70a011bcf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:30.761785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95d0d-e178-4567-a83c-e70a011bcf78 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:30.761902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95d0d-e178-4567-a83c-e70a011bcf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:30.762213 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95d0d-e178-4567-a83c-e70a011bcf78 None admin] PATH_INFO: `/v3/services/image` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:30.762841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b95d0d-e178-4567-a83c-e70a011bcf78 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:30.764274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b95d0d-e178-4567-a83c-e70a011bcf78 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-d4b95d0d-e178-4567-a83c-e70a011bcf78 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:30.785435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:30.786460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:56:30.787399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:30.788157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 507/1021] 10.222.0.49 () {56 vars in 1105 bytes} [Mon May 23 16:56:30 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:30.793234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95d0d-e178-4567-a83c-e70a011bcf78 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:30.795250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257da33-1fc7-4bd9-acf6-71cc9f1f26c8 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:30.831816 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2005cbb-e0cb-453d-a333-b769b5ca4f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:30.832607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2005cbb-e0cb-453d-a333-b769b5ca4f39 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:30.832893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2005cbb-e0cb-453d-a333-b769b5ca4f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:30.833168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2005cbb-e0cb-453d-a333-b769b5ca4f39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:30.834333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2005cbb-e0cb-453d-a333-b769b5ca4f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:30.835844 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2005cbb-e0cb-453d-a333-b769b5ca4f39 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:30.837460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 515/1022] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:30.843173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2005cbb-e0cb-453d-a333-b769b5ca4f39 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:30.888298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:30.908475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95d0d-e178-4567-a83c-e70a011bcf78 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:30.930217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:30.947151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bff383-e225-487f-9b55-92a7095c2af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:30.947567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bff383-e225-487f-9b55-92a7095c2af8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:30.947851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bff383-e225-487f-9b55-92a7095c2af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:30.948193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bff383-e225-487f-9b55-92a7095c2af8 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:30.948830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bff383-e225-487f-9b55-92a7095c2af8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:30.949137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bff383-e225-487f-9b55-92a7095c2af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:30.950768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bff383-e225-487f-9b55-92a7095c2af8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:30.960262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 508/1023] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:30.960433 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2005cbb-e0cb-453d-a333-b769b5ca4f39 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:30.961255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bff383-e225-487f-9b55-92a7095c2af8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.000627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5206e-a86f-4498-b9ef-f337002b7240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.001303 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5206e-a86f-4498-b9ef-f337002b7240 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.001593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5206e-a86f-4498-b9ef-f337002b7240 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.001874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5206e-a86f-4498-b9ef-f337002b7240 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.002614 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5206e-a86f-4498-b9ef-f337002b7240 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.004048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5206e-a86f-4498-b9ef-f337002b7240 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.030671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 516/1024] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:56:30 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:31.070794 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bff383-e225-487f-9b55-92a7095c2af8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.109573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2e74-b17d-4f00-b64d-74e4bb81e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.110257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2e74-b17d-4f00-b64d-74e4bb81e676 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.110570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2e74-b17d-4f00-b64d-74e4bb81e676 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.110843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2e74-b17d-4f00-b64d-74e4bb81e676 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.111562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb2e74-b17d-4f00-b64d-74e4bb81e676 None admin] RBAC: Adding query filter params (type=image) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:31.111870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb2e74-b17d-4f00-b64d-74e4bb81e676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.113248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb2e74-b17d-4f00-b64d-74e4bb81e676 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.119117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 509/1025] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:31.125486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5206e-a86f-4498-b9ef-f337002b7240 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.234332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5206e-a86f-4498-b9ef-f337002b7240 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.264893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:31.271488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf91d-84db-4ae7-b642-47a1353dbeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.272170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf91d-84db-4ae7-b642-47a1353dbeca None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.272631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf91d-84db-4ae7-b642-47a1353dbeca None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.273077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf91d-84db-4ae7-b642-47a1353dbeca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.274048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bf91d-84db-4ae7-b642-47a1353dbeca None admin] RBAC: Adding query filter params (interface=public, service_id=a904f1207ab447e1a4a85ec01222934d, region_id=RegionOne) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:31.274390 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bf91d-84db-4ae7-b642-47a1353dbeca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.275765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bf91d-84db-4ae7-b642-47a1353dbeca None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.281092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 517/1026] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 23 16:56:31 2022] GET /identity/v3/endpoints?service_id=a904f1207ab447e1a4a85ec01222934d&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:31.286765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2e74-b17d-4f00-b64d-74e4bb81e676 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.300085 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:31.394569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2e74-b17d-4f00-b64d-74e4bb81e676 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.429515 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe51f0-e38b-43c6-9507-f275e7299844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.430194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe51f0-e38b-43c6-9507-f275e7299844 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.430576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe51f0-e38b-43c6-9507-f275e7299844 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.431030 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe51f0-e38b-43c6-9507-f275e7299844 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.431799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe51f0-e38b-43c6-9507-f275e7299844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.433412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe51f0-e38b-43c6-9507-f275e7299844 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.441054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 510/1027] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 23 16:56:31 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:32.484850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b1960-d8e0-4835-8684-cbfd5c3d1824 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.485486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b1960-d8e0-4835-8684-cbfd5c3d1824 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.485486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b1960-d8e0-4835-8684-cbfd5c3d1824 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.487069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 518/1028] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:32.493566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c73a01-0afe-4240-8a4b-7df58da96025 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.494000 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c73a01-0afe-4240-8a4b-7df58da96025 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.494147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c73a01-0afe-4240-8a4b-7df58da96025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.511969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-50c73a01-0afe-4240-8a4b-7df58da96025 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:32.513148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-50c73a01-0afe-4240-8a4b-7df58da96025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:32.584199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 511/1029] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:32.607818 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b1960-d8e0-4835-8684-cbfd5c3d1824 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:32.720781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b1960-d8e0-4835-8684-cbfd5c3d1824 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:32.755655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece2487-f40a-403a-a35a-8f28ab2be307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:32.756757 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece2487-f40a-403a-a35a-8f28ab2be307 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.757198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece2487-f40a-403a-a35a-8f28ab2be307 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.757678 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece2487-f40a-403a-a35a-8f28ab2be307 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.771143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece2487-f40a-403a-a35a-8f28ab2be307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-cece2487-f40a-403a-a35a-8f28ab2be307 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:32.786344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:32.787540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:32.788607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 519/1030] 10.222.0.49 () {56 vars in 1120 bytes} [Mon May 23 16:56:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:32.791487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c73a01-0afe-4240-8a4b-7df58da96025 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:32.796887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:32.899786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c73a01-0afe-4240-8a4b-7df58da96025 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:32.934961 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77d36e-3679-499a-bfe2-f3c9230a32dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:32.935903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77d36e-3679-499a-bfe2-f3c9230a32dd None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.936344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77d36e-3679-499a-bfe2-f3c9230a32dd None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.936775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77d36e-3679-499a-bfe2-f3c9230a32dd None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.937705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77d36e-3679-499a-bfe2-f3c9230a32dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:32.938169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77d36e-3679-499a-bfe2-f3c9230a32dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:32.939713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77d36e-3679-499a-bfe2-f3c9230a32dd None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:32.953120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 512/1031] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 23 16:56:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:32.954730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece2487-f40a-403a-a35a-8f28ab2be307 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:33.011791 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:33.058381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece2487-f40a-403a-a35a-8f28ab2be307 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:33.092981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c17c6-97b8-4ea4-83dc-112bc5620566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:33.094016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c17c6-97b8-4ea4-83dc-112bc5620566 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.094517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c17c6-97b8-4ea4-83dc-112bc5620566 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.094946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c17c6-97b8-4ea4-83dc-112bc5620566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.105895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c17c6-97b8-4ea4-83dc-112bc5620566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:33.108100 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c17c6-97b8-4ea4-83dc-112bc5620566 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-4b6c17c6-97b8-4ea4-83dc-112bc5620566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:33.126443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:33.127508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:33.128416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:33.128416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:33.128416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:33.128416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:33.128416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 520/1032] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:33.134593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77d36e-3679-499a-bfe2-f3c9230a32dd None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:33.205156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:33.241884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77d36e-3679-499a-bfe2-f3c9230a32dd None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:33.276665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7100782-945a-430f-aa9c-51455dfac3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:33.277635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7100782-945a-430f-aa9c-51455dfac3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.278072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7100782-945a-430f-aa9c-51455dfac3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.278538 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7100782-945a-430f-aa9c-51455dfac3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.279534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7100782-945a-430f-aa9c-51455dfac3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:33.279993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7100782-945a-430f-aa9c-51455dfac3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:33.281536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7100782-945a-430f-aa9c-51455dfac3c2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:33.294337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 513/1033] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:33.300280 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c17c6-97b8-4ea4-83dc-112bc5620566 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:33.320400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378363cb-2989-47d7-bb11-25ded787dcd7 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.320695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378363cb-2989-47d7-bb11-25ded787dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.320989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378363cb-2989-47d7-bb11-25ded787dcd7 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.322608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 514/1034] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:56:33.327916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52baa-61d2-4bb6-b355-52fed8e68429 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.328213 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52baa-61d2-4bb6-b355-52fed8e68429 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.328497 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52baa-61d2-4bb6-b355-52fed8e68429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.345296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-41b52baa-61d2-4bb6-b355-52fed8e68429 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:33.346524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-41b52baa-61d2-4bb6-b355-52fed8e68429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:33.413679 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c17c6-97b8-4ea4-83dc-112bc5620566 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:33.416662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 515/1035] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:33.422460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:33.442222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b52baa-61d2-4bb6-b355-52fed8e68429 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:33.452575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397bd49-055c-4e61-9302-a3707cbedc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:33.453369 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397bd49-055c-4e61-9302-a3707cbedc98 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.453659 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397bd49-055c-4e61-9302-a3707cbedc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.453929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397bd49-055c-4e61-9302-a3707cbedc98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.461317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397bd49-055c-4e61-9302-a3707cbedc98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:33.462795 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397bd49-055c-4e61-9302-a3707cbedc98 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b397bd49-055c-4e61-9302-a3707cbedc98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:56:33.478181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:33.479228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:33.480222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:33.480222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:33.480222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:56:33.480222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:56:33.480222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:56:33.480222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:56:33.480222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:56:33.480222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:56:33.480222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:56:33.480222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:33.482776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 521/1036] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 23 16:56:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:33.485441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397bd49-055c-4e61-9302-a3707cbedc98 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:33.509469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:33.564811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b52baa-61d2-4bb6-b355-52fed8e68429 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:33.602996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e67439-fe14-4e93-82d8-345d85ca5a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:33.603569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397bd49-055c-4e61-9302-a3707cbedc98 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:33.603789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e67439-fe14-4e93-82d8-345d85ca5a0e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.604080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e67439-fe14-4e93-82d8-345d85ca5a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.604366 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e67439-fe14-4e93-82d8-345d85ca5a0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.605746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e67439-fe14-4e93-82d8-345d85ca5a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:33.608489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e67439-fe14-4e93-82d8-345d85ca5a0e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:33.614724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 516/1037] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:33.616076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e67439-fe14-4e93-82d8-345d85ca5a0e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:33.640685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe42a65-ebd2-4dd1-802c-0bfad2ac8a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:33.641361 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe42a65-ebd2-4dd1-802c-0bfad2ac8a31 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.641651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe42a65-ebd2-4dd1-802c-0bfad2ac8a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.641935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe42a65-ebd2-4dd1-802c-0bfad2ac8a31 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.642939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe42a65-ebd2-4dd1-802c-0bfad2ac8a31 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:33.643260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe42a65-ebd2-4dd1-802c-0bfad2ac8a31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:33.644707 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe42a65-ebd2-4dd1-802c-0bfad2ac8a31 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:33.663941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 522/1038] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 23 16:56:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:33.669230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe42a65-ebd2-4dd1-802c-0bfad2ac8a31 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:33.695823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:33.723046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e67439-fe14-4e93-82d8-345d85ca5a0e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:33.746938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:33.757996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40842fb2-86b8-4ff4-9ae6-894bf85c3875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:33.758696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40842fb2-86b8-4ff4-9ae6-894bf85c3875 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.759010 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40842fb2-86b8-4ff4-9ae6-894bf85c3875 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.759291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40842fb2-86b8-4ff4-9ae6-894bf85c3875 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.759993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40842fb2-86b8-4ff4-9ae6-894bf85c3875 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:33.761421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40842fb2-86b8-4ff4-9ae6-894bf85c3875 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:33.772196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe42a65-ebd2-4dd1-802c-0bfad2ac8a31 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:33.787836 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 517/1039] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:56:33 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:33.788994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74863dde-0b24-4e64-ac21-a185a7ef9748 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.789286 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74863dde-0b24-4e64-ac21-a185a7ef9748 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.789571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74863dde-0b24-4e64-ac21-a185a7ef9748 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.790997 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 518/1040] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:33.797930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b576ee-da6e-43c5-b154-f45cbace8ed9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.798249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b576ee-da6e-43c5-b154-f45cbace8ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.798540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b576ee-da6e-43c5-b154-f45cbace8ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.817407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c6b576ee-da6e-43c5-b154-f45cbace8ed9 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:33.818592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c6b576ee-da6e-43c5-b154-f45cbace8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:33.820946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c107e-efa9-4688-9d6f-ef19b8f9c38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:33.821631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c107e-efa9-4688-9d6f-ef19b8f9c38d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.822772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c107e-efa9-4688-9d6f-ef19b8f9c38d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.823065 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c107e-efa9-4688-9d6f-ef19b8f9c38d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.901265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c107e-efa9-4688-9d6f-ef19b8f9c38d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:33.902762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c107e-efa9-4688-9d6f-ef19b8f9c38d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:33.907263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 519/1041] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:33.932088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b576ee-da6e-43c5-b154-f45cbace8ed9 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:33.933222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:34.021110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 523/1042] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:56:33 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 16:56:34.026632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c107e-efa9-4688-9d6f-ef19b8f9c38d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:34.052552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b576ee-da6e-43c5-b154-f45cbace8ed9 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:34.066204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:34.099636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6050999-ff02-41bc-ae25-45b4461a15cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:34.100432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6050999-ff02-41bc-ae25-45b4461a15cf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:34.100715 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6050999-ff02-41bc-ae25-45b4461a15cf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:34.100987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6050999-ff02-41bc-ae25-45b4461a15cf None admin] PATH_INFO: `/v3/services/image` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:34.101639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6050999-ff02-41bc-ae25-45b4461a15cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:34.103053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6050999-ff02-41bc-ae25-45b4461a15cf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-f6050999-ff02-41bc-ae25-45b4461a15cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:34.114630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:34.115673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:34.116536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 520/1043] 10.222.0.49 () {56 vars in 1105 bytes} [Mon May 23 16:56:33 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:34.121866 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6050999-ff02-41bc-ae25-45b4461a15cf None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:34.136792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c107e-efa9-4688-9d6f-ef19b8f9c38d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:34.161812 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:34.173427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533600e-1433-4365-8a6d-18e7182b0765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:34.174227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533600e-1433-4365-8a6d-18e7182b0765 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:34.174548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533600e-1433-4365-8a6d-18e7182b0765 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:34.174826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533600e-1433-4365-8a6d-18e7182b0765 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:34.185070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533600e-1433-4365-8a6d-18e7182b0765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:34.186862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533600e-1433-4365-8a6d-18e7182b0765 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-5533600e-1433-4365-8a6d-18e7182b0765 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:34.205665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:34.206713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:34.207760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:34.207760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:34.207760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:34.207760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:34.207760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 524/1044] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:34.212400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533600e-1433-4365-8a6d-18e7182b0765 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:34.237676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6050999-ff02-41bc-ae25-45b4461a15cf None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:34.274838 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7bcba-9200-4a0f-afdc-1b6139ace02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:34.275505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7bcba-9200-4a0f-afdc-1b6139ace02e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:34.275795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7bcba-9200-4a0f-afdc-1b6139ace02e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:34.276118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7bcba-9200-4a0f-afdc-1b6139ace02e None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:34.276789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7bcba-9200-4a0f-afdc-1b6139ace02e None admin] RBAC: Adding query filter params (name=image) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:34.277102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7bcba-9200-4a0f-afdc-1b6139ace02e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:34.278504 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7bcba-9200-4a0f-afdc-1b6139ace02e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:34.288646 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 521/1045] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:34.289661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7bcba-9200-4a0f-afdc-1b6139ace02e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:34.323828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533600e-1433-4365-8a6d-18e7182b0765 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:34.331688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:34.362975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1221d85-b6de-4975-bea6-cab67f79f0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:34.363561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1221d85-b6de-4975-bea6-cab67f79f0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:34.363840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1221d85-b6de-4975-bea6-cab67f79f0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:34.364124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1221d85-b6de-4975-bea6-cab67f79f0c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:34.364847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1221d85-b6de-4975-bea6-cab67f79f0c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:34.365156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1221d85-b6de-4975-bea6-cab67f79f0c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:34.366540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1221d85-b6de-4975-bea6-cab67f79f0c7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:34.379372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 525/1046] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:34.384595 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1221d85-b6de-4975-bea6-cab67f79f0c7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:34.398430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7bcba-9200-4a0f-afdc-1b6139ace02e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:34.420110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:34.438040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab967eef-6d93-4053-a5ca-e162c7e7a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:34.438731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab967eef-6d93-4053-a5ca-e162c7e7a6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:34.439017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab967eef-6d93-4053-a5ca-e162c7e7a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:34.439292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab967eef-6d93-4053-a5ca-e162c7e7a6c4 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:34.440302 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab967eef-6d93-4053-a5ca-e162c7e7a6c4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:34.440302 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab967eef-6d93-4053-a5ca-e162c7e7a6c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:34.441634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab967eef-6d93-4053-a5ca-e162c7e7a6c4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:34.446918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 522/1047] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:34.452687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab967eef-6d93-4053-a5ca-e162c7e7a6c4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:34.495331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1221d85-b6de-4975-bea6-cab67f79f0c7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:34.538767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce15faf-0e2c-4a33-9842-3718dede1407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:34.540120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce15faf-0e2c-4a33-9842-3718dede1407 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:34.540541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce15faf-0e2c-4a33-9842-3718dede1407 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:34.540819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce15faf-0e2c-4a33-9842-3718dede1407 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:34.549607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce15faf-0e2c-4a33-9842-3718dede1407 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:34.551068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce15faf-0e2c-4a33-9842-3718dede1407 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:34.562214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab967eef-6d93-4053-a5ca-e162c7e7a6c4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:34.563990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-0ce15faf-0e2c-4a33-9842-3718dede1407 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:56:34.566006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:34.567453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:34.568408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:56:34.568408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:56:34.568408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:56:34.568408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:56:34.568408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:56:34.568408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:56:34.568408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:34.568408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:34.568408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 526/1048] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:34.573311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce15faf-0e2c-4a33-9842-3718dede1407 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:34.604816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84c351-12c8-46c1-a2f9-467067c75427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:34.605485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84c351-12c8-46c1-a2f9-467067c75427 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:34.605767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84c351-12c8-46c1-a2f9-467067c75427 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:34.606040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84c351-12c8-46c1-a2f9-467067c75427 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:34.606805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84c351-12c8-46c1-a2f9-467067c75427 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:34.608511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84c351-12c8-46c1-a2f9-467067c75427 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:34.638817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 523/1049] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 23 16:56:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:34.687896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:34.696290 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce15faf-0e2c-4a33-9842-3718dede1407 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:34.742179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30ed93-b33d-43ba-9184-717e0f804fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:34.742969 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ed93-b33d-43ba-9184-717e0f804fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:34.743258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ed93-b33d-43ba-9184-717e0f804fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:34.743528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ed93-b33d-43ba-9184-717e0f804fa6 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:34.744317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30ed93-b33d-43ba-9184-717e0f804fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:34.744623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30ed93-b33d-43ba-9184-717e0f804fa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:34.746042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30ed93-b33d-43ba-9184-717e0f804fa6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:34.759420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 527/1050] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:56:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:34.766091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84c351-12c8-46c1-a2f9-467067c75427 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:34.873760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84c351-12c8-46c1-a2f9-467067c75427 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:34.909376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203640f-8daa-4b4a-ba9b-b44f621bc954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:34.910346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203640f-8daa-4b4a-ba9b-b44f621bc954 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:34.910874 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203640f-8daa-4b4a-ba9b-b44f621bc954 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:34.911346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203640f-8daa-4b4a-ba9b-b44f621bc954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:34.912423 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203640f-8daa-4b4a-ba9b-b44f621bc954 None admin] RBAC: Adding query filter params (role.id=17a702ca9868424f82b0bc9637326a8e, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=9884780c88aa48ffa92a696740761387) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:34.912744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203640f-8daa-4b4a-ba9b-b44f621bc954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:34.914795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203640f-8daa-4b4a-ba9b-b44f621bc954 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:34.921448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 524/1051] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:56:34 2022] GET /identity/v3/role_assignments?user.id=9884780c88aa48ffa92a696740761387&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=17a702ca9868424f82b0bc9637326a8e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:36.131041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce175bf-e0fd-4852-b0ea-4c388a38cdac None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:36.131667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce175bf-e0fd-4852-b0ea-4c388a38cdac None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:36.131911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce175bf-e0fd-4852-b0ea-4c388a38cdac None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:36.134183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 528/1052] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:36.139919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded688-6ad2-4603-a5e9-8daae577f07c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:36.140387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded688-6ad2-4603-a5e9-8daae577f07c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:36.140474 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded688-6ad2-4603-a5e9-8daae577f07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:36.157780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-29ded688-6ad2-4603-a5e9-8daae577f07c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:36.159011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-29ded688-6ad2-4603-a5e9-8daae577f07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:36.176817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:36.229884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 525/1053] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:36.254656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce175bf-e0fd-4852-b0ea-4c388a38cdac None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:36.356266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce175bf-e0fd-4852-b0ea-4c388a38cdac None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:36.390543 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2418ae-dc03-492c-88e1-9093f356154d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:36.391274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2418ae-dc03-492c-88e1-9093f356154d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:36.391541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2418ae-dc03-492c-88e1-9093f356154d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:36.391816 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2418ae-dc03-492c-88e1-9093f356154d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:36.402062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2418ae-dc03-492c-88e1-9093f356154d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-6f2418ae-dc03-492c-88e1-9093f356154d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:36.409815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:36.411047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:36.411949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:36.411949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:36.411949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:36.411949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:36.411949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:36.411949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:36.411949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:36.411949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:36.411949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:36.411949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:36.411949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:56:36.411949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:36.414685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 529/1054] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:56:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:36.416852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded688-6ad2-4603-a5e9-8daae577f07c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:36.520772 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded688-6ad2-4603-a5e9-8daae577f07c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:36.555002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a1e40-f249-4be7-9ee2-9f559e635a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:36.555670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a1e40-f249-4be7-9ee2-9f559e635a20 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:36.555956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a1e40-f249-4be7-9ee2-9f559e635a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:36.556232 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a1e40-f249-4be7-9ee2-9f559e635a20 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:36.556978 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a1e40-f249-4be7-9ee2-9f559e635a20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:36.557284 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a1e40-f249-4be7-9ee2-9f559e635a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:36.558672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a1e40-f249-4be7-9ee2-9f559e635a20 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:36.571965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 526/1055] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:56:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:36.573266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2418ae-dc03-492c-88e1-9093f356154d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:36.590318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:36.682083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2418ae-dc03-492c-88e1-9093f356154d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:36.721342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf62e3c-4862-40c0-a99e-89d30ababe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:36.722236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf62e3c-4862-40c0-a99e-89d30ababe31 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:36.722554 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf62e3c-4862-40c0-a99e-89d30ababe31 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:36.722836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf62e3c-4862-40c0-a99e-89d30ababe31 None admin] PATH_INFO: `/v3/users/1e6381a2454a4081a30e833a1af90afd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:36.737599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf62e3c-4862-40c0-a99e-89d30ababe31 None admin] RBAC: Authorizing `identity:get_user(user_id=1e6381a2454a4081a30e833a1af90afd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:36.739084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf62e3c-4862-40c0-a99e-89d30ababe31 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:36.740959 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 530/1056] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:56:36 2022] GET /identity/v3/users/1e6381a2454a4081a30e833a1af90afd => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:36.746529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a1e40-f249-4be7-9ee2-9f559e635a20 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:36.764323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:36.859251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a1e40-f249-4be7-9ee2-9f559e635a20 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:36.885016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784db79-e09f-48e3-9412-d6765b9fcaae None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:36.885301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784db79-e09f-48e3-9412-d6765b9fcaae None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:36.885588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784db79-e09f-48e3-9412-d6765b9fcaae None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:36.887025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 531/1057] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:56:36.892200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8f8aa-379c-418b-8617-903bf3d41bbe None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:36.892485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8f8aa-379c-418b-8617-903bf3d41bbe None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:36.892760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8f8aa-379c-418b-8617-903bf3d41bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:36.899724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864de3d-208e-4a06-b515-7ad32439f730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:36.900380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864de3d-208e-4a06-b515-7ad32439f730 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:36.900667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864de3d-208e-4a06-b515-7ad32439f730 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:36.900944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864de3d-208e-4a06-b515-7ad32439f730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:36.915630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-02c8f8aa-379c-418b-8617-903bf3d41bbe None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:36.916953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-02c8f8aa-379c-418b-8617-903bf3d41bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:36.982507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864de3d-208e-4a06-b515-7ad32439f730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:36.983881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864de3d-208e-4a06-b515-7ad32439f730 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:36.999857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:37.007960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:37.022406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 532/1058] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:37.035910 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8f8aa-379c-418b-8617-903bf3d41bbe None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.094034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 527/1059] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:56:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:56:37.095131 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864de3d-208e-4a06-b515-7ad32439f730 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.155693 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8f8aa-379c-418b-8617-903bf3d41bbe None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.188715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc6db6-8776-44d7-9247-5e5f284b237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.189376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6db6-8776-44d7-9247-5e5f284b237e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.189660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6db6-8776-44d7-9247-5e5f284b237e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.189936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6db6-8776-44d7-9247-5e5f284b237e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.194000 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864de3d-208e-4a06-b515-7ad32439f730 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.208467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:37.228818 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defebbe-a196-4b7d-bac3-e1c59e2e573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.229696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defebbe-a196-4b7d-bac3-e1c59e2e573c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.229986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defebbe-a196-4b7d-bac3-e1c59e2e573c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.230258 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defebbe-a196-4b7d-bac3-e1c59e2e573c None admin] PATH_INFO: `/v3/projects/cc5978a1b0484f53becb8327eb426734` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.231456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defebbe-a196-4b7d-bac3-e1c59e2e573c None admin] RBAC: Authorizing `identity:get_project(project_id=cc5978a1b0484f53becb8327eb426734)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.232972 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defebbe-a196-4b7d-bac3-e1c59e2e573c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.234636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 528/1060] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:56:37 2022] GET /identity/v3/projects/cc5978a1b0484f53becb8327eb426734 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:37.235873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bfc52-dd6c-440b-968c-4840208af582 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.236169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bfc52-dd6c-440b-968c-4840208af582 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.236448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bfc52-dd6c-440b-968c-4840208af582 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.241569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 529/1061] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:37.241569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bfc52-dd6c-440b-968c-4840208af582 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.258867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:37.261380 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc6db6-8776-44d7-9247-5e5f284b237e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.263657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc6db6-8776-44d7-9247-5e5f284b237e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.340843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bfc52-dd6c-440b-968c-4840208af582 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.360585 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 533/1062] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:56:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 16:56:37.361863 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766b8d5-2c61-44c4-92de-bcfbf553727c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.362150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766b8d5-2c61-44c4-92de-bcfbf553727c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.362610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766b8d5-2c61-44c4-92de-bcfbf553727c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.376852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d196f-6d22-4f14-a5f0-1986a6ce76a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.377506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d196f-6d22-4f14-a5f0-1986a6ce76a1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.377792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d196f-6d22-4f14-a5f0-1986a6ce76a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.377983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c766b8d5-2c61-44c4-92de-bcfbf553727c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:37.378087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d196f-6d22-4f14-a5f0-1986a6ce76a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.378933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d196f-6d22-4f14-a5f0-1986a6ce76a1 None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=cc5978a1b0484f53becb8327eb426734, user.id=1e6381a2454a4081a30e833a1af90afd) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:37.379180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c766b8d5-2c61-44c4-92de-bcfbf553727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:37.379274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d196f-6d22-4f14-a5f0-1986a6ce76a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.380667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d196f-6d22-4f14-a5f0-1986a6ce76a1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.386049 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 530/1063] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:56:37 2022] GET /identity/v3/role_assignments?user.id=1e6381a2454a4081a30e833a1af90afd&scope.project.id=cc5978a1b0484f53becb8327eb426734&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:37.386862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d196f-6d22-4f14-a5f0-1986a6ce76a1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.454021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 534/1064] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:37.455203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:37.484054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766b8d5-2c61-44c4-92de-bcfbf553727c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.519198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:37.530108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d196f-6d22-4f14-a5f0-1986a6ce76a1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.568922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7514dc-3d20-4baf-9396-21a5a8d4faeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.569727 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7514dc-3d20-4baf-9396-21a5a8d4faeb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.570076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7514dc-3d20-4baf-9396-21a5a8d4faeb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.570286 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7514dc-3d20-4baf-9396-21a5a8d4faeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.583765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7514dc-3d20-4baf-9396-21a5a8d4faeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.584759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7514dc-3d20-4baf-9396-21a5a8d4faeb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ad7514dc-3d20-4baf-9396-21a5a8d4faeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:37.603493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:37.604452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:37.605362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:37.605362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:37.605362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:37.605362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:37.605362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 531/1065] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:37.610658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7514dc-3d20-4baf-9396-21a5a8d4faeb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.612491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766b8d5-2c61-44c4-92de-bcfbf553727c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.646915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd67b2-fe63-4fae-833f-b9f282525520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.647841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd67b2-fe63-4fae-833f-b9f282525520 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.648240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd67b2-fe63-4fae-833f-b9f282525520 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.648512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd67b2-fe63-4fae-833f-b9f282525520 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.659756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd67b2-fe63-4fae-833f-b9f282525520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-6abd67b2-fe63-4fae-833f-b9f282525520 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:37.667761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:37.668713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:37.669713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 535/1066] 10.222.0.49 () {56 vars in 1120 bytes} [Mon May 23 16:56:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:37.674952 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd67b2-fe63-4fae-833f-b9f282525520 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.727974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:37.733105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7514dc-3d20-4baf-9396-21a5a8d4faeb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.770189 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8f260-6e65-4707-87ce-3d128e1987d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.770803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8f260-6e65-4707-87ce-3d128e1987d6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.771091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8f260-6e65-4707-87ce-3d128e1987d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.771430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8f260-6e65-4707-87ce-3d128e1987d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.772096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8f260-6e65-4707-87ce-3d128e1987d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:37.772568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8f260-6e65-4707-87ce-3d128e1987d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.773785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8f260-6e65-4707-87ce-3d128e1987d6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.778228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:37.788979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 532/1067] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:37.792939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd67b2-fe63-4fae-833f-b9f282525520 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.833903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14384a-a4f1-4273-9428-210a2fc7ece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.835549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14384a-a4f1-4273-9428-210a2fc7ece4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.836473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14384a-a4f1-4273-9428-210a2fc7ece4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.837329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14384a-a4f1-4273-9428-210a2fc7ece4 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.839296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14384a-a4f1-4273-9428-210a2fc7ece4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:37.840085 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14384a-a4f1-4273-9428-210a2fc7ece4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.843602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14384a-a4f1-4273-9428-210a2fc7ece4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.856026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 536/1068] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 23 16:56:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:37.862689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8f260-6e65-4707-87ce-3d128e1987d6 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.977483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8f260-6e65-4707-87ce-3d128e1987d6 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.016330 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70662-4186-4834-9531-2981d76d9c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.017127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70662-4186-4834-9531-2981d76d9c12 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.017412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70662-4186-4834-9531-2981d76d9c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.017690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70662-4186-4834-9531-2981d76d9c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.029994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b70662-4186-4834-9531-2981d76d9c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.031410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b70662-4186-4834-9531-2981d76d9c12 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-14b70662-4186-4834-9531-2981d76d9c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:38.049186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:38.050143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:38.051101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:38.051101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:38.051101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:38.051101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:38.051101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 533/1069] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:38.057227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14384a-a4f1-4273-9428-210a2fc7ece4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.170971 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14384a-a4f1-4273-9428-210a2fc7ece4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.204510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bee1e-ee14-4d40-8032-d1d49b585bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.205169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bee1e-ee14-4d40-8032-d1d49b585bbe None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.205451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bee1e-ee14-4d40-8032-d1d49b585bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.205727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bee1e-ee14-4d40-8032-d1d49b585bbe None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.206470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bee1e-ee14-4d40-8032-d1d49b585bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:38.206782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bee1e-ee14-4d40-8032-d1d49b585bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.208126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bee1e-ee14-4d40-8032-d1d49b585bbe None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.220012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 537/1070] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:38.225516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70662-4186-4834-9531-2981d76d9c12 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.239051 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:38.329313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70662-4186-4834-9531-2981d76d9c12 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.362634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237f114-a54f-4acd-9d40-5ad85c6d5831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.363413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237f114-a54f-4acd-9d40-5ad85c6d5831 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.363698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237f114-a54f-4acd-9d40-5ad85c6d5831 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.363976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237f114-a54f-4acd-9d40-5ad85c6d5831 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.371273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237f114-a54f-4acd-9d40-5ad85c6d5831 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.372837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237f114-a54f-4acd-9d40-5ad85c6d5831 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-2237f114-a54f-4acd-9d40-5ad85c6d5831 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:56:38.386598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:38.387741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:38.389201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:38.389201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:38.389201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:56:38.389201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:56:38.389201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:56:38.389201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:56:38.389201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:56:38.389201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:56:38.389201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:56:38.389201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:38.389201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 534/1071] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 23 16:56:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:38.393968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bee1e-ee14-4d40-8032-d1d49b585bbe None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.409469 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:38.494376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bee1e-ee14-4d40-8032-d1d49b585bbe None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.530581 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0939e51-3b8d-4f63-848b-1a67028f3d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.531256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0939e51-3b8d-4f63-848b-1a67028f3d39 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.531544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0939e51-3b8d-4f63-848b-1a67028f3d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.531819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0939e51-3b8d-4f63-848b-1a67028f3d39 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.532655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0939e51-3b8d-4f63-848b-1a67028f3d39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:38.532966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0939e51-3b8d-4f63-848b-1a67028f3d39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.534387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0939e51-3b8d-4f63-848b-1a67028f3d39 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.551386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 538/1072] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 23 16:56:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:38.556947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237f114-a54f-4acd-9d40-5ad85c6d5831 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.626967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:38.658838 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237f114-a54f-4acd-9d40-5ad85c6d5831 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.691198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1289e-df6e-4933-9a00-ab38824be75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.691990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1289e-df6e-4933-9a00-ab38824be75d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.692278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1289e-df6e-4933-9a00-ab38824be75d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.692555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1289e-df6e-4933-9a00-ab38824be75d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.704098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1289e-df6e-4933-9a00-ab38824be75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.705543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1289e-df6e-4933-9a00-ab38824be75d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-bfc1289e-df6e-4933-9a00-ab38824be75d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:38.724592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:38.725513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:38.726451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:38.726451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:38.726451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:38.726451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:38.730423 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 535/1073] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:38.731550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0939e51-3b8d-4f63-848b-1a67028f3d39 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.802236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:38.836060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0939e51-3b8d-4f63-848b-1a67028f3d39 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.869164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c20d1f-4149-449c-8a6d-a4461b45c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.869820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c20d1f-4149-449c-8a6d-a4461b45c734 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.870096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c20d1f-4149-449c-8a6d-a4461b45c734 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.870388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c20d1f-4149-449c-8a6d-a4461b45c734 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.871100 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c20d1f-4149-449c-8a6d-a4461b45c734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:38.871406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c20d1f-4149-449c-8a6d-a4461b45c734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.873324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c20d1f-4149-449c-8a6d-a4461b45c734 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.889652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 539/1074] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:38.891148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1289e-df6e-4933-9a00-ab38824be75d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.989480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1289e-df6e-4933-9a00-ab38824be75d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:39.011569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:39.023812 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff7cc5-5e27-494b-8fc9-ff99a2bdaaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:39.024635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff7cc5-5e27-494b-8fc9-ff99a2bdaaab None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:39.024921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff7cc5-5e27-494b-8fc9-ff99a2bdaaab None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:39.025197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff7cc5-5e27-494b-8fc9-ff99a2bdaaab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:39.032114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff7cc5-5e27-494b-8fc9-ff99a2bdaaab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:39.033543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff7cc5-5e27-494b-8fc9-ff99a2bdaaab None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6fff7cc5-5e27-494b-8fc9-ff99a2bdaaab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:56:39.047433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:39.048509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:39.049615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:56:39.049615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:56:39.049615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:56:39.049615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:56:39.049615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:56:39.049615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:56:39.049615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:39.049615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:39.050516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 536/1075] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:39.054496 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c20d1f-4149-449c-8a6d-a4461b45c734 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:39.152488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c20d1f-4149-449c-8a6d-a4461b45c734 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:39.181330 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:39.187852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae32aa-e8ad-43d6-ac38-05a12644f3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:39.188517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae32aa-e8ad-43d6-ac38-05a12644f3cf None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:39.188802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae32aa-e8ad-43d6-ac38-05a12644f3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:39.189079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae32aa-e8ad-43d6-ac38-05a12644f3cf None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:39.189869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae32aa-e8ad-43d6-ac38-05a12644f3cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:39.190179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae32aa-e8ad-43d6-ac38-05a12644f3cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:39.191644 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae32aa-e8ad-43d6-ac38-05a12644f3cf None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:39.204006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 540/1076] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:56:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:39.209914 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff7cc5-5e27-494b-8fc9-ff99a2bdaaab None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:39.308013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff7cc5-5e27-494b-8fc9-ff99a2bdaaab None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:39.341405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1570e0-2cb0-4be4-837e-cf30c0d28bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:39.342501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1570e0-2cb0-4be4-837e-cf30c0d28bb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:39.342786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1570e0-2cb0-4be4-837e-cf30c0d28bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:39.343062 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1570e0-2cb0-4be4-837e-cf30c0d28bb9 None admin] PATH_INFO: `/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/9884780c88aa48ffa92a696740761387/roles/17a702ca9868424f82b0bc9637326a8e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:39.345263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1570e0-2cb0-4be4-837e-cf30c0d28bb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=733d8651e4a74a2ab694091d9fd83e49, user_id=9884780c88aa48ffa92a696740761387, role_id=17a702ca9868424f82b0bc9637326a8e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:39.346728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1570e0-2cb0-4be4-837e-cf30c0d28bb9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:39.360171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 537/1077] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:56:39 2022] PUT /identity/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/9884780c88aa48ffa92a696740761387/roles/17a702ca9868424f82b0bc9637326a8e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:39.643838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c083-7fe0-43c4-9774-354b2a5f914e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:39.644133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c083-7fe0-43c4-9774-354b2a5f914e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:39.644417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c083-7fe0-43c4-9774-354b2a5f914e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:39.645807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 541/1078] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:39.651169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92d366-b5a0-42a8-beb6-f275c7762f9b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:39.651465 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92d366-b5a0-42a8-beb6-f275c7762f9b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:39.651746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92d366-b5a0-42a8-beb6-f275c7762f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:39.668487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-db92d366-b5a0-42a8-beb6-f275c7762f9b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:39.669724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-db92d366-b5a0-42a8-beb6-f275c7762f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:39.705243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:39.739758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 538/1079] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:39.762906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c083-7fe0-43c4-9774-354b2a5f914e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:39.864368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c083-7fe0-43c4-9774-354b2a5f914e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:39.897960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf8787-e630-481a-b5d5-835168fc6fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:39.898705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf8787-e630-481a-b5d5-835168fc6fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:39.898990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf8787-e630-481a-b5d5-835168fc6fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:39.899265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf8787-e630-481a-b5d5-835168fc6fe7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:39.909237 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf8787-e630-481a-b5d5-835168fc6fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-a2cf8787-e630-481a-b5d5-835168fc6fe7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:39.916786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:39.917877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:39.918851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 542/1080] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:56:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:39.924531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92d366-b5a0-42a8-beb6-f275c7762f9b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:40.021122 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92d366-b5a0-42a8-beb6-f275c7762f9b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:40.053947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fe186-d0a7-47d4-9977-98fcf4b52358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:40.054633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fe186-d0a7-47d4-9977-98fcf4b52358 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:40.054919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fe186-d0a7-47d4-9977-98fcf4b52358 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:40.055198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fe186-d0a7-47d4-9977-98fcf4b52358 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:40.055941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fe186-d0a7-47d4-9977-98fcf4b52358 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:40.056249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fe186-d0a7-47d4-9977-98fcf4b52358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:40.057606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fe186-d0a7-47d4-9977-98fcf4b52358 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:40.065637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 539/1081] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:56:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:40.071450 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf8787-e630-481a-b5d5-835168fc6fe7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:40.121337 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:40.171552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf8787-e630-481a-b5d5-835168fc6fe7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:40.205216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50ffc7-ae8d-4d23-b062-1c9b7d31156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:40.206084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50ffc7-ae8d-4d23-b062-1c9b7d31156a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:40.206393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50ffc7-ae8d-4d23-b062-1c9b7d31156a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:40.206677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50ffc7-ae8d-4d23-b062-1c9b7d31156a None admin] PATH_INFO: `/v3/users/1e6381a2454a4081a30e833a1af90afd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:40.207850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50ffc7-ae8d-4d23-b062-1c9b7d31156a None admin] RBAC: Authorizing `identity:get_user(user_id=1e6381a2454a4081a30e833a1af90afd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:40.209268 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50ffc7-ae8d-4d23-b062-1c9b7d31156a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:40.210924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 543/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:56:40 2022] GET /identity/v3/users/1e6381a2454a4081a30e833a1af90afd => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:40.217145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fe186-d0a7-47d4-9977-98fcf4b52358 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:40.251919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:40.316479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fe186-d0a7-47d4-9977-98fcf4b52358 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:40.349578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461281f-9f30-4b48-af6d-76b8841489a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:40.350457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461281f-9f30-4b48-af6d-76b8841489a6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:40.350746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461281f-9f30-4b48-af6d-76b8841489a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:40.351025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461281f-9f30-4b48-af6d-76b8841489a6 None admin] PATH_INFO: `/v3/projects/cc5978a1b0484f53becb8327eb426734` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:40.352198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461281f-9f30-4b48-af6d-76b8841489a6 None admin] RBAC: Authorizing `identity:get_project(project_id=cc5978a1b0484f53becb8327eb426734)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:40.353628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461281f-9f30-4b48-af6d-76b8841489a6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:40.355354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 540/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:56:40 2022] GET /identity/v3/projects/cc5978a1b0484f53becb8327eb426734 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:40.361337 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50ffc7-ae8d-4d23-b062-1c9b7d31156a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:40.458931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50ffc7-ae8d-4d23-b062-1c9b7d31156a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:40.477199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:40.493836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b8d8c-7889-4e56-94b0-ae9c63ef81a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:40.494759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b8d8c-7889-4e56-94b0-ae9c63ef81a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:40.495043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b8d8c-7889-4e56-94b0-ae9c63ef81a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:40.495316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b8d8c-7889-4e56-94b0-ae9c63ef81a4 None admin] PATH_INFO: `/v3/projects/cc5978a1b0484f53becb8327eb426734/users/1e6381a2454a4081a30e833a1af90afd/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:40.497243 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b8d8c-7889-4e56-94b0-ae9c63ef81a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc5978a1b0484f53becb8327eb426734, user_id=1e6381a2454a4081a30e833a1af90afd, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:40.499468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b8d8c-7889-4e56-94b0-ae9c63ef81a4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:40.512610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 544/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:56:40 2022] PUT /identity/v3/projects/cc5978a1b0484f53becb8327eb426734/users/1e6381a2454a4081a30e833a1af90afd/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:41.602324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142ba3d-b641-4fce-9f0e-f665373903ff None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:41.602909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142ba3d-b641-4fce-9f0e-f665373903ff None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:41.602909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142ba3d-b641-4fce-9f0e-f665373903ff None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:41.604293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 541/1085] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:41.609718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b964af7-851f-40cb-a466-24433814c928 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:41.610143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b964af7-851f-40cb-a466-24433814c928 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:41.610282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b964af7-851f-40cb-a466-24433814c928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:41.626802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6b964af7-851f-40cb-a466-24433814c928 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:41.627966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6b964af7-851f-40cb-a466-24433814c928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:41.693422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 545/1086] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:41.717817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142ba3d-b641-4fce-9f0e-f665373903ff None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:41.821502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142ba3d-b641-4fce-9f0e-f665373903ff None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:41.823101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:41.857221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2ed5d-fe44-455c-bccb-319f93ca4635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:41.857994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2ed5d-fe44-455c-bccb-319f93ca4635 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:41.858274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2ed5d-fe44-455c-bccb-319f93ca4635 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:41.858587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2ed5d-fe44-455c-bccb-319f93ca4635 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:41.868487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2ed5d-fe44-455c-bccb-319f93ca4635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-baa2ed5d-fe44-455c-bccb-319f93ca4635 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:41.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:41.878203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:41.879102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 542/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Mon May 23 16:56:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:41.884428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b964af7-851f-40cb-a466-24433814c928 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:41.984176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b964af7-851f-40cb-a466-24433814c928 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:41.993330 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:42.020395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e3771-e0af-426b-965c-3ceb9f0c7e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:42.021059 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e3771-e0af-426b-965c-3ceb9f0c7e27 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:42.021339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e3771-e0af-426b-965c-3ceb9f0c7e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:42.021610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e3771-e0af-426b-965c-3ceb9f0c7e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:42.022344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e3771-e0af-426b-965c-3ceb9f0c7e27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:42.022677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e3771-e0af-426b-965c-3ceb9f0c7e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:42.024017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e3771-e0af-426b-965c-3ceb9f0c7e27 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:42.032107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 546/1088] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 23 16:56:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:42.037745 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2ed5d-fe44-455c-bccb-319f93ca4635 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:42.135292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2ed5d-fe44-455c-bccb-319f93ca4635 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:42.167349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfd044-9e6f-41ff-8da0-061e468215a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:42.168130 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfd044-9e6f-41ff-8da0-061e468215a1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:42.168410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfd044-9e6f-41ff-8da0-061e468215a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:42.168679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfd044-9e6f-41ff-8da0-061e468215a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:42.179666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfd044-9e6f-41ff-8da0-061e468215a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:42.181089 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfd044-9e6f-41ff-8da0-061e468215a1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ffcfd044-9e6f-41ff-8da0-061e468215a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:42.197511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:42.198597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:42.199805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:42.199805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:42.199805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:42.199805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:42.199805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 543/1089] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:42.205096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e3771-e0af-426b-965c-3ceb9f0c7e27 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:42.304517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e3771-e0af-426b-965c-3ceb9f0c7e27 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:42.337451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1956a2-8201-4b64-bf3e-673a6cbdc960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:42.338107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1956a2-8201-4b64-bf3e-673a6cbdc960 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:42.338420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1956a2-8201-4b64-bf3e-673a6cbdc960 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:42.338703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1956a2-8201-4b64-bf3e-673a6cbdc960 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:42.339425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1956a2-8201-4b64-bf3e-673a6cbdc960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:42.339732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1956a2-8201-4b64-bf3e-673a6cbdc960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:42.341125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1956a2-8201-4b64-bf3e-673a6cbdc960 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:42.352715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 547/1090] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:42.358906 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfd044-9e6f-41ff-8da0-061e468215a1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:42.375584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:42.457607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfd044-9e6f-41ff-8da0-061e468215a1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:42.489831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c229a1f-5259-42c8-beb7-68169885665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:42.490645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c229a1f-5259-42c8-beb7-68169885665a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:42.490932 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c229a1f-5259-42c8-beb7-68169885665a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:42.491210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c229a1f-5259-42c8-beb7-68169885665a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:42.499023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c229a1f-5259-42c8-beb7-68169885665a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:42.500461 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c229a1f-5259-42c8-beb7-68169885665a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-0c229a1f-5259-42c8-beb7-68169885665a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:56:42.514410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:42.515534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:42.521253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:42.521253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:42.521253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:56:42.521253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:56:42.521253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:56:42.521253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:56:42.521253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:56:42.521253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:56:42.521253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:56:42.521253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:42.521253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 544/1091] 10.222.0.49 () {56 vars in 1093 bytes} [Mon May 23 16:56:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:56:42.521882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1956a2-8201-4b64-bf3e-673a6cbdc960 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:42.551947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:42.621453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1956a2-8201-4b64-bf3e-673a6cbdc960 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:42.658563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7fce-d771-44bd-b57a-813b12e75d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:42.659238 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7fce-d771-44bd-b57a-813b12e75d64 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:42.659522 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7fce-d771-44bd-b57a-813b12e75d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:42.659796 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7fce-d771-44bd-b57a-813b12e75d64 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:42.660633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7fce-d771-44bd-b57a-813b12e75d64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:42.660945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7fce-d771-44bd-b57a-813b12e75d64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:42.662355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7fce-d771-44bd-b57a-813b12e75d64 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:42.679515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 548/1092] 10.222.0.49 () {56 vars in 1133 bytes} [Mon May 23 16:56:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:42.685648 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c229a1f-5259-42c8-beb7-68169885665a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:42.762454 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:42.790810 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c229a1f-5259-42c8-beb7-68169885665a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:42.815124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4e0a-7962-4f71-921e-279014fd6671 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:42.815413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4e0a-7962-4f71-921e-279014fd6671 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:42.815693 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4e0a-7962-4f71-921e-279014fd6671 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:42.817056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 549/1093] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:42.821800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca760a0-1375-4f2c-9b62-390310508d92 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:42.822086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca760a0-1375-4f2c-9b62-390310508d92 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:42.822379 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca760a0-1375-4f2c-9b62-390310508d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:42.823992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75da6c-598f-4da2-8c0e-51d55d177774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:42.824903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75da6c-598f-4da2-8c0e-51d55d177774 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:42.825187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75da6c-598f-4da2-8c0e-51d55d177774 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:42.826035 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75da6c-598f-4da2-8c0e-51d55d177774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:42.839780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-fca760a0-1375-4f2c-9b62-390310508d92 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:42.840996 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fca760a0-1375-4f2c-9b62-390310508d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:42.897062 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75da6c-598f-4da2-8c0e-51d55d177774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:42.898654 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75da6c-598f-4da2-8c0e-51d55d177774 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:42.907870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 550/1094] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:56:42.933910 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca760a0-1375-4f2c-9b62-390310508d92 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:42.952685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:42.974254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:43.001283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 545/1095] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:56:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 16:56:43.007197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75da6c-598f-4da2-8c0e-51d55d177774 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:43.033172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca760a0-1375-4f2c-9b62-390310508d92 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:43.068835 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be880ba-3719-40a9-898a-4648a0cb480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:43.069629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be880ba-3719-40a9-898a-4648a0cb480d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:43.069914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be880ba-3719-40a9-898a-4648a0cb480d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:43.070187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be880ba-3719-40a9-898a-4648a0cb480d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:43.080455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be880ba-3719-40a9-898a-4648a0cb480d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-0be880ba-3719-40a9-898a-4648a0cb480d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:56:43.088005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:43.089078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:56:43.089977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 551/1096] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:56:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:43.095386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be880ba-3719-40a9-898a-4648a0cb480d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:43.106337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75da6c-598f-4da2-8c0e-51d55d177774 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:43.141411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02b19d-4f81-4526-8d3a-7d91249c37b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:43.142196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02b19d-4f81-4526-8d3a-7d91249c37b9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:43.142520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02b19d-4f81-4526-8d3a-7d91249c37b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:43.142802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02b19d-4f81-4526-8d3a-7d91249c37b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:43.152923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02b19d-4f81-4526-8d3a-7d91249c37b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:43.154931 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02b19d-4f81-4526-8d3a-7d91249c37b9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-fc02b19d-4f81-4526-8d3a-7d91249c37b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:56:43.172205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:43.173108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:43.174040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:56:43.174040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:56:43.174040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:56:43.174040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:43.174040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 546/1097] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:43.176157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:43.178967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02b19d-4f81-4526-8d3a-7d91249c37b9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:43.197981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be880ba-3719-40a9-898a-4648a0cb480d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:43.210129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:43.237825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb6792-8e84-42ed-91df-a6b98c173805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:43.238537 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb6792-8e84-42ed-91df-a6b98c173805 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:43.238833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb6792-8e84-42ed-91df-a6b98c173805 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:43.239322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb6792-8e84-42ed-91df-a6b98c173805 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:43.240623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb6792-8e84-42ed-91df-a6b98c173805 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:43.241132 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb6792-8e84-42ed-91df-a6b98c173805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:43.243367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb6792-8e84-42ed-91df-a6b98c173805 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:43.255456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 552/1098] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:56:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:43.261158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb6792-8e84-42ed-91df-a6b98c173805 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:43.293854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02b19d-4f81-4526-8d3a-7d91249c37b9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:43.328843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba250e60-c64b-4e7c-ae93-076bffa053ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:43.329503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba250e60-c64b-4e7c-ae93-076bffa053ef None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:43.329790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba250e60-c64b-4e7c-ae93-076bffa053ef None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:43.330070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba250e60-c64b-4e7c-ae93-076bffa053ef None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:43.330835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba250e60-c64b-4e7c-ae93-076bffa053ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:43.331142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba250e60-c64b-4e7c-ae93-076bffa053ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:43.332499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba250e60-c64b-4e7c-ae93-076bffa053ef None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:43.348039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 547/1099] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:43.348991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba250e60-c64b-4e7c-ae93-076bffa053ef None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:43.362767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb6792-8e84-42ed-91df-a6b98c173805 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:43.395965 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1aab4-7ae8-494d-8d00-880169eebb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:43.396829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1aab4-7ae8-494d-8d00-880169eebb6a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:43.397115 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1aab4-7ae8-494d-8d00-880169eebb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:43.397390 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1aab4-7ae8-494d-8d00-880169eebb6a None admin] PATH_INFO: `/v3/users/1e6381a2454a4081a30e833a1af90afd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:43.398598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1aab4-7ae8-494d-8d00-880169eebb6a None admin] RBAC: Authorizing `identity:get_user(user_id=1e6381a2454a4081a30e833a1af90afd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:43.400028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1aab4-7ae8-494d-8d00-880169eebb6a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:43.401655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 553/1100] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:56:43 2022] GET /identity/v3/users/1e6381a2454a4081a30e833a1af90afd => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:43.407838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1aab4-7ae8-494d-8d00-880169eebb6a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:43.418188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:43.432935 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:43.447994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba250e60-c64b-4e7c-ae93-076bffa053ef None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:43.480774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6378092-e0b9-4c36-976b-305bd97fa160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:43.481583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6378092-e0b9-4c36-976b-305bd97fa160 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:43.482424 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6378092-e0b9-4c36-976b-305bd97fa160 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:43.482707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6378092-e0b9-4c36-976b-305bd97fa160 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:43.489275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6378092-e0b9-4c36-976b-305bd97fa160 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:43.490733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6378092-e0b9-4c36-976b-305bd97fa160 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-f6378092-e0b9-4c36-976b-305bd97fa160 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:56:43.504768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:56:43.505705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:56:43.506709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:56:43.506709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:56:43.506709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:56:43.506709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:56:43.506709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:56:43.506709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:56:43.506709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:56:43.506709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:56:43.506709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 548/1101] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:56:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:56:43.510457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1aab4-7ae8-494d-8d00-880169eebb6a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:43.511691 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6378092-e0b9-4c36-976b-305bd97fa160 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:43.546044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f1a07-ead1-4159-9216-93a4b9a2feff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:43.546626 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f1a07-ead1-4159-9216-93a4b9a2feff None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:43.546917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f1a07-ead1-4159-9216-93a4b9a2feff None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:43.547199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f1a07-ead1-4159-9216-93a4b9a2feff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:43.620790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6378092-e0b9-4c36-976b-305bd97fa160 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:43.623421 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f1a07-ead1-4159-9216-93a4b9a2feff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:43.624915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f1a07-ead1-4159-9216-93a4b9a2feff None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:43.634282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:43.656225 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd7c4c-be04-4aee-b09e-346199535270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:43.656878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd7c4c-be04-4aee-b09e-346199535270 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:43.657163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd7c4c-be04-4aee-b09e-346199535270 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:43.657440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd7c4c-be04-4aee-b09e-346199535270 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:43.658222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd7c4c-be04-4aee-b09e-346199535270 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:43.658555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd7c4c-be04-4aee-b09e-346199535270 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:43.659976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd7c4c-be04-4aee-b09e-346199535270 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:43.671779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 549/1102] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:56:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:43.677867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd7c4c-be04-4aee-b09e-346199535270 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:43.687283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:43.722775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 554/1103] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:56:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 16:56:43.728507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f1a07-ead1-4159-9216-93a4b9a2feff None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:43.781118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd7c4c-be04-4aee-b09e-346199535270 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:43.816639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf53b59-bdd5-4143-a517-1b838bf57f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:43.817221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf53b59-bdd5-4143-a517-1b838bf57f74 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:43.817511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf53b59-bdd5-4143-a517-1b838bf57f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:43.817791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf53b59-bdd5-4143-a517-1b838bf57f74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:43.818661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf53b59-bdd5-4143-a517-1b838bf57f74 None admin] RBAC: Adding query filter params (role.id=17a702ca9868424f82b0bc9637326a8e, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=9884780c88aa48ffa92a696740761387) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:43.818977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf53b59-bdd5-4143-a517-1b838bf57f74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:43.820402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf53b59-bdd5-4143-a517-1b838bf57f74 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:43.827121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 550/1104] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:56:43 2022] GET /identity/v3/role_assignments?user.id=9884780c88aa48ffa92a696740761387&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=17a702ca9868424f82b0bc9637326a8e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:43.831994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f1a07-ead1-4159-9216-93a4b9a2feff None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:43.843395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:43.872004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc2409-ab1e-4ccd-bfa8-a9ddfb24bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:43.873954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2409-ab1e-4ccd-bfa8-a9ddfb24bf7e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:43.874240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2409-ab1e-4ccd-bfa8-a9ddfb24bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:43.874567 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2409-ab1e-4ccd-bfa8-a9ddfb24bf7e None admin] PATH_INFO: `/v3/projects/cc5978a1b0484f53becb8327eb426734` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:43.875867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc2409-ab1e-4ccd-bfa8-a9ddfb24bf7e None admin] RBAC: Authorizing `identity:get_project(project_id=cc5978a1b0484f53becb8327eb426734)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:43.877314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc2409-ab1e-4ccd-bfa8-a9ddfb24bf7e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:43.879093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 555/1105] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:56:43 2022] GET /identity/v3/projects/cc5978a1b0484f53becb8327eb426734 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:43.885342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf53b59-bdd5-4143-a517-1b838bf57f74 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:43.963815 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:43.998647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf53b59-bdd5-4143-a517-1b838bf57f74 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:44.035623 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aef8c6-4041-4252-8ec1-c0cc54e7d65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:44.036273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aef8c6-4041-4252-8ec1-c0cc54e7d65b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:44.036555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aef8c6-4041-4252-8ec1-c0cc54e7d65b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:44.036827 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aef8c6-4041-4252-8ec1-c0cc54e7d65b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:44.037686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aef8c6-4041-4252-8ec1-c0cc54e7d65b None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=cc5978a1b0484f53becb8327eb426734, user.id=1e6381a2454a4081a30e833a1af90afd) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:44.037995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aef8c6-4041-4252-8ec1-c0cc54e7d65b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:44.039436 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aef8c6-4041-4252-8ec1-c0cc54e7d65b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:44.046849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 551/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:56:43 2022] GET /identity/v3/role_assignments?user.id=1e6381a2454a4081a30e833a1af90afd&scope.project.id=cc5978a1b0484f53becb8327eb426734&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:46.279376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b24a-c768-415a-a0b7-482f1922a59e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:46.279938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b24a-c768-415a-a0b7-482f1922a59e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:46.279938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b24a-c768-415a-a0b7-482f1922a59e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:46.281322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 556/1107] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:46.286632 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaae465-6f7b-4c01-83ae-f5753ba529ae None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:46.287046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaae465-6f7b-4c01-83ae-f5753ba529ae None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:46.287202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaae465-6f7b-4c01-83ae-f5753ba529ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:46.304144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4aaae465-6f7b-4c01-83ae-f5753ba529ae None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:46.305318 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4aaae465-6f7b-4c01-83ae-f5753ba529ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:46.369759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 552/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:46.394666 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008b24a-c768-415a-a0b7-482f1922a59e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:46.493061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008b24a-c768-415a-a0b7-482f1922a59e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:46.525928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2bb1d-fad4-4bd3-8c14-78d6ef399687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:46.526751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2bb1d-fad4-4bd3-8c14-78d6ef399687 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:46.527036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2bb1d-fad4-4bd3-8c14-78d6ef399687 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:46.527312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2bb1d-fad4-4bd3-8c14-78d6ef399687 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:46.529079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2bb1d-fad4-4bd3-8c14-78d6ef399687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:46.530823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2bb1d-fad4-4bd3-8c14-78d6ef399687 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:46.532386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 557/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:46.537912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaae465-6f7b-4c01-83ae-f5753ba529ae None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:46.597664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:46.634388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaae465-6f7b-4c01-83ae-f5753ba529ae None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:46.666259 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dfc79-98b9-46ac-856f-9a640c61b493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:46.666936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dfc79-98b9-46ac-856f-9a640c61b493 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:46.667222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dfc79-98b9-46ac-856f-9a640c61b493 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:46.667499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dfc79-98b9-46ac-856f-9a640c61b493 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:46.668204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dfc79-98b9-46ac-856f-9a640c61b493 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:46.670229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dfc79-98b9-46ac-856f-9a640c61b493 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:46.689300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 553/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:56:46 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:48.913460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea944565-d4b1-4a0c-b385-cf917cefe4cc None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:48.913997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea944565-d4b1-4a0c-b385-cf917cefe4cc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:48.913997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea944565-d4b1-4a0c-b385-cf917cefe4cc None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:48.915422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 558/1111] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:48.921269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015af9a-9177-4844-ad3e-40a9221cade8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:48.921699 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015af9a-9177-4844-ad3e-40a9221cade8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:48.921825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015af9a-9177-4844-ad3e-40a9221cade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:48.938901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a015af9a-9177-4844-ad3e-40a9221cade8 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:48.940080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a015af9a-9177-4844-ad3e-40a9221cade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:49.007544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 554/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:49.031355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea944565-d4b1-4a0c-b385-cf917cefe4cc None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:49.077522 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:49.131478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea944565-d4b1-4a0c-b385-cf917cefe4cc None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:49.164300 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd7da4-d60e-4482-9561-05daa9f33fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:49.165140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd7da4-d60e-4482-9561-05daa9f33fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:49.165421 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd7da4-d60e-4482-9561-05daa9f33fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:49.165694 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd7da4-d60e-4482-9561-05daa9f33fe3 None admin] PATH_INFO: `/v3/roles/c4b17c7a2a644e91a1872f5fa53e6421` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:49.167156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd7da4-d60e-4482-9561-05daa9f33fe3 None admin] RBAC: Authorizing `identity:get_role(role_id=c4b17c7a2a644e91a1872f5fa53e6421)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:49.168497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd7da4-d60e-4482-9561-05daa9f33fe3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:49.170392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 559/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:56:49 2022] GET /identity/v3/roles/c4b17c7a2a644e91a1872f5fa53e6421 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:49.176146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015af9a-9177-4844-ad3e-40a9221cade8 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:49.225770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:49.273875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015af9a-9177-4844-ad3e-40a9221cade8 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:49.307643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830faae-345d-4b36-b362-fbc488d08dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:49.308497 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830faae-345d-4b36-b362-fbc488d08dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:49.308777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830faae-345d-4b36-b362-fbc488d08dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:49.309050 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830faae-345d-4b36-b362-fbc488d08dd3 None admin] PATH_INFO: `/v3/users/8d3a56250dfd451a971e536823984d07` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:49.321585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830faae-345d-4b36-b362-fbc488d08dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=8d3a56250dfd451a971e536823984d07)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:49.323046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830faae-345d-4b36-b362-fbc488d08dd3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:49.324902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 555/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:56:49 2022] GET /identity/v3/users/8d3a56250dfd451a971e536823984d07 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:49.330759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd7da4-d60e-4482-9561-05daa9f33fe3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:49.426710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd7da4-d60e-4482-9561-05daa9f33fe3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:49.439190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:49.459821 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3e654-507e-4464-8f1a-b65937699477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:49.460454 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3e654-507e-4464-8f1a-b65937699477 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:49.460735 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3e654-507e-4464-8f1a-b65937699477 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:49.461007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3e654-507e-4464-8f1a-b65937699477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:49.526145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3e654-507e-4464-8f1a-b65937699477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:49.527602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3e654-507e-4464-8f1a-b65937699477 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:49.621353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 560/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:56:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:56:49.627325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830faae-345d-4b36-b362-fbc488d08dd3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:49.725306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830faae-345d-4b36-b362-fbc488d08dd3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:49.734724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:49.759074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f649b-5a75-4ee8-a810-044e4ebc3178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:49.759920 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f649b-5a75-4ee8-a810-044e4ebc3178 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:49.760214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f649b-5a75-4ee8-a810-044e4ebc3178 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:49.760493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f649b-5a75-4ee8-a810-044e4ebc3178 None admin] PATH_INFO: `/v3/projects/cc5978a1b0484f53becb8327eb426734` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:49.761660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f649b-5a75-4ee8-a810-044e4ebc3178 None admin] RBAC: Authorizing `identity:get_project(project_id=cc5978a1b0484f53becb8327eb426734)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:49.763759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f649b-5a75-4ee8-a810-044e4ebc3178 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:49.765435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 556/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:56:49 2022] GET /identity/v3/projects/cc5978a1b0484f53becb8327eb426734 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:49.771569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3e654-507e-4464-8f1a-b65937699477 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:49.786278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:49.869030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3e654-507e-4464-8f1a-b65937699477 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:49.902163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94896a8a-fd59-46f9-a897-379ea872be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:49.902776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94896a8a-fd59-46f9-a897-379ea872be08 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:49.903064 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94896a8a-fd59-46f9-a897-379ea872be08 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:49.903916 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94896a8a-fd59-46f9-a897-379ea872be08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:49.904743 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94896a8a-fd59-46f9-a897-379ea872be08 None admin] RBAC: Adding query filter params (role.id=c4b17c7a2a644e91a1872f5fa53e6421, scope.project.id=cc5978a1b0484f53becb8327eb426734, user.id=8d3a56250dfd451a971e536823984d07) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:49.905058 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94896a8a-fd59-46f9-a897-379ea872be08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:49.906636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94896a8a-fd59-46f9-a897-379ea872be08 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:49.911912 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 561/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:56:49 2022] GET /identity/v3/role_assignments?user.id=8d3a56250dfd451a971e536823984d07&scope.project.id=cc5978a1b0484f53becb8327eb426734&role.id=c4b17c7a2a644e91a1872f5fa53e6421 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:52.086167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7faf-f35f-4619-8c64-dfa398eaf8b8 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:52.086695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7faf-f35f-4619-8c64-dfa398eaf8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:52.086695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7faf-f35f-4619-8c64-dfa398eaf8b8 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:52.088015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 557/1118] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:52.093279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb9ed1-1b9d-43ac-956d-fe9a08ba80ed None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:52.093678 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb9ed1-1b9d-43ac-956d-fe9a08ba80ed None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:52.093850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb9ed1-1b9d-43ac-956d-fe9a08ba80ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:52.111087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9cdb9ed1-1b9d-43ac-956d-fe9a08ba80ed None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:52.112284 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9cdb9ed1-1b9d-43ac-956d-fe9a08ba80ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:52.177963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 562/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:52.201675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7faf-f35f-4619-8c64-dfa398eaf8b8 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:52.300788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7faf-f35f-4619-8c64-dfa398eaf8b8 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:52.333756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e16fe-661a-41ac-8da6-e029083facc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:52.334619 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e16fe-661a-41ac-8da6-e029083facc2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:52.334903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e16fe-661a-41ac-8da6-e029083facc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:52.335177 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e16fe-661a-41ac-8da6-e029083facc2 None admin] PATH_INFO: `/v3/roles/c4b17c7a2a644e91a1872f5fa53e6421` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:52.336675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e16fe-661a-41ac-8da6-e029083facc2 None admin] RBAC: Authorizing `identity:get_role(role_id=c4b17c7a2a644e91a1872f5fa53e6421)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:52.337971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e16fe-661a-41ac-8da6-e029083facc2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:52.339324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 558/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:56:52 2022] GET /identity/v3/roles/c4b17c7a2a644e91a1872f5fa53e6421 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:52.345706 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb9ed1-1b9d-43ac-956d-fe9a08ba80ed None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:52.353738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:52.441372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb9ed1-1b9d-43ac-956d-fe9a08ba80ed None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:52.474871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4db53-1746-452a-9d98-d77642e67031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:52.475739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4db53-1746-452a-9d98-d77642e67031 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:52.476027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4db53-1746-452a-9d98-d77642e67031 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:52.476306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4db53-1746-452a-9d98-d77642e67031 None admin] PATH_INFO: `/v3/users/8d3a56250dfd451a971e536823984d07` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:52.477515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4db53-1746-452a-9d98-d77642e67031 None admin] RBAC: Authorizing `identity:get_user(user_id=8d3a56250dfd451a971e536823984d07)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:52.478975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4db53-1746-452a-9d98-d77642e67031 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:52.480599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 563/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:56:52 2022] GET /identity/v3/users/8d3a56250dfd451a971e536823984d07 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:52.486786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e16fe-661a-41ac-8da6-e029083facc2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:52.531545 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:52.584850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e16fe-661a-41ac-8da6-e029083facc2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:52.617756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adbbac-cda6-457d-bee9-f832743e6e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:52.618617 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adbbac-cda6-457d-bee9-f832743e6e01 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:52.618901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adbbac-cda6-457d-bee9-f832743e6e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:52.619176 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adbbac-cda6-457d-bee9-f832743e6e01 None admin] PATH_INFO: `/v3/projects/cc5978a1b0484f53becb8327eb426734` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:52.620328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adbbac-cda6-457d-bee9-f832743e6e01 None admin] RBAC: Authorizing `identity:get_project(project_id=cc5978a1b0484f53becb8327eb426734)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:52.621739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adbbac-cda6-457d-bee9-f832743e6e01 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:52.624037 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 559/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:56:52 2022] GET /identity/v3/projects/cc5978a1b0484f53becb8327eb426734 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:52.629792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4db53-1746-452a-9d98-d77642e67031 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:52.702247 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:52.726194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4db53-1746-452a-9d98-d77642e67031 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:52.758975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82230d9-0c4b-4aca-a5aa-2de7f86ee526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:52.759857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82230d9-0c4b-4aca-a5aa-2de7f86ee526 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:52.760143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82230d9-0c4b-4aca-a5aa-2de7f86ee526 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:52.760417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82230d9-0c4b-4aca-a5aa-2de7f86ee526 None admin] PATH_INFO: `/v3/projects/cc5978a1b0484f53becb8327eb426734/users/8d3a56250dfd451a971e536823984d07/roles/c4b17c7a2a644e91a1872f5fa53e6421` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:52.762846 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82230d9-0c4b-4aca-a5aa-2de7f86ee526 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc5978a1b0484f53becb8327eb426734, user_id=8d3a56250dfd451a971e536823984d07, role_id=c4b17c7a2a644e91a1872f5fa53e6421)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:52.764262 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82230d9-0c4b-4aca-a5aa-2de7f86ee526 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:52.778169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 564/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:56:52 2022] PUT /identity/v3/projects/cc5978a1b0484f53becb8327eb426734/users/8d3a56250dfd451a971e536823984d07/roles/c4b17c7a2a644e91a1872f5fa53e6421 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:54.939723 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e040d7-d6fd-4b67-b827-92ac6a960fda None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:54.940506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e040d7-d6fd-4b67-b827-92ac6a960fda None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:54.940506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e040d7-d6fd-4b67-b827-92ac6a960fda None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:54.941686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 560/1124] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:54.946934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024bf4-0a92-4aff-80b0-94268e51d350 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:54.947328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024bf4-0a92-4aff-80b0-94268e51d350 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:54.947503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024bf4-0a92-4aff-80b0-94268e51d350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:54.964796 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c7024bf4-0a92-4aff-80b0-94268e51d350 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:54.966642 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c7024bf4-0a92-4aff-80b0-94268e51d350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:55.030813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 565/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:55.053776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e040d7-d6fd-4b67-b827-92ac6a960fda None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:55.152675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e040d7-d6fd-4b67-b827-92ac6a960fda None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:55.165838 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:55.187065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d3541-5a77-4575-a4d6-e74a2400d820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:55.187913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d3541-5a77-4575-a4d6-e74a2400d820 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:55.188207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d3541-5a77-4575-a4d6-e74a2400d820 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:55.188485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d3541-5a77-4575-a4d6-e74a2400d820 None admin] PATH_INFO: `/v3/roles/c4b17c7a2a644e91a1872f5fa53e6421` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:55.189958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d3541-5a77-4575-a4d6-e74a2400d820 None admin] RBAC: Authorizing `identity:get_role(role_id=c4b17c7a2a644e91a1872f5fa53e6421)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:55.191363 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d3541-5a77-4575-a4d6-e74a2400d820 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:55.192723 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 561/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:56:55 2022] GET /identity/v3/roles/c4b17c7a2a644e91a1872f5fa53e6421 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:55.198517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7024bf4-0a92-4aff-80b0-94268e51d350 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:55.260125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:55.297629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7024bf4-0a92-4aff-80b0-94268e51d350 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:55.331138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc140388-55eb-41c2-9001-c3fc2564390a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:55.331943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc140388-55eb-41c2-9001-c3fc2564390a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:55.332224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc140388-55eb-41c2-9001-c3fc2564390a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:55.332497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc140388-55eb-41c2-9001-c3fc2564390a None admin] PATH_INFO: `/v3/users/8d3a56250dfd451a971e536823984d07` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:55.333668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc140388-55eb-41c2-9001-c3fc2564390a None admin] RBAC: Authorizing `identity:get_user(user_id=8d3a56250dfd451a971e536823984d07)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:55.335104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc140388-55eb-41c2-9001-c3fc2564390a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:55.336721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 566/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:56:55 2022] GET /identity/v3/users/8d3a56250dfd451a971e536823984d07 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:55.342644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d3541-5a77-4575-a4d6-e74a2400d820 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:55.441056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d3541-5a77-4575-a4d6-e74a2400d820 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:55.475119 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00871d2-c047-4d9d-a37f-f8a019a87f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:55.475749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00871d2-c047-4d9d-a37f-f8a019a87f6d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:55.476033 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00871d2-c047-4d9d-a37f-f8a019a87f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:55.476306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00871d2-c047-4d9d-a37f-f8a019a87f6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:55.523080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:55.542307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00871d2-c047-4d9d-a37f-f8a019a87f6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:55.543871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00871d2-c047-4d9d-a37f-f8a019a87f6d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:55.637968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 562/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:56:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:56:55.643790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc140388-55eb-41c2-9001-c3fc2564390a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:55.739839 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc140388-55eb-41c2-9001-c3fc2564390a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:55.768049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:55.773834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d217be-a7e3-4231-bc50-157a1da32a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:55.774735 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d217be-a7e3-4231-bc50-157a1da32a34 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:55.775025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d217be-a7e3-4231-bc50-157a1da32a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:55.775307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d217be-a7e3-4231-bc50-157a1da32a34 None admin] PATH_INFO: `/v3/projects/cc5978a1b0484f53becb8327eb426734` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:55.776480 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d217be-a7e3-4231-bc50-157a1da32a34 None admin] RBAC: Authorizing `identity:get_project(project_id=cc5978a1b0484f53becb8327eb426734)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:55.777905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d217be-a7e3-4231-bc50-157a1da32a34 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:55.779670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 567/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:56:55 2022] GET /identity/v3/projects/cc5978a1b0484f53becb8327eb426734 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:55.785676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00871d2-c047-4d9d-a37f-f8a019a87f6d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:55.864736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:55.884082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00871d2-c047-4d9d-a37f-f8a019a87f6d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:55.916543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cb928-dbed-40cd-a712-c12552af5612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:55.917134 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb928-dbed-40cd-a712-c12552af5612 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:55.917422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb928-dbed-40cd-a712-c12552af5612 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:55.917701 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb928-dbed-40cd-a712-c12552af5612 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:55.918568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb928-dbed-40cd-a712-c12552af5612 None admin] RBAC: Adding query filter params (role.id=c4b17c7a2a644e91a1872f5fa53e6421, scope.project.id=cc5978a1b0484f53becb8327eb426734, user.id=8d3a56250dfd451a971e536823984d07) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:55.919425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb928-dbed-40cd-a712-c12552af5612 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:55.920847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb928-dbed-40cd-a712-c12552af5612 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:55.926616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 563/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:56:55 2022] GET /identity/v3/role_assignments?user.id=8d3a56250dfd451a971e536823984d07&scope.project.id=cc5978a1b0484f53becb8327eb426734&role.id=c4b17c7a2a644e91a1872f5fa53e6421 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:58.177026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8c6df-3ba9-4fa6-9f24-1488f595e2d6 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:58.177579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8c6df-3ba9-4fa6-9f24-1488f595e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:58.177579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8c6df-3ba9-4fa6-9f24-1488f595e2d6 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:58.178995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 568/1131] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:56:58.184805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dcd23-04d4-4125-bef0-8e291726203a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:58.185327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dcd23-04d4-4125-bef0-8e291726203a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:58.185633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dcd23-04d4-4125-bef0-8e291726203a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:58.202155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-031dcd23-04d4-4125-bef0-8e291726203a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:58.203358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-031dcd23-04d4-4125-bef0-8e291726203a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:58.267778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 564/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:56:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:56:58.292590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8c6df-3ba9-4fa6-9f24-1488f595e2d6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:58.390678 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8c6df-3ba9-4fa6-9f24-1488f595e2d6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:58.423411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16383483-37a4-4cff-88ec-7c360239ded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:58.424182 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16383483-37a4-4cff-88ec-7c360239ded3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:58.424461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16383483-37a4-4cff-88ec-7c360239ded3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:58.424731 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16383483-37a4-4cff-88ec-7c360239ded3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:58.425870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16383483-37a4-4cff-88ec-7c360239ded3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:58.427356 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16383483-37a4-4cff-88ec-7c360239ded3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:58.428881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 569/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:56:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:58.435038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dcd23-04d4-4125-bef0-8e291726203a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:58.507775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:58.532321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dcd23-04d4-4125-bef0-8e291726203a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:58.565003 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d3f65-0beb-4d0f-b366-bc19d083807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:58.565652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d3f65-0beb-4d0f-b366-bc19d083807b None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:58.566109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d3f65-0beb-4d0f-b366-bc19d083807b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:58.566407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d3f65-0beb-4d0f-b366-bc19d083807b None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:58.567126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d3f65-0beb-4d0f-b366-bc19d083807b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:58.568726 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d3f65-0beb-4d0f-b366-bc19d083807b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:58.599724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 565/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:56:58 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:00.814087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c5c04-c13c-47fc-8030-d7fb26e4ee2f None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:00.814583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c5c04-c13c-47fc-8030-d7fb26e4ee2f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:00.814699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c5c04-c13c-47fc-8030-d7fb26e4ee2f None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:00.816086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 570/1135] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:57:00.821215 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22735e-5b72-453e-a8b6-fcd668eeaa06 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:00.821603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22735e-5b72-453e-a8b6-fcd668eeaa06 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:00.821791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22735e-5b72-453e-a8b6-fcd668eeaa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:00.839354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4f22735e-5b72-453e-a8b6-fcd668eeaa06 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:00.841258 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4f22735e-5b72-453e-a8b6-fcd668eeaa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:00.905693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 566/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:57:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:57:00.929867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c5c04-c13c-47fc-8030-d7fb26e4ee2f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:00.996229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:01.030463 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c5c04-c13c-47fc-8030-d7fb26e4ee2f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:01.064025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75f583-9dbc-4a9f-bd13-bbb0fa09278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:01.064786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f583-9dbc-4a9f-bd13-bbb0fa09278d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:01.065078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f583-9dbc-4a9f-bd13-bbb0fa09278d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:01.065359 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f583-9dbc-4a9f-bd13-bbb0fa09278d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:01.066558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75f583-9dbc-4a9f-bd13-bbb0fa09278d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:01.067986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75f583-9dbc-4a9f-bd13-bbb0fa09278d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:01.069602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 571/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:57:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:01.076182 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22735e-5b72-453e-a8b6-fcd668eeaa06 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:01.129792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:01.172876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22735e-5b72-453e-a8b6-fcd668eeaa06 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:01.205440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc74f86-f88b-4762-9465-a06d955f7296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:01.206092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc74f86-f88b-4762-9465-a06d955f7296 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:01.206394 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc74f86-f88b-4762-9465-a06d955f7296 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:01.206670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc74f86-f88b-4762-9465-a06d955f7296 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:01.207383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc74f86-f88b-4762-9465-a06d955f7296 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:01.208799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc74f86-f88b-4762-9465-a06d955f7296 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:01.227497 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 567/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:57:01 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:03.434416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90b12a-67d3-4b0e-86ef-2d38f30dbd68 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:03.435052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90b12a-67d3-4b0e-86ef-2d38f30dbd68 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:03.435148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90b12a-67d3-4b0e-86ef-2d38f30dbd68 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:03.436488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 572/1139] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:57:03.441720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabd9f7-9330-4fcc-b559-ac1b7bbf6fe6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:03.442141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabd9f7-9330-4fcc-b559-ac1b7bbf6fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:03.442280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabd9f7-9330-4fcc-b559-ac1b7bbf6fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:03.459419 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6cabd9f7-9330-4fcc-b559-ac1b7bbf6fe6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:03.460582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6cabd9f7-9330-4fcc-b559-ac1b7bbf6fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:03.525397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 568/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:57:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:57:03.549020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90b12a-67d3-4b0e-86ef-2d38f30dbd68 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:03.647650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90b12a-67d3-4b0e-86ef-2d38f30dbd68 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:03.679677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12896ef-b6a8-47d2-9792-832fdc23a829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:03.680448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12896ef-b6a8-47d2-9792-832fdc23a829 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:03.680730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12896ef-b6a8-47d2-9792-832fdc23a829 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:03.681005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12896ef-b6a8-47d2-9792-832fdc23a829 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:03.683622 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:03.692500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12896ef-b6a8-47d2-9792-832fdc23a829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e12896ef-b6a8-47d2-9792-832fdc23a829 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:57:03.700986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:57:03.702074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:57:03.703049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 573/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:57:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:57:03.708092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabd9f7-9330-4fcc-b559-ac1b7bbf6fe6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:03.749230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:03.804141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabd9f7-9330-4fcc-b559-ac1b7bbf6fe6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:03.837746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6ceb4-c5de-45fc-9767-4329a67751aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:03.838426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6ceb4-c5de-45fc-9767-4329a67751aa None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:03.838714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6ceb4-c5de-45fc-9767-4329a67751aa None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:03.838990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6ceb4-c5de-45fc-9767-4329a67751aa None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:03.839736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6ceb4-c5de-45fc-9767-4329a67751aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:03.840045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6ceb4-c5de-45fc-9767-4329a67751aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:03.841425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6ceb4-c5de-45fc-9767-4329a67751aa None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:03.849158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 569/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:57:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:03.854890 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12896ef-b6a8-47d2-9792-832fdc23a829 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:03.955462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12896ef-b6a8-47d2-9792-832fdc23a829 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:03.988090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d7c3f-4d94-4530-b5e9-7ddef61e6285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:03.988962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d7c3f-4d94-4530-b5e9-7ddef61e6285 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:03.989249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d7c3f-4d94-4530-b5e9-7ddef61e6285 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:03.989527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d7c3f-4d94-4530-b5e9-7ddef61e6285 None admin] PATH_INFO: `/v3/users/365486dbf0b347b78016e40af50b3177` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:04.002120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d7c3f-4d94-4530-b5e9-7ddef61e6285 None admin] RBAC: Authorizing `identity:get_user(user_id=365486dbf0b347b78016e40af50b3177)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:04.003589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d7c3f-4d94-4530-b5e9-7ddef61e6285 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:04.005227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 574/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:57:03 2022] GET /identity/v3/users/365486dbf0b347b78016e40af50b3177 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:04.010937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6ceb4-c5de-45fc-9767-4329a67751aa None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:04.108248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6ceb4-c5de-45fc-9767-4329a67751aa None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:04.110551 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:04.141074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd882a5e-ca5f-4ac6-abcb-53c126d551d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:04.141711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd882a5e-ca5f-4ac6-abcb-53c126d551d9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:04.141995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd882a5e-ca5f-4ac6-abcb-53c126d551d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:04.142270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd882a5e-ca5f-4ac6-abcb-53c126d551d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:04.207090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd882a5e-ca5f-4ac6-abcb-53c126d551d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:04.208470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd882a5e-ca5f-4ac6-abcb-53c126d551d9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:04.302172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 570/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:57:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:57:04.308032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d7c3f-4d94-4530-b5e9-7ddef61e6285 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:04.363322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:04.407422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d7c3f-4d94-4530-b5e9-7ddef61e6285 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:04.440139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363d028-a281-49af-9c05-e7c818dfcf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:04.440995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363d028-a281-49af-9c05-e7c818dfcf7e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:04.441283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363d028-a281-49af-9c05-e7c818dfcf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:04.441560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363d028-a281-49af-9c05-e7c818dfcf7e None admin] PATH_INFO: `/v3/projects/29330d1ae25844a090a953f0cf92bc71` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:04.442759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363d028-a281-49af-9c05-e7c818dfcf7e None admin] RBAC: Authorizing `identity:get_project(project_id=29330d1ae25844a090a953f0cf92bc71)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:04.444164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363d028-a281-49af-9c05-e7c818dfcf7e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:04.445858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 575/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:57:04 2022] GET /identity/v3/projects/29330d1ae25844a090a953f0cf92bc71 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:04.452402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd882a5e-ca5f-4ac6-abcb-53c126d551d9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:04.455470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:04.549791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd882a5e-ca5f-4ac6-abcb-53c126d551d9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:04.583495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bffb8-4b54-4875-a18c-11b43d2363bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:04.584129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bffb8-4b54-4875-a18c-11b43d2363bf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:04.584412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bffb8-4b54-4875-a18c-11b43d2363bf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:04.584687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bffb8-4b54-4875-a18c-11b43d2363bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:04.585510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bffb8-4b54-4875-a18c-11b43d2363bf None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=29330d1ae25844a090a953f0cf92bc71, user.id=365486dbf0b347b78016e40af50b3177) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:04.585822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bffb8-4b54-4875-a18c-11b43d2363bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:04.587264 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bffb8-4b54-4875-a18c-11b43d2363bf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:04.593187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 571/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:57:04 2022] GET /identity/v3/role_assignments?user.id=365486dbf0b347b78016e40af50b3177&scope.project.id=29330d1ae25844a090a953f0cf92bc71&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:06.743500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa911d-9b4d-4d81-a770-1b7eed4a3484 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:06.744124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa911d-9b4d-4d81-a770-1b7eed4a3484 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:06.744124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa911d-9b4d-4d81-a770-1b7eed4a3484 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:06.745451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 576/1147] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:57:06.750880 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63370ac2-a165-4819-a9cf-dbf607ab6dab None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:06.751308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63370ac2-a165-4819-a9cf-dbf607ab6dab None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:06.751433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63370ac2-a165-4819-a9cf-dbf607ab6dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:06.768055 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-63370ac2-a165-4819-a9cf-dbf607ab6dab None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:06.769245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-63370ac2-a165-4819-a9cf-dbf607ab6dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:06.831164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:06.837157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 572/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:57:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:57:06.859409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa911d-9b4d-4d81-a770-1b7eed4a3484 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:06.963352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa911d-9b4d-4d81-a770-1b7eed4a3484 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:06.985540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:06.996871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3048e46-8847-4396-a49c-82638352f3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:06.997586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3048e46-8847-4396-a49c-82638352f3ed None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:06.997867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3048e46-8847-4396-a49c-82638352f3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:06.998140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3048e46-8847-4396-a49c-82638352f3ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:07.007856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3048e46-8847-4396-a49c-82638352f3ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e3048e46-8847-4396-a49c-82638352f3ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:57:07.016070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:57:07.017228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:57:07.018188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 577/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:57:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:57:07.023263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63370ac2-a165-4819-a9cf-dbf607ab6dab None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:07.119125 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63370ac2-a165-4819-a9cf-dbf607ab6dab None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:07.151732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b190e-35fb-4ae6-a4c9-2ecb189301af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:07.152387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b190e-35fb-4ae6-a4c9-2ecb189301af None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:07.153253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b190e-35fb-4ae6-a4c9-2ecb189301af None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:07.153533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b190e-35fb-4ae6-a4c9-2ecb189301af None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:07.154281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b190e-35fb-4ae6-a4c9-2ecb189301af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:07.154620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b190e-35fb-4ae6-a4c9-2ecb189301af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:07.155983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b190e-35fb-4ae6-a4c9-2ecb189301af None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:07.163797 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 573/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:57:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:07.169620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3048e46-8847-4396-a49c-82638352f3ed None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:07.268334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3048e46-8847-4396-a49c-82638352f3ed None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:07.300658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3be7a-5b48-4845-8f4c-c10a4101e29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:07.301521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3be7a-5b48-4845-8f4c-c10a4101e29b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:07.301806 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3be7a-5b48-4845-8f4c-c10a4101e29b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:07.302083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3be7a-5b48-4845-8f4c-c10a4101e29b None admin] PATH_INFO: `/v3/users/365486dbf0b347b78016e40af50b3177` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:07.303274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3be7a-5b48-4845-8f4c-c10a4101e29b None admin] RBAC: Authorizing `identity:get_user(user_id=365486dbf0b347b78016e40af50b3177)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:07.304693 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3be7a-5b48-4845-8f4c-c10a4101e29b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:07.306379 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 578/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:57:07 2022] GET /identity/v3/users/365486dbf0b347b78016e40af50b3177 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:07.312606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b190e-35fb-4ae6-a4c9-2ecb189301af None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:07.373712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:07.414531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b190e-35fb-4ae6-a4c9-2ecb189301af None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:07.446910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023d067-df1d-4d10-9301-d14e89d196cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:07.447765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023d067-df1d-4d10-9301-d14e89d196cf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:07.448056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023d067-df1d-4d10-9301-d14e89d196cf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:07.448337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023d067-df1d-4d10-9301-d14e89d196cf None admin] PATH_INFO: `/v3/projects/29330d1ae25844a090a953f0cf92bc71` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:07.450476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023d067-df1d-4d10-9301-d14e89d196cf None admin] RBAC: Authorizing `identity:get_project(project_id=29330d1ae25844a090a953f0cf92bc71)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:07.451904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023d067-df1d-4d10-9301-d14e89d196cf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:07.453582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 574/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:57:07 2022] GET /identity/v3/projects/29330d1ae25844a090a953f0cf92bc71 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:07.459656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3be7a-5b48-4845-8f4c-c10a4101e29b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:07.508371 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:07.557169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3be7a-5b48-4845-8f4c-c10a4101e29b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:07.590173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f11d49-335e-4068-ac25-65f4d5df46bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:07.591200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f11d49-335e-4068-ac25-65f4d5df46bd None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:07.591484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f11d49-335e-4068-ac25-65f4d5df46bd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:07.591762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f11d49-335e-4068-ac25-65f4d5df46bd None admin] PATH_INFO: `/v3/projects/29330d1ae25844a090a953f0cf92bc71/users/365486dbf0b347b78016e40af50b3177/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:07.593698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f11d49-335e-4068-ac25-65f4d5df46bd None admin] RBAC: Authorizing `identity:create_grant(project_id=29330d1ae25844a090a953f0cf92bc71, user_id=365486dbf0b347b78016e40af50b3177, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:07.595141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f11d49-335e-4068-ac25-65f4d5df46bd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:07.608334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 579/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:57:07 2022] PUT /identity/v3/projects/29330d1ae25844a090a953f0cf92bc71/users/365486dbf0b347b78016e40af50b3177/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:09.801260 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eb7d7-6696-4e14-be13-fee9b821e9f1 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:09.801729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eb7d7-6696-4e14-be13-fee9b821e9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:09.801830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eb7d7-6696-4e14-be13-fee9b821e9f1 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:09.803196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 575/1154] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:57:09.808398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc038a3-6c02-4e12-ac24-24f303fc5682 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:09.808783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc038a3-6c02-4e12-ac24-24f303fc5682 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:09.808972 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc038a3-6c02-4e12-ac24-24f303fc5682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:09.826605 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ffc038a3-6c02-4e12-ac24-24f303fc5682 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:09.827793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ffc038a3-6c02-4e12-ac24-24f303fc5682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:09.892362 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 580/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:57:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:57:09.917308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eb7d7-6696-4e14-be13-fee9b821e9f1 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:10.019256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eb7d7-6696-4e14-be13-fee9b821e9f1 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:10.044959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:10.053006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797431a-777d-4484-95b7-3114c0e1b780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:10.053794 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797431a-777d-4484-95b7-3114c0e1b780 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:10.054081 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797431a-777d-4484-95b7-3114c0e1b780 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:10.054373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797431a-777d-4484-95b7-3114c0e1b780 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:10.064380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797431a-777d-4484-95b7-3114c0e1b780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-d797431a-777d-4484-95b7-3114c0e1b780 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:57:10.071964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:57:10.073064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:57:10.074096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 576/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:57:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:57:10.079864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc038a3-6c02-4e12-ac24-24f303fc5682 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:10.119872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:10.177719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc038a3-6c02-4e12-ac24-24f303fc5682 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:10.210730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e0b04-02b1-48fe-9230-cc0dc36ea2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:10.211392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e0b04-02b1-48fe-9230-cc0dc36ea2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:10.211681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e0b04-02b1-48fe-9230-cc0dc36ea2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:10.211960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e0b04-02b1-48fe-9230-cc0dc36ea2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:10.212702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e0b04-02b1-48fe-9230-cc0dc36ea2a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:10.213014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e0b04-02b1-48fe-9230-cc0dc36ea2a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:10.214385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e0b04-02b1-48fe-9230-cc0dc36ea2a8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:10.222814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 581/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:57:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:10.228466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797431a-777d-4484-95b7-3114c0e1b780 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:10.327184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797431a-777d-4484-95b7-3114c0e1b780 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:10.364876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceac0b-6c92-49cc-8736-f0b70d07bbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:10.365739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceac0b-6c92-49cc-8736-f0b70d07bbca None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:10.366025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceac0b-6c92-49cc-8736-f0b70d07bbca None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:10.366305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceac0b-6c92-49cc-8736-f0b70d07bbca None admin] PATH_INFO: `/v3/users/365486dbf0b347b78016e40af50b3177` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:10.367509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ceac0b-6c92-49cc-8736-f0b70d07bbca None admin] RBAC: Authorizing `identity:get_user(user_id=365486dbf0b347b78016e40af50b3177)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:10.368933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ceac0b-6c92-49cc-8736-f0b70d07bbca None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:10.370618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 577/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:57:10 2022] GET /identity/v3/users/365486dbf0b347b78016e40af50b3177 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:10.376942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e0b04-02b1-48fe-9230-cc0dc36ea2a8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:10.474172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e0b04-02b1-48fe-9230-cc0dc36ea2a8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:10.475689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:10.509118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4f87-f9c8-443c-b80d-4681c17b1465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:10.509765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4f87-f9c8-443c-b80d-4681c17b1465 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:10.510055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4f87-f9c8-443c-b80d-4681c17b1465 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:10.510333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4f87-f9c8-443c-b80d-4681c17b1465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:10.576249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b4f87-f9c8-443c-b80d-4681c17b1465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:10.577727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b4f87-f9c8-443c-b80d-4681c17b1465 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:10.671766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 582/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:57:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:57:10.677574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceac0b-6c92-49cc-8736-f0b70d07bbca None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:10.733053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:10.776286 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceac0b-6c92-49cc-8736-f0b70d07bbca None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:10.810116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea06059-9be2-4096-b0e7-40b7972b5e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:10.811538 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea06059-9be2-4096-b0e7-40b7972b5e4a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:10.811991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea06059-9be2-4096-b0e7-40b7972b5e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:10.812281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea06059-9be2-4096-b0e7-40b7972b5e4a None admin] PATH_INFO: `/v3/projects/29330d1ae25844a090a953f0cf92bc71` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:10.813739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea06059-9be2-4096-b0e7-40b7972b5e4a None admin] RBAC: Authorizing `identity:get_project(project_id=29330d1ae25844a090a953f0cf92bc71)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:10.815566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea06059-9be2-4096-b0e7-40b7972b5e4a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:10.817728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 578/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:57:10 2022] GET /identity/v3/projects/29330d1ae25844a090a953f0cf92bc71 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:10.823917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4f87-f9c8-443c-b80d-4681c17b1465 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:10.826985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:10.922017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4f87-f9c8-443c-b80d-4681c17b1465 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:10.955716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985200d-bcee-450e-a4e3-c3e822db15a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:10.956350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985200d-bcee-450e-a4e3-c3e822db15a7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:10.956634 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985200d-bcee-450e-a4e3-c3e822db15a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:10.956906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985200d-bcee-450e-a4e3-c3e822db15a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:10.957721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985200d-bcee-450e-a4e3-c3e822db15a7 None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=29330d1ae25844a090a953f0cf92bc71, user.id=365486dbf0b347b78016e40af50b3177) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:10.958027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985200d-bcee-450e-a4e3-c3e822db15a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:10.959454 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985200d-bcee-450e-a4e3-c3e822db15a7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:10.965737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 583/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:57:10 2022] GET /identity/v3/role_assignments?user.id=365486dbf0b347b78016e40af50b3177&scope.project.id=29330d1ae25844a090a953f0cf92bc71&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:13.219767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f08a0-ab5d-4d0e-8b75-bcacd3d29cef None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:13.220289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f08a0-ab5d-4d0e-8b75-bcacd3d29cef None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:13.220396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f08a0-ab5d-4d0e-8b75-bcacd3d29cef None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:13.221677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 579/1162] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:57:13.226847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e80ecf-dbb1-4c99-bb62-51ace440f905 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:13.227267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e80ecf-dbb1-4c99-bb62-51ace440f905 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:13.227411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e80ecf-dbb1-4c99-bb62-51ace440f905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:13.244375 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-42e80ecf-dbb1-4c99-bb62-51ace440f905 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:13.245567 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-42e80ecf-dbb1-4c99-bb62-51ace440f905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:13.303355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:13.310636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 584/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:57:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:57:13.333278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f08a0-ab5d-4d0e-8b75-bcacd3d29cef None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:13.432505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f08a0-ab5d-4d0e-8b75-bcacd3d29cef None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:13.455239 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:13.466831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1422750-a6a3-4e16-9289-ac12b437cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:13.467475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1422750-a6a3-4e16-9289-ac12b437cc3b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:13.467758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1422750-a6a3-4e16-9289-ac12b437cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:13.468032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1422750-a6a3-4e16-9289-ac12b437cc3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:13.533188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1422750-a6a3-4e16-9289-ac12b437cc3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:13.534602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1422750-a6a3-4e16-9289-ac12b437cc3b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:13.628655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 580/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:57:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:57:13.634642 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e80ecf-dbb1-4c99-bb62-51ace440f905 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:13.731333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e80ecf-dbb1-4c99-bb62-51ace440f905 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:13.765354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2a5c8-fe99-4f35-9f8a-d594717322bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:13.766152 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a5c8-fe99-4f35-9f8a-d594717322bf None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:13.766459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a5c8-fe99-4f35-9f8a-d594717322bf None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:13.766735 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a5c8-fe99-4f35-9f8a-d594717322bf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:13.773339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2a5c8-fe99-4f35-9f8a-d594717322bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:13.774778 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2a5c8-fe99-4f35-9f8a-d594717322bf None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-4bb2a5c8-fe99-4f35-9f8a-d594717322bf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:57:13.789606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:57:13.790826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:57:13.791718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 585/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 23 16:57:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:57:13.797025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1422750-a6a3-4e16-9289-ac12b437cc3b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:13.820593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:13.894087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1422750-a6a3-4e16-9289-ac12b437cc3b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:13.927023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd9863-cb51-4e41-bd57-b299dd445890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:13.927677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd9863-cb51-4e41-bd57-b299dd445890 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:13.927965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd9863-cb51-4e41-bd57-b299dd445890 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:13.928269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd9863-cb51-4e41-bd57-b299dd445890 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:13.928988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd9863-cb51-4e41-bd57-b299dd445890 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:13.929298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd9863-cb51-4e41-bd57-b299dd445890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:13.930686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd9863-cb51-4e41-bd57-b299dd445890 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:13.937725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 581/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Mon May 23 16:57:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:16.124888 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a1388-90e4-4460-92ed-38a7c8532356 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:16.125434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a1388-90e4-4460-92ed-38a7c8532356 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:16.125434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a1388-90e4-4460-92ed-38a7c8532356 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:16.126854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 586/1167] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:57:16.131968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffe7df-e0e5-4411-93fe-e62b0d31f5db None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:16.132387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffe7df-e0e5-4411-93fe-e62b0d31f5db None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:16.132523 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffe7df-e0e5-4411-93fe-e62b0d31f5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:16.149411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-54ffe7df-e0e5-4411-93fe-e62b0d31f5db None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:16.150616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-54ffe7df-e0e5-4411-93fe-e62b0d31f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:16.213996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 582/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:57:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:57:16.236768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a1388-90e4-4460-92ed-38a7c8532356 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:16.293276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:16.338120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a1388-90e4-4460-92ed-38a7c8532356 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:16.370581 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062621c-312e-4276-a7ad-45a8b0fe05d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:16.371748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062621c-312e-4276-a7ad-45a8b0fe05d2 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:16.372028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062621c-312e-4276-a7ad-45a8b0fe05d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:16.372303 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062621c-312e-4276-a7ad-45a8b0fe05d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:16.373040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062621c-312e-4276-a7ad-45a8b0fe05d2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:16.374407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062621c-312e-4276-a7ad-45a8b0fe05d2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:16.389179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 587/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Mon May 23 16:57:16 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:18.597877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c6086-4f7a-4b5e-8d8b-0fb08ab226cf None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:18.598451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c6086-4f7a-4b5e-8d8b-0fb08ab226cf None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:18.598451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c6086-4f7a-4b5e-8d8b-0fb08ab226cf None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:18.599901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 583/1170] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:57:18.604989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03199bb2-228b-4e3c-aa61-cf73abcbefbc None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:18.606026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03199bb2-228b-4e3c-aa61-cf73abcbefbc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:18.606212 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03199bb2-228b-4e3c-aa61-cf73abcbefbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:18.622866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-03199bb2-228b-4e3c-aa61-cf73abcbefbc None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:18.624036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-03199bb2-228b-4e3c-aa61-cf73abcbefbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:18.687836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 588/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:57:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:57:18.711145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c6086-4f7a-4b5e-8d8b-0fb08ab226cf None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:18.730129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:18.812370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c6086-4f7a-4b5e-8d8b-0fb08ab226cf None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:18.845617 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146be80-fa01-4691-a935-002194e31bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:18.846485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146be80-fa01-4691-a935-002194e31bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:18.846769 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146be80-fa01-4691-a935-002194e31bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:18.847042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146be80-fa01-4691-a935-002194e31bb7 None admin] PATH_INFO: `/v3/domains/dfcbfcd7370c4514b56e0fba50bd7f82` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:18.857328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146be80-fa01-4691-a935-002194e31bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=dfcbfcd7370c4514b56e0fba50bd7f82)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:18.858735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146be80-fa01-4691-a935-002194e31bb7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:18.860346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 584/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Mon May 23 16:57:18 2022] GET /identity/v3/domains/dfcbfcd7370c4514b56e0fba50bd7f82 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:18.866130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03199bb2-228b-4e3c-aa61-cf73abcbefbc None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:18.911646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:18.963907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03199bb2-228b-4e3c-aa61-cf73abcbefbc None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:18.997157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e401216-7065-4d88-8a61-e7b6464c7eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:18.997808 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e401216-7065-4d88-8a61-e7b6464c7eb8 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:18.998092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e401216-7065-4d88-8a61-e7b6464c7eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:18.998400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e401216-7065-4d88-8a61-e7b6464c7eb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:18.999101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e401216-7065-4d88-8a61-e7b6464c7eb8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:19.000528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e401216-7065-4d88-8a61-e7b6464c7eb8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:19.025342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 589/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:57:18 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:21.255405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c29c2-d680-4a12-88e2-60bc85c0c147 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:21.255932 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c29c2-d680-4a12-88e2-60bc85c0c147 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:21.256025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c29c2-d680-4a12-88e2-60bc85c0c147 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:21.257319 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 585/1174] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:57:21.262617 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9557b6f-bf15-4c95-99ab-808f870a689b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:21.263020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9557b6f-bf15-4c95-99ab-808f870a689b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:21.263183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9557b6f-bf15-4c95-99ab-808f870a689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:21.280200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b9557b6f-bf15-4c95-99ab-808f870a689b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:21.281384 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b9557b6f-bf15-4c95-99ab-808f870a689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:21.346576 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 590/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:57:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:57:21.371914 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c29c2-d680-4a12-88e2-60bc85c0c147 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:21.449038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:21.472041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c29c2-d680-4a12-88e2-60bc85c0c147 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:21.504523 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df86bf-eda0-4c89-ae5d-f6e4c61c8534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:21.505463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df86bf-eda0-4c89-ae5d-f6e4c61c8534 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:21.505730 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df86bf-eda0-4c89-ae5d-f6e4c61c8534 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:21.506009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df86bf-eda0-4c89-ae5d-f6e4c61c8534 None admin] PATH_INFO: `/v3/domains/dfcbfcd7370c4514b56e0fba50bd7f82` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:21.507227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df86bf-eda0-4c89-ae5d-f6e4c61c8534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=dfcbfcd7370c4514b56e0fba50bd7f82)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:21.508682 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df86bf-eda0-4c89-ae5d-f6e4c61c8534 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:21.510290 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 586/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Mon May 23 16:57:21 2022] GET /identity/v3/domains/dfcbfcd7370c4514b56e0fba50bd7f82 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:21.516005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9557b6f-bf15-4c95-99ab-808f870a689b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:21.543804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:21.615449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9557b6f-bf15-4c95-99ab-808f870a689b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:21.648145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785aa8e-313a-4931-840e-acec45df4d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:21.648812 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785aa8e-313a-4931-840e-acec45df4d5c None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:21.649101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785aa8e-313a-4931-840e-acec45df4d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:21.649381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785aa8e-313a-4931-840e-acec45df4d5c None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:21.650092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785aa8e-313a-4931-840e-acec45df4d5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:21.651532 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785aa8e-313a-4931-840e-acec45df4d5c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:21.671914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 591/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:57:21 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:23.941497 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c400940-62dd-4376-9227-6eb8b669bdd0 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:23.942045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c400940-62dd-4376-9227-6eb8b669bdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:23.942045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c400940-62dd-4376-9227-6eb8b669bdd0 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:23.943438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 587/1178] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:57:23.948528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6521-f908-4c76-9e37-a5fd19459a43 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:23.949084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6521-f908-4c76-9e37-a5fd19459a43 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:23.949588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6521-f908-4c76-9e37-a5fd19459a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:23.966765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d37e6521-f908-4c76-9e37-a5fd19459a43 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:23.967939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d37e6521-f908-4c76-9e37-a5fd19459a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:24.032540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 592/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:57:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:57:24.056289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c400940-62dd-4376-9227-6eb8b669bdd0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:24.174608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c400940-62dd-4376-9227-6eb8b669bdd0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:24.207951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf63b68-15d7-4e5b-9f28-dbac8bd3f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:24.208736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf63b68-15d7-4e5b-9f28-dbac8bd3f4df None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:24.209025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf63b68-15d7-4e5b-9f28-dbac8bd3f4df None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:24.209305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf63b68-15d7-4e5b-9f28-dbac8bd3f4df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:24.219874 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf63b68-15d7-4e5b-9f28-dbac8bd3f4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-bbf63b68-15d7-4e5b-9f28-dbac8bd3f4df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:57:24.227441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:57:24.228531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:57:24.229550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 588/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:57:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:57:24.234687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e6521-f908-4c76-9e37-a5fd19459a43 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:24.249314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:24.332415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e6521-f908-4c76-9e37-a5fd19459a43 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:24.365543 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf12d0c-8fbf-4168-8e14-0e6d3238c2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:24.366200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf12d0c-8fbf-4168-8e14-0e6d3238c2ec None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:24.366520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf12d0c-8fbf-4168-8e14-0e6d3238c2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:24.366801 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf12d0c-8fbf-4168-8e14-0e6d3238c2ec None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:24.367547 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf12d0c-8fbf-4168-8e14-0e6d3238c2ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:24.367860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf12d0c-8fbf-4168-8e14-0e6d3238c2ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:24.369217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf12d0c-8fbf-4168-8e14-0e6d3238c2ec None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:24.377165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 593/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:57:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:24.382773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf63b68-15d7-4e5b-9f28-dbac8bd3f4df None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:24.392467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:24.489629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf63b68-15d7-4e5b-9f28-dbac8bd3f4df None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:24.524732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798175-580c-43c9-a177-9365cfb2bfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:24.525598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798175-580c-43c9-a177-9365cfb2bfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:24.525879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798175-580c-43c9-a177-9365cfb2bfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:24.526151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798175-580c-43c9-a177-9365cfb2bfe8 None admin] PATH_INFO: `/v3/users/b55d7f03ec04402ebc2291c462604ca3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:24.539215 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798175-580c-43c9-a177-9365cfb2bfe8 None admin] RBAC: Authorizing `identity:get_user(user_id=b55d7f03ec04402ebc2291c462604ca3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:24.540644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798175-580c-43c9-a177-9365cfb2bfe8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:24.542266 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 589/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:57:24 2022] GET /identity/v3/users/b55d7f03ec04402ebc2291c462604ca3 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:24.548304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf12d0c-8fbf-4168-8e14-0e6d3238c2ec None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:24.624534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:24.647992 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf12d0c-8fbf-4168-8e14-0e6d3238c2ec None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:24.680011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c26d5-7511-433b-bc6e-d5fb236a8c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:24.680656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c26d5-7511-433b-bc6e-d5fb236a8c8e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:24.680939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c26d5-7511-433b-bc6e-d5fb236a8c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:24.681215 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c26d5-7511-433b-bc6e-d5fb236a8c8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:24.747129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c26d5-7511-433b-bc6e-d5fb236a8c8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:24.748569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c26d5-7511-433b-bc6e-d5fb236a8c8e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:24.820782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:24.844020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 594/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:57:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:57:24.849976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798175-580c-43c9-a177-9365cfb2bfe8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:24.911079 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:24.948802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798175-580c-43c9-a177-9365cfb2bfe8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:24.982722 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56490c4b-8a2c-471a-96c4-f0dacd2720c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:24.983561 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56490c4b-8a2c-471a-96c4-f0dacd2720c0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:24.983843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56490c4b-8a2c-471a-96c4-f0dacd2720c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:24.984115 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56490c4b-8a2c-471a-96c4-f0dacd2720c0 None admin] PATH_INFO: `/v3/projects/c32f67f5f9ab4305901c5574158c5c21` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:24.985269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56490c4b-8a2c-471a-96c4-f0dacd2720c0 None admin] RBAC: Authorizing `identity:get_project(project_id=c32f67f5f9ab4305901c5574158c5c21)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:24.986707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56490c4b-8a2c-471a-96c4-f0dacd2720c0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:24.988352 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 590/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:57:24 2022] GET /identity/v3/projects/c32f67f5f9ab4305901c5574158c5c21 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:24.994571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c26d5-7511-433b-bc6e-d5fb236a8c8e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:25.091717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c26d5-7511-433b-bc6e-d5fb236a8c8e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:25.124901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c7ac4-e618-4c6f-bdf0-840ec407ad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:25.125538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c7ac4-e618-4c6f-bdf0-840ec407ad34 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:25.125817 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c7ac4-e618-4c6f-bdf0-840ec407ad34 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:25.126090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c7ac4-e618-4c6f-bdf0-840ec407ad34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:25.126934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c7ac4-e618-4c6f-bdf0-840ec407ad34 None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=c32f67f5f9ab4305901c5574158c5c21, user.id=b55d7f03ec04402ebc2291c462604ca3) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:25.127244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c7ac4-e618-4c6f-bdf0-840ec407ad34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:25.128669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c7ac4-e618-4c6f-bdf0-840ec407ad34 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:25.133881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 595/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:57:24 2022] GET /identity/v3/role_assignments?user.id=b55d7f03ec04402ebc2291c462604ca3&scope.project.id=c32f67f5f9ab4305901c5574158c5c21&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:27.281426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbf411-92af-4baa-b4a0-610db0d4bda0 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:27.281975 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbf411-92af-4baa-b4a0-610db0d4bda0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:27.281975 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbf411-92af-4baa-b4a0-610db0d4bda0 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:27.283392 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 591/1186] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:57:27.288703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89354f42-0ff5-4d1a-ad11-084129aec07e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:27.289113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89354f42-0ff5-4d1a-ad11-084129aec07e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:27.289261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89354f42-0ff5-4d1a-ad11-084129aec07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:27.305726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-89354f42-0ff5-4d1a-ad11-084129aec07e None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:27.306934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-89354f42-0ff5-4d1a-ad11-084129aec07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:27.340841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:27.372700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 596/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:57:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:57:27.402695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbf411-92af-4baa-b4a0-610db0d4bda0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:27.509322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbf411-92af-4baa-b4a0-610db0d4bda0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:27.537966 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:27.543315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ee543-a8a7-4392-86a0-7ef42efaf51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:27.544100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ee543-a8a7-4392-86a0-7ef42efaf51e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:27.544383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ee543-a8a7-4392-86a0-7ef42efaf51e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:27.544655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ee543-a8a7-4392-86a0-7ef42efaf51e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:27.554470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ee543-a8a7-4392-86a0-7ef42efaf51e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ab1ee543-a8a7-4392-86a0-7ef42efaf51e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:57:27.562347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:57:27.563462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:57:27.564655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 592/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:57:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:57:27.569542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89354f42-0ff5-4d1a-ad11-084129aec07e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:27.666654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89354f42-0ff5-4d1a-ad11-084129aec07e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:27.700572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117946e6-7f04-47e1-b201-08b0287099ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:27.701233 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117946e6-7f04-47e1-b201-08b0287099ef None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:27.701515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117946e6-7f04-47e1-b201-08b0287099ef None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:27.701789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117946e6-7f04-47e1-b201-08b0287099ef None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:27.702552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117946e6-7f04-47e1-b201-08b0287099ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:27.702860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117946e6-7f04-47e1-b201-08b0287099ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:27.704211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117946e6-7f04-47e1-b201-08b0287099ef None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:27.712003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 597/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:57:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:27.717851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ee543-a8a7-4392-86a0-7ef42efaf51e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:27.821318 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ee543-a8a7-4392-86a0-7ef42efaf51e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:27.854211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ae1a9-a753-4118-b43f-b614cf6f894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:27.855793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ae1a9-a753-4118-b43f-b614cf6f894d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:27.856085 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ae1a9-a753-4118-b43f-b614cf6f894d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:27.856363 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ae1a9-a753-4118-b43f-b614cf6f894d None admin] PATH_INFO: `/v3/users/b55d7f03ec04402ebc2291c462604ca3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:27.857540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ae1a9-a753-4118-b43f-b614cf6f894d None admin] RBAC: Authorizing `identity:get_user(user_id=b55d7f03ec04402ebc2291c462604ca3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:27.858998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ae1a9-a753-4118-b43f-b614cf6f894d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:27.860609 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 593/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:57:27 2022] GET /identity/v3/users/b55d7f03ec04402ebc2291c462604ca3 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:27.866354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117946e6-7f04-47e1-b201-08b0287099ef None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:27.897911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:27.963521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117946e6-7f04-47e1-b201-08b0287099ef None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:27.995565 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de968b-ce44-4a59-beb7-3dd93a827972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:27.996485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de968b-ce44-4a59-beb7-3dd93a827972 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:27.996772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de968b-ce44-4a59-beb7-3dd93a827972 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:27.997050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de968b-ce44-4a59-beb7-3dd93a827972 None admin] PATH_INFO: `/v3/projects/c32f67f5f9ab4305901c5574158c5c21` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:27.998216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de968b-ce44-4a59-beb7-3dd93a827972 None admin] RBAC: Authorizing `identity:get_project(project_id=c32f67f5f9ab4305901c5574158c5c21)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:27.999651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de968b-ce44-4a59-beb7-3dd93a827972 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:28.001323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 598/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:57:27 2022] GET /identity/v3/projects/c32f67f5f9ab4305901c5574158c5c21 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:28.007155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ae1a9-a753-4118-b43f-b614cf6f894d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:28.064949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:28.106266 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ae1a9-a753-4118-b43f-b614cf6f894d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:28.139011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8013f11-cbdd-4b2d-b1ac-16f561d2b228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:28.139889 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8013f11-cbdd-4b2d-b1ac-16f561d2b228 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:28.140168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8013f11-cbdd-4b2d-b1ac-16f561d2b228 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:28.140439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8013f11-cbdd-4b2d-b1ac-16f561d2b228 None admin] PATH_INFO: `/v3/projects/c32f67f5f9ab4305901c5574158c5c21/users/b55d7f03ec04402ebc2291c462604ca3/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:28.142339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8013f11-cbdd-4b2d-b1ac-16f561d2b228 None admin] RBAC: Authorizing `identity:create_grant(project_id=c32f67f5f9ab4305901c5574158c5c21, user_id=b55d7f03ec04402ebc2291c462604ca3, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:28.143936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8013f11-cbdd-4b2d-b1ac-16f561d2b228 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:28.156808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 594/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:57:28 2022] PUT /identity/v3/projects/c32f67f5f9ab4305901c5574158c5c21/users/b55d7f03ec04402ebc2291c462604ca3/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:30.325059 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1b54e-a34b-4258-9687-5170e25f3de0 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:30.325591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1b54e-a34b-4258-9687-5170e25f3de0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:30.325591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1b54e-a34b-4258-9687-5170e25f3de0 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:30.327032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 599/1193] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:57:30.332260 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677af3c-6ae8-4f5e-8676-445ea43f122d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:30.332697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677af3c-6ae8-4f5e-8676-445ea43f122d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:30.332819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677af3c-6ae8-4f5e-8676-445ea43f122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:30.349840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5677af3c-6ae8-4f5e-8676-445ea43f122d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:30.351039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5677af3c-6ae8-4f5e-8676-445ea43f122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:30.414651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 595/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:57:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:57:30.437619 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1b54e-a34b-4258-9687-5170e25f3de0 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:30.534762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:30.538940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1b54e-a34b-4258-9687-5170e25f3de0 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:30.572252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5bb09-17b5-4091-9bd0-0f1ee4629d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:30.573033 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5bb09-17b5-4091-9bd0-0f1ee4629d88 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:30.573331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5bb09-17b5-4091-9bd0-0f1ee4629d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:30.574535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5bb09-17b5-4091-9bd0-0f1ee4629d88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:30.584387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5bb09-17b5-4091-9bd0-0f1ee4629d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e9f5bb09-17b5-4091-9bd0-0f1ee4629d88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:57:30.592023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:57:30.593136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:57:30.594023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 600/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:57:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:57:30.599211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677af3c-6ae8-4f5e-8676-445ea43f122d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:30.647444 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:30.695417 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677af3c-6ae8-4f5e-8676-445ea43f122d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:30.728233 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aff6d7-6589-4d50-9546-37244f546220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:30.728886 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aff6d7-6589-4d50-9546-37244f546220 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:30.729172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aff6d7-6589-4d50-9546-37244f546220 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:30.729449 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aff6d7-6589-4d50-9546-37244f546220 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:30.731508 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aff6d7-6589-4d50-9546-37244f546220 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:30.731508 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aff6d7-6589-4d50-9546-37244f546220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:30.732076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aff6d7-6589-4d50-9546-37244f546220 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:30.740244 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 596/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:57:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:30.747259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5bb09-17b5-4091-9bd0-0f1ee4629d88 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:30.845702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5bb09-17b5-4091-9bd0-0f1ee4629d88 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:30.878652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6f86f-15e9-4979-bff2-2d96ae514d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:30.879508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6f86f-15e9-4979-bff2-2d96ae514d70 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:30.879789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6f86f-15e9-4979-bff2-2d96ae514d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:30.880058 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6f86f-15e9-4979-bff2-2d96ae514d70 None admin] PATH_INFO: `/v3/users/b55d7f03ec04402ebc2291c462604ca3` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:30.881217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6f86f-15e9-4979-bff2-2d96ae514d70 None admin] RBAC: Authorizing `identity:get_user(user_id=b55d7f03ec04402ebc2291c462604ca3)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:30.882644 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6f86f-15e9-4979-bff2-2d96ae514d70 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:30.884243 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 601/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Mon May 23 16:57:30 2022] GET /identity/v3/users/b55d7f03ec04402ebc2291c462604ca3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:30.890012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aff6d7-6589-4d50-9546-37244f546220 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:30.987580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aff6d7-6589-4d50-9546-37244f546220 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:31.000498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:31.020721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac276b-a108-4df5-b9a7-0bfaeb4192d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:31.021361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac276b-a108-4df5-b9a7-0bfaeb4192d4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:31.021647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac276b-a108-4df5-b9a7-0bfaeb4192d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:31.021924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac276b-a108-4df5-b9a7-0bfaeb4192d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:31.086906 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac276b-a108-4df5-b9a7-0bfaeb4192d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:31.088342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac276b-a108-4df5-b9a7-0bfaeb4192d4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:31.182139 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 597/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:57:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:57:31.189665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6f86f-15e9-4979-bff2-2d96ae514d70 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:31.219192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:31.288341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6f86f-15e9-4979-bff2-2d96ae514d70 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:31.320748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf6cec-a230-4bbb-9585-68422711cf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:31.321597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf6cec-a230-4bbb-9585-68422711cf72 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:31.321882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf6cec-a230-4bbb-9585-68422711cf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:31.322154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf6cec-a230-4bbb-9585-68422711cf72 None admin] PATH_INFO: `/v3/projects/c32f67f5f9ab4305901c5574158c5c21` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:31.323333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf6cec-a230-4bbb-9585-68422711cf72 None admin] RBAC: Authorizing `identity:get_project(project_id=c32f67f5f9ab4305901c5574158c5c21)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:31.325257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf6cec-a230-4bbb-9585-68422711cf72 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:31.326983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 602/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Mon May 23 16:57:31 2022] GET /identity/v3/projects/c32f67f5f9ab4305901c5574158c5c21 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:31.333064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac276b-a108-4df5-b9a7-0bfaeb4192d4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:31.347458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:31.430429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac276b-a108-4df5-b9a7-0bfaeb4192d4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:31.462946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fcfc1-a7e2-4bab-914b-2611363d69f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:31.463524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fcfc1-a7e2-4bab-914b-2611363d69f5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:31.463809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fcfc1-a7e2-4bab-914b-2611363d69f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:31.464089 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fcfc1-a7e2-4bab-914b-2611363d69f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:31.465452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fcfc1-a7e2-4bab-914b-2611363d69f5 None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=c32f67f5f9ab4305901c5574158c5c21, user.id=b55d7f03ec04402ebc2291c462604ca3) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:31.465774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fcfc1-a7e2-4bab-914b-2611363d69f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:31.467217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fcfc1-a7e2-4bab-914b-2611363d69f5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:31.472965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 598/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:57:31 2022] GET /identity/v3/role_assignments?user.id=b55d7f03ec04402ebc2291c462604ca3&scope.project.id=c32f67f5f9ab4305901c5574158c5c21&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:41.317187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=52 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:41.470373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=62 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:32.156141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdadd6-433f-4bab-bb42-6b823a50c579 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:32.156747 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdadd6-433f-4bab-bb42-6b823a50c579 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:32.156747 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdadd6-433f-4bab-bb42-6b823a50c579 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:32.158337 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 603/1201] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:58:32.163841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b32f9-082d-4cb0-9944-075bbdba1777 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:32.164277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b32f9-082d-4cb0-9944-075bbdba1777 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:32.164418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b32f9-082d-4cb0-9944-075bbdba1777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:32.187565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-077b32f9-082d-4cb0-9944-075bbdba1777 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:32.188855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-077b32f9-082d-4cb0-9944-075bbdba1777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:32.285966 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 599/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:58:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:58:32.313969 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdadd6-433f-4bab-bb42-6b823a50c579 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:32.465976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdadd6-433f-4bab-bb42-6b823a50c579 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:32.515601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9ee1b-d2c3-4c8e-ade4-06b0de8f0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:32.516644 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9ee1b-d2c3-4c8e-ade4-06b0de8f0417 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:32.517043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9ee1b-d2c3-4c8e-ade4-06b0de8f0417 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:32.517328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9ee1b-d2c3-4c8e-ade4-06b0de8f0417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:32.529947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9ee1b-d2c3-4c8e-ade4-06b0de8f0417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:32.531487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9ee1b-d2c3-4c8e-ade4-06b0de8f0417 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f3f9ee1b-d2c3-4c8e-ade4-06b0de8f0417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:58:32.550354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:32.551475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:32.552800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:58:32.552800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:58:32.552800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:32.552800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:32.552800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 604/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:32.557631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b32f9-082d-4cb0-9944-075bbdba1777 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:32.679909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b32f9-082d-4cb0-9944-075bbdba1777 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:32.732409 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:32.739179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c8300-c1fb-4225-a7f1-10e4455a031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:32.739946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8300-c1fb-4225-a7f1-10e4455a031f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:32.740214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8300-c1fb-4225-a7f1-10e4455a031f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:32.740524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8300-c1fb-4225-a7f1-10e4455a031f None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:32.741318 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c8300-c1fb-4225-a7f1-10e4455a031f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:32.741686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c8300-c1fb-4225-a7f1-10e4455a031f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:32.743175 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c8300-c1fb-4225-a7f1-10e4455a031f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:32.760630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 600/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:32.763668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9ee1b-d2c3-4c8e-ade4-06b0de8f0417 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:32.835385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:32.899355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9ee1b-d2c3-4c8e-ade4-06b0de8f0417 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:32.944881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d6127-de36-4213-b385-f12dcbbf19fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:32.945628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d6127-de36-4213-b385-f12dcbbf19fb None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:32.945961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d6127-de36-4213-b385-f12dcbbf19fb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:32.946242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d6127-de36-4213-b385-f12dcbbf19fb None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:32.947680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d6127-de36-4213-b385-f12dcbbf19fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:32.949594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d6127-de36-4213-b385-f12dcbbf19fb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:32.972601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 605/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Mon May 23 16:58:32 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:58:35.492096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2e1af-fd8e-46c6-85d2-66371b38b755 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:35.492679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2e1af-fd8e-46c6-85d2-66371b38b755 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:35.492679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2e1af-fd8e-46c6-85d2-66371b38b755 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:35.494771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 601/1206] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:58:35.504407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56766aac-af4a-4f5c-9029-7028224a4b6d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:35.505048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56766aac-af4a-4f5c-9029-7028224a4b6d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:35.505164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56766aac-af4a-4f5c-9029-7028224a4b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:35.526999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-56766aac-af4a-4f5c-9029-7028224a4b6d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:35.528201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-56766aac-af4a-4f5c-9029-7028224a4b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:35.611513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 606/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:58:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:58:35.640732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2e1af-fd8e-46c6-85d2-66371b38b755 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:35.769070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2e1af-fd8e-46c6-85d2-66371b38b755 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:35.820612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ebf24-7ea7-4bd9-a77f-9cdcab337229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:35.821420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ebf24-7ea7-4bd9-a77f-9cdcab337229 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:35.821739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ebf24-7ea7-4bd9-a77f-9cdcab337229 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:35.822018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ebf24-7ea7-4bd9-a77f-9cdcab337229 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:35.833623 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ebf24-7ea7-4bd9-a77f-9cdcab337229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-b75ebf24-7ea7-4bd9-a77f-9cdcab337229 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:58:35.842411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:35.843416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:35.844342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 602/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:35.850014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56766aac-af4a-4f5c-9029-7028224a4b6d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:35.895437 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:35.961771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56766aac-af4a-4f5c-9029-7028224a4b6d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:36.003512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d13bff-7978-4712-82f2-31d7dd61af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:36.004217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d13bff-7978-4712-82f2-31d7dd61af06 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:36.004501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d13bff-7978-4712-82f2-31d7dd61af06 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:36.004790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d13bff-7978-4712-82f2-31d7dd61af06 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:36.005504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d13bff-7978-4712-82f2-31d7dd61af06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:36.005811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d13bff-7978-4712-82f2-31d7dd61af06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:36.007278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d13bff-7978-4712-82f2-31d7dd61af06 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:36.016340 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 607/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:36.022274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ebf24-7ea7-4bd9-a77f-9cdcab337229 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:36.087664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:36.152447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ebf24-7ea7-4bd9-a77f-9cdcab337229 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:36.193347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd99fe-6f32-453c-99f2-a60726a50e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:36.194304 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd99fe-6f32-453c-99f2-a60726a50e5b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:36.194850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd99fe-6f32-453c-99f2-a60726a50e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:36.195171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd99fe-6f32-453c-99f2-a60726a50e5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:36.208290 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd99fe-6f32-453c-99f2-a60726a50e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:36.209738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd99fe-6f32-453c-99f2-a60726a50e5b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-8ccd99fe-6f32-453c-99f2-a60726a50e5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:58:36.233849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:36.234896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:36.236455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:58:36.236455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:58:36.236455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:36.236455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:36.236455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 603/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:58:36.241725 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d13bff-7978-4712-82f2-31d7dd61af06 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:36.361584 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:36.364577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d13bff-7978-4712-82f2-31d7dd61af06 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:36.406657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01af470-c4a9-45bb-9651-9228527cf822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:36.407373 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01af470-c4a9-45bb-9651-9228527cf822 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:36.407657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01af470-c4a9-45bb-9651-9228527cf822 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:36.407934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01af470-c4a9-45bb-9651-9228527cf822 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:36.408667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01af470-c4a9-45bb-9651-9228527cf822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:36.408975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01af470-c4a9-45bb-9651-9228527cf822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:36.410423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01af470-c4a9-45bb-9651-9228527cf822 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:36.425776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 608/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:36.431541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd99fe-6f32-453c-99f2-a60726a50e5b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:36.564392 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd99fe-6f32-453c-99f2-a60726a50e5b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:36.566273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:36.606213 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418e8ea-43ed-4beb-8bb0-14cd8684994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:36.607047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418e8ea-43ed-4beb-8bb0-14cd8684994c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:36.607344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418e8ea-43ed-4beb-8bb0-14cd8684994c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:36.607663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418e8ea-43ed-4beb-8bb0-14cd8684994c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:36.617330 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418e8ea-43ed-4beb-8bb0-14cd8684994c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:36.619855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418e8ea-43ed-4beb-8bb0-14cd8684994c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-3418e8ea-43ed-4beb-8bb0-14cd8684994c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:58:36.638442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:36.639540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:36.640492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:36.640492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:36.640492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:58:36.640492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:58:36.640492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:58:36.640492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:58:36.640492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:58:36.640492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:58:36.640492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 16:58:36.640492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:36.640492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 604/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:36.646066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01af470-c4a9-45bb-9651-9228527cf822 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:36.764834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01af470-c4a9-45bb-9651-9228527cf822 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:36.803538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b996b-eca8-414c-bc7e-3fcf2015991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:36.804210 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b996b-eca8-414c-bc7e-3fcf2015991a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:36.804494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b996b-eca8-414c-bc7e-3fcf2015991a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:36.804774 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b996b-eca8-414c-bc7e-3fcf2015991a None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:36.805648 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b996b-eca8-414c-bc7e-3fcf2015991a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:36.806804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b996b-eca8-414c-bc7e-3fcf2015991a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:36.808513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b996b-eca8-414c-bc7e-3fcf2015991a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:36.834404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 609/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Mon May 23 16:58:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:36.839543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418e8ea-43ed-4beb-8bb0-14cd8684994c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:36.959986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418e8ea-43ed-4beb-8bb0-14cd8684994c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:36.997113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d29fdf-4ec4-4717-85cf-660e55674b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:36.997754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d29fdf-4ec4-4717-85cf-660e55674b07 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:36.998037 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d29fdf-4ec4-4717-85cf-660e55674b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:36.998442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d29fdf-4ec4-4717-85cf-660e55674b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:37.035405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:37.081646 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d29fdf-4ec4-4717-85cf-660e55674b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:37.083214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d29fdf-4ec4-4717-85cf-660e55674b07 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:37.201096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 605/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:58:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:58:37.207228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b996b-eca8-414c-bc7e-3fcf2015991a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:37.234041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:37.326145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b996b-eca8-414c-bc7e-3fcf2015991a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:37.374198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05057e-2acf-437b-baeb-41a811a15c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:37.375097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05057e-2acf-437b-baeb-41a811a15c35 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:37.375399 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05057e-2acf-437b-baeb-41a811a15c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:37.375642 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05057e-2acf-437b-baeb-41a811a15c35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:37.386831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05057e-2acf-437b-baeb-41a811a15c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:37.388258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05057e-2acf-437b-baeb-41a811a15c35 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-ee05057e-2acf-437b-baeb-41a811a15c35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:58:37.408156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:37.409650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:37.411027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:58:37.411027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:58:37.411027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:37.411027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:37.417609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 610/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:58:37.417776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d29fdf-4ec4-4717-85cf-660e55674b07 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:37.481170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:37.529581 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d29fdf-4ec4-4717-85cf-660e55674b07 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:37.570865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65257fe-0cf3-481c-93e0-85d074c1a307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:37.573191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65257fe-0cf3-481c-93e0-85d074c1a307 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:37.573690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65257fe-0cf3-481c-93e0-85d074c1a307 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:37.574487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65257fe-0cf3-481c-93e0-85d074c1a307 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:37.575847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65257fe-0cf3-481c-93e0-85d074c1a307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:37.576413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65257fe-0cf3-481c-93e0-85d074c1a307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:37.578448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65257fe-0cf3-481c-93e0-85d074c1a307 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:37.593180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 606/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:37.599030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05057e-2acf-437b-baeb-41a811a15c35 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:37.690391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:37.726842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05057e-2acf-437b-baeb-41a811a15c35 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:37.770275 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad1e85-4cfd-434e-b1fa-0a058113397c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:37.770275 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1e85-4cfd-434e-b1fa-0a058113397c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:37.773717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1e85-4cfd-434e-b1fa-0a058113397c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:37.773717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1e85-4cfd-434e-b1fa-0a058113397c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:37.781503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad1e85-4cfd-434e-b1fa-0a058113397c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:37.781503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad1e85-4cfd-434e-b1fa-0a058113397c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-c8ad1e85-4cfd-434e-b1fa-0a058113397c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:58:37.797929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:37.799260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:37.800334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:58:37.800334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:58:37.800334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:58:37.800334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:58:37.800334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:58:37.800334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:58:37.800334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:58:37.800334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:37.800334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 611/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:37.805460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65257fe-0cf3-481c-93e0-85d074c1a307 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:37.918284 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65257fe-0cf3-481c-93e0-85d074c1a307 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:37.945638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:37.958927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd990a-c282-4491-bcfa-e017bcb55905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:37.959638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd990a-c282-4491-bcfa-e017bcb55905 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:37.959936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd990a-c282-4491-bcfa-e017bcb55905 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:37.960279 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd990a-c282-4491-bcfa-e017bcb55905 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:37.961233 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd990a-c282-4491-bcfa-e017bcb55905 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:37.961598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd990a-c282-4491-bcfa-e017bcb55905 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:37.963727 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd990a-c282-4491-bcfa-e017bcb55905 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:37.983731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 607/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:58:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:37.985260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad1e85-4cfd-434e-b1fa-0a058113397c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:38.110935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad1e85-4cfd-434e-b1fa-0a058113397c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:38.146145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:38.155444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747f6b0-4bcd-4a91-9651-a0c08e70def3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:38.156275 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747f6b0-4bcd-4a91-9651-a0c08e70def3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:38.156714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747f6b0-4bcd-4a91-9651-a0c08e70def3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:38.157206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747f6b0-4bcd-4a91-9651-a0c08e70def3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:38.158232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747f6b0-4bcd-4a91-9651-a0c08e70def3 None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=81fb8b261e2142fcbf8d23bd010bf715) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:38.158681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747f6b0-4bcd-4a91-9651-a0c08e70def3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:38.160419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747f6b0-4bcd-4a91-9651-a0c08e70def3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:38.168303 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 612/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:58:37 2022] GET /identity/v3/role_assignments?user.id=81fb8b261e2142fcbf8d23bd010bf715&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:58:40.831870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ce507-95ca-402a-bd02-41bf28491cbc None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:40.832444 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ce507-95ca-402a-bd02-41bf28491cbc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:40.832444 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ce507-95ca-402a-bd02-41bf28491cbc None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:40.834041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 608/1220] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:58:40.839961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa987a3-2128-4f49-963f-18ff202a71f1 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:40.840435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa987a3-2128-4f49-963f-18ff202a71f1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:40.840537 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa987a3-2128-4f49-963f-18ff202a71f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:40.857130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4fa987a3-2128-4f49-963f-18ff202a71f1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:40.858301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4fa987a3-2128-4f49-963f-18ff202a71f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:40.927093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 613/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:58:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:58:40.950650 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ce507-95ca-402a-bd02-41bf28491cbc None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:41.060936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ce507-95ca-402a-bd02-41bf28491cbc None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:41.101236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d2f0c-f933-4c1c-9712-71dad0f1ca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:41.102015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d2f0c-f933-4c1c-9712-71dad0f1ca3c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:41.102341 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d2f0c-f933-4c1c-9712-71dad0f1ca3c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:41.103351 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d2f0c-f933-4c1c-9712-71dad0f1ca3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:41.115822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d2f0c-f933-4c1c-9712-71dad0f1ca3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-887d2f0c-f933-4c1c-9712-71dad0f1ca3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:58:41.125825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:41.126940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:41.128262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 609/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:41.134350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa987a3-2128-4f49-963f-18ff202a71f1 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:41.236346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa987a3-2128-4f49-963f-18ff202a71f1 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:41.263317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:41.276923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddd882-11e6-42f6-951b-176d1013db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:41.277594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddd882-11e6-42f6-951b-176d1013db48 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:41.277880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddd882-11e6-42f6-951b-176d1013db48 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:41.278156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddd882-11e6-42f6-951b-176d1013db48 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:41.278931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddd882-11e6-42f6-951b-176d1013db48 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:41.279276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddd882-11e6-42f6-951b-176d1013db48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:41.280615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddd882-11e6-42f6-951b-176d1013db48 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:41.288768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 614/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:58:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:41.295397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d2f0c-f933-4c1c-9712-71dad0f1ca3c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:41.353161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:41.415932 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d2f0c-f933-4c1c-9712-71dad0f1ca3c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:41.453432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c7ed0-01ea-457b-9aaa-411c609ef357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:41.454277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c7ed0-01ea-457b-9aaa-411c609ef357 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:41.454593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c7ed0-01ea-457b-9aaa-411c609ef357 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:41.454883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c7ed0-01ea-457b-9aaa-411c609ef357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:41.466767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c7ed0-01ea-457b-9aaa-411c609ef357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:41.468283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c7ed0-01ea-457b-9aaa-411c609ef357 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-b97c7ed0-01ea-457b-9aaa-411c609ef357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:58:41.486865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:41.487921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:41.489178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:58:41.489178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:58:41.489178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:41.489178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:41.489178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 610/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:41.493823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddd882-11e6-42f6-951b-176d1013db48 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:41.615835 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddd882-11e6-42f6-951b-176d1013db48 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:41.654231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49aed3-030c-46e9-ab15-1b1b711289d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:41.654931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49aed3-030c-46e9-ab15-1b1b711289d2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:41.655222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49aed3-030c-46e9-ab15-1b1b711289d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:41.655509 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49aed3-030c-46e9-ab15-1b1b711289d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:41.656239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49aed3-030c-46e9-ab15-1b1b711289d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:41.656550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49aed3-030c-46e9-ab15-1b1b711289d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:41.657913 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49aed3-030c-46e9-ab15-1b1b711289d2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:41.671859 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 615/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:41.677635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c7ed0-01ea-457b-9aaa-411c609ef357 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:41.783895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:41.792430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c7ed0-01ea-457b-9aaa-411c609ef357 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:41.831797 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b106317-730a-4f09-9915-48679e209122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:41.832816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b106317-730a-4f09-9915-48679e209122 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:41.833386 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b106317-730a-4f09-9915-48679e209122 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:41.833386 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b106317-730a-4f09-9915-48679e209122 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:41.845354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b106317-730a-4f09-9915-48679e209122 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:41.847129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b106317-730a-4f09-9915-48679e209122 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6b106317-730a-4f09-9915-48679e209122 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:58:41.862511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:41.863553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:41.864671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:41.864671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:41.864671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:58:41.864671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:58:41.864671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:58:41.864671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:58:41.864671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:58:41.864671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:58:41.864671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 16:58:41.864671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:41.864671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 611/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:41.871158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49aed3-030c-46e9-ab15-1b1b711289d2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:41.922505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:41.982264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49aed3-030c-46e9-ab15-1b1b711289d2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:42.019761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3094329-1ed6-4577-a29d-91632c5311e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:42.020430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3094329-1ed6-4577-a29d-91632c5311e1 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:42.020710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3094329-1ed6-4577-a29d-91632c5311e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:42.020991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3094329-1ed6-4577-a29d-91632c5311e1 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:42.021828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3094329-1ed6-4577-a29d-91632c5311e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:42.022138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3094329-1ed6-4577-a29d-91632c5311e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:42.023596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3094329-1ed6-4577-a29d-91632c5311e1 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:42.042325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 616/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Mon May 23 16:58:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:42.048167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b106317-730a-4f09-9915-48679e209122 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:42.158328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b106317-730a-4f09-9915-48679e209122 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:42.199728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2f7ec-bf03-4a35-ad8c-c852b501ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:42.201030 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2f7ec-bf03-4a35-ad8c-c852b501ad24 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:42.201517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2f7ec-bf03-4a35-ad8c-c852b501ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:42.201998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2f7ec-bf03-4a35-ad8c-c852b501ad24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:42.220025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2f7ec-bf03-4a35-ad8c-c852b501ad24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:42.222144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2f7ec-bf03-4a35-ad8c-c852b501ad24 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-37d2f7ec-bf03-4a35-ad8c-c852b501ad24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:58:42.242478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:42.244208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:42.245294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:58:42.245294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:58:42.245294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:42.245294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:42.245294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 612/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:42.250847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3094329-1ed6-4577-a29d-91632c5311e1 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:42.364650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3094329-1ed6-4577-a29d-91632c5311e1 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:42.367155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:42.403233 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee7b13-1a44-47b2-84ef-84f14fc12396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:42.404015 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee7b13-1a44-47b2-84ef-84f14fc12396 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:42.404329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee7b13-1a44-47b2-84ef-84f14fc12396 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:42.404608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee7b13-1a44-47b2-84ef-84f14fc12396 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:42.405371 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee7b13-1a44-47b2-84ef-84f14fc12396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:42.405674 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee7b13-1a44-47b2-84ef-84f14fc12396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:42.407232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee7b13-1a44-47b2-84ef-84f14fc12396 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:42.420377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 617/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:42.426172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2f7ec-bf03-4a35-ad8c-c852b501ad24 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:42.436791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:42.533946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2f7ec-bf03-4a35-ad8c-c852b501ad24 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:42.573529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cc733-8e5c-4055-b5ec-e3be424a55f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:42.574659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc733-8e5c-4055-b5ec-e3be424a55f6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:42.574960 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc733-8e5c-4055-b5ec-e3be424a55f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:42.575242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc733-8e5c-4055-b5ec-e3be424a55f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:42.582444 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cc733-8e5c-4055-b5ec-e3be424a55f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:42.583896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cc733-8e5c-4055-b5ec-e3be424a55f6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-f44cc733-8e5c-4055-b5ec-e3be424a55f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:58:42.603776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:42.605095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:42.606212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:58:42.606212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:58:42.606212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:58:42.606212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:58:42.606212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:58:42.606212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:58:42.606212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:58:42.606212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:42.606212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 613/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:58:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:42.611286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee7b13-1a44-47b2-84ef-84f14fc12396 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:42.728263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee7b13-1a44-47b2-84ef-84f14fc12396 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:42.763686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e1c6a-29da-4b91-aff8-3caecec4b426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:42.764350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e1c6a-29da-4b91-aff8-3caecec4b426 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:42.764626 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e1c6a-29da-4b91-aff8-3caecec4b426 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:42.764907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e1c6a-29da-4b91-aff8-3caecec4b426 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:42.765685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e1c6a-29da-4b91-aff8-3caecec4b426 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:42.765992 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e1c6a-29da-4b91-aff8-3caecec4b426 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:42.767439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e1c6a-29da-4b91-aff8-3caecec4b426 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:42.781321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 618/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:58:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:42.787668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cc733-8e5c-4055-b5ec-e3be424a55f6 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:42.858656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:42.896437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cc733-8e5c-4055-b5ec-e3be424a55f6 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:42.933772 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b61553-8bda-4126-a4e1-6c6751f763b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:42.934693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b61553-8bda-4126-a4e1-6c6751f763b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:42.934977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b61553-8bda-4126-a4e1-6c6751f763b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:42.935254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b61553-8bda-4126-a4e1-6c6751f763b0 None admin] PATH_INFO: `/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/81fb8b261e2142fcbf8d23bd010bf715/roles/3d6cf7264f664a20a5a635d4d11c3e1a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:42.950471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b61553-8bda-4126-a4e1-6c6751f763b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=733d8651e4a74a2ab694091d9fd83e49, user_id=81fb8b261e2142fcbf8d23bd010bf715, role_id=3d6cf7264f664a20a5a635d4d11c3e1a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:42.951904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b61553-8bda-4126-a4e1-6c6751f763b0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:42.965487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 614/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:58:42 2022] PUT /identity/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/81fb8b261e2142fcbf8d23bd010bf715/roles/3d6cf7264f664a20a5a635d4d11c3e1a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:58:45.381418 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad91453-80b7-4350-9be7-0f9eb4c11b2e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:45.382030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad91453-80b7-4350-9be7-0f9eb4c11b2e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:45.382030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad91453-80b7-4350-9be7-0f9eb4c11b2e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:45.383469 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 619/1233] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:58:45.389593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2600f-735f-4dd8-9352-cb7786627d44 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:45.390250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2600f-735f-4dd8-9352-cb7786627d44 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:45.390692 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2600f-735f-4dd8-9352-cb7786627d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:45.409851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-edf2600f-735f-4dd8-9352-cb7786627d44 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:45.411095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-edf2600f-735f-4dd8-9352-cb7786627d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:45.491245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 615/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:58:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:58:45.515236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad91453-80b7-4350-9be7-0f9eb4c11b2e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:45.554187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:45.648738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad91453-80b7-4350-9be7-0f9eb4c11b2e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:45.686327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab124b-0167-47e5-a7f3-a6ff31d65a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:45.687242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab124b-0167-47e5-a7f3-a6ff31d65a28 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:45.687458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab124b-0167-47e5-a7f3-a6ff31d65a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:45.687818 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab124b-0167-47e5-a7f3-a6ff31d65a28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:45.698513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab124b-0167-47e5-a7f3-a6ff31d65a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-d2ab124b-0167-47e5-a7f3-a6ff31d65a28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:58:45.706336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:45.707527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:45.714150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 620/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Mon May 23 16:58:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:45.714994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2600f-735f-4dd8-9352-cb7786627d44 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:45.769919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:45.838553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2600f-735f-4dd8-9352-cb7786627d44 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:45.894568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f268d7-aac0-47a8-b930-c3b53d365a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:45.895830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f268d7-aac0-47a8-b930-c3b53d365a96 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:45.896340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f268d7-aac0-47a8-b930-c3b53d365a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:45.896962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f268d7-aac0-47a8-b930-c3b53d365a96 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:45.898530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f268d7-aac0-47a8-b930-c3b53d365a96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:45.899254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f268d7-aac0-47a8-b930-c3b53d365a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:45.902382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f268d7-aac0-47a8-b930-c3b53d365a96 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:45.920435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 616/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Mon May 23 16:58:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:45.921907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab124b-0167-47e5-a7f3-a6ff31d65a28 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:46.016858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:46.035537 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab124b-0167-47e5-a7f3-a6ff31d65a28 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:46.073928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4de98-a099-4dc2-ac78-cf2f7303ab48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:46.075036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4de98-a099-4dc2-ac78-cf2f7303ab48 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:46.075321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4de98-a099-4dc2-ac78-cf2f7303ab48 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:46.075594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4de98-a099-4dc2-ac78-cf2f7303ab48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:46.088646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4de98-a099-4dc2-ac78-cf2f7303ab48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:46.090092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4de98-a099-4dc2-ac78-cf2f7303ab48 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-ede4de98-a099-4dc2-ac78-cf2f7303ab48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:58:46.107589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:46.108683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:46.109981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:58:46.109981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:58:46.109981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:46.109981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:46.109981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 621/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:46.114967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f268d7-aac0-47a8-b930-c3b53d365a96 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:46.237215 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f268d7-aac0-47a8-b930-c3b53d365a96 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:46.248901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:46.276358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9f4e4-aec9-4b54-915d-1ebf93875ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:46.277341 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9f4e4-aec9-4b54-915d-1ebf93875ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:46.277583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9f4e4-aec9-4b54-915d-1ebf93875ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:46.277853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9f4e4-aec9-4b54-915d-1ebf93875ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:46.278638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9f4e4-aec9-4b54-915d-1ebf93875ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:46.279036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9f4e4-aec9-4b54-915d-1ebf93875ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:46.280296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9f4e4-aec9-4b54-915d-1ebf93875ca7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:46.294480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 617/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:46.300388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4de98-a099-4dc2-ac78-cf2f7303ab48 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:46.423037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4de98-a099-4dc2-ac78-cf2f7303ab48 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:46.461105 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e2dfb-f227-4254-a754-da327eb980e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:46.462523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e2dfb-f227-4254-a754-da327eb980e3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:46.462844 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e2dfb-f227-4254-a754-da327eb980e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:46.463099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e2dfb-f227-4254-a754-da327eb980e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:46.466201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:46.472266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e2dfb-f227-4254-a754-da327eb980e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:46.473763 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e2dfb-f227-4254-a754-da327eb980e3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-186e2dfb-f227-4254-a754-da327eb980e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:58:46.490080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:46.491270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:46.492415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:46.492415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:46.492415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:58:46.492415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:58:46.492415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:58:46.492415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:58:46.492415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:58:46.492415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:58:46.492415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 16:58:46.492415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:46.492415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 622/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:58:46.497314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9f4e4-aec9-4b54-915d-1ebf93875ca7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:46.614713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9f4e4-aec9-4b54-915d-1ebf93875ca7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:46.653477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af124f-5f0e-4084-bf63-7fe2e27679b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:46.654174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af124f-5f0e-4084-bf63-7fe2e27679b5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:46.654490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af124f-5f0e-4084-bf63-7fe2e27679b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:46.654771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af124f-5f0e-4084-bf63-7fe2e27679b5 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:46.655766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af124f-5f0e-4084-bf63-7fe2e27679b5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:46.656084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af124f-5f0e-4084-bf63-7fe2e27679b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:46.657527 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af124f-5f0e-4084-bf63-7fe2e27679b5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:46.682235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 618/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Mon May 23 16:58:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:46.683902 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e2dfb-f227-4254-a754-da327eb980e3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:46.798986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e2dfb-f227-4254-a754-da327eb980e3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:46.836328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f722bf-3dfe-4530-a756-3b3b12e59bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:46.837030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f722bf-3dfe-4530-a756-3b3b12e59bca None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:46.837323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f722bf-3dfe-4530-a756-3b3b12e59bca None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:46.837595 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f722bf-3dfe-4530-a756-3b3b12e59bca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:46.904977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:46.912196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f722bf-3dfe-4530-a756-3b3b12e59bca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:46.913943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f722bf-3dfe-4530-a756-3b3b12e59bca None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:47.034512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 623/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:58:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:58:47.041024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af124f-5f0e-4084-bf63-7fe2e27679b5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:47.068147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:47.148864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af124f-5f0e-4084-bf63-7fe2e27679b5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:47.187512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27f85c-2cac-4d51-a441-efcd87ba543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:47.188346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27f85c-2cac-4d51-a441-efcd87ba543d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:47.188632 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27f85c-2cac-4d51-a441-efcd87ba543d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:47.188916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27f85c-2cac-4d51-a441-efcd87ba543d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:47.200049 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27f85c-2cac-4d51-a441-efcd87ba543d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:47.201635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27f85c-2cac-4d51-a441-efcd87ba543d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ca27f85c-2cac-4d51-a441-efcd87ba543d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:58:47.220525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:47.221471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:47.222430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:58:47.222430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:58:47.222430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:47.222430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:47.222430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 619/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:47.227554 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f722bf-3dfe-4530-a756-3b3b12e59bca None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:47.338295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:47.345873 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f722bf-3dfe-4530-a756-3b3b12e59bca None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:47.387793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fc277-2adb-498a-964c-927bdc2303f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:47.388531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fc277-2adb-498a-964c-927bdc2303f3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:47.388820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fc277-2adb-498a-964c-927bdc2303f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:47.389097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fc277-2adb-498a-964c-927bdc2303f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:47.389819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fc277-2adb-498a-964c-927bdc2303f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:47.390125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fc277-2adb-498a-964c-927bdc2303f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:47.391517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fc277-2adb-498a-964c-927bdc2303f3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:47.404286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 624/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:47.410452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27f85c-2cac-4d51-a441-efcd87ba543d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:47.503407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:47.527326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27f85c-2cac-4d51-a441-efcd87ba543d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:47.573890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5814a50-ba11-4f97-9b63-d2fedd61c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:47.575045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5814a50-ba11-4f97-9b63-d2fedd61c545 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:47.575347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5814a50-ba11-4f97-9b63-d2fedd61c545 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:47.575629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5814a50-ba11-4f97-9b63-d2fedd61c545 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:47.583317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5814a50-ba11-4f97-9b63-d2fedd61c545 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:47.584767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5814a50-ba11-4f97-9b63-d2fedd61c545 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c5814a50-ba11-4f97-9b63-d2fedd61c545 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:58:47.604432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:47.605702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:47.606738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:58:47.606738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:58:47.606738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:58:47.606738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:58:47.606738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:58:47.606738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:58:47.606738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:58:47.606738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:47.606738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 620/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:47.612448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fc277-2adb-498a-964c-927bdc2303f3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:47.726517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fc277-2adb-498a-964c-927bdc2303f3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:47.763077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc99398-0c4e-41ae-ba1e-b384f4f06068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:47.763888 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99398-0c4e-41ae-ba1e-b384f4f06068 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:47.764168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99398-0c4e-41ae-ba1e-b384f4f06068 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:47.764490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99398-0c4e-41ae-ba1e-b384f4f06068 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:47.765425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc99398-0c4e-41ae-ba1e-b384f4f06068 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:47.765816 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc99398-0c4e-41ae-ba1e-b384f4f06068 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:47.767283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc99398-0c4e-41ae-ba1e-b384f4f06068 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:47.780928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 625/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:47.787311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5814a50-ba11-4f97-9b63-d2fedd61c545 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:47.896516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5814a50-ba11-4f97-9b63-d2fedd61c545 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:47.934222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d4f0d-ed24-449c-b3e2-fea682a1706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:47.934913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d4f0d-ed24-449c-b3e2-fea682a1706f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:47.935201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d4f0d-ed24-449c-b3e2-fea682a1706f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:47.935479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d4f0d-ed24-449c-b3e2-fea682a1706f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:47.936329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d4f0d-ed24-449c-b3e2-fea682a1706f None admin] RBAC: Adding query filter params (role.id=3d6cf7264f664a20a5a635d4d11c3e1a, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=81fb8b261e2142fcbf8d23bd010bf715) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:47.936639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d4f0d-ed24-449c-b3e2-fea682a1706f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:47.938074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d4f0d-ed24-449c-b3e2-fea682a1706f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:47.945172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 621/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:58:47 2022] GET /identity/v3/role_assignments?user.id=81fb8b261e2142fcbf8d23bd010bf715&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=3d6cf7264f664a20a5a635d4d11c3e1a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:50.304896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e178022-6cad-4037-8195-62713e0de876 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:50.306011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e178022-6cad-4037-8195-62713e0de876 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:50.306011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e178022-6cad-4037-8195-62713e0de876 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:50.307515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 626/1247] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:58:50.312965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5d3eb-c723-40e5-a957-e2fc0c8b372a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:50.313512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5d3eb-c723-40e5-a957-e2fc0c8b372a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:50.313512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5d3eb-c723-40e5-a957-e2fc0c8b372a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:50.318861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:50.333985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c9f5d3eb-c723-40e5-a957-e2fc0c8b372a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:50.335383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c9f5d3eb-c723-40e5-a957-e2fc0c8b372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:50.411992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 622/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:58:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:58:50.435509 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e178022-6cad-4037-8195-62713e0de876 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:50.455049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:50.557633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e178022-6cad-4037-8195-62713e0de876 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:50.601781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4326f28-6aa9-4079-b22b-a7fcc564e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:50.602989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4326f28-6aa9-4079-b22b-a7fcc564e040 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:50.603331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4326f28-6aa9-4079-b22b-a7fcc564e040 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:50.603701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4326f28-6aa9-4079-b22b-a7fcc564e040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:50.615394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4326f28-6aa9-4079-b22b-a7fcc564e040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-a4326f28-6aa9-4079-b22b-a7fcc564e040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:58:50.623993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:50.625161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:50.626677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 627/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:58:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:58:50.632181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5d3eb-c723-40e5-a957-e2fc0c8b372a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:50.742171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5d3eb-c723-40e5-a957-e2fc0c8b372a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:50.778685 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:50.783831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815eb0a-1849-4fd8-85c1-ab6e77a703d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:50.784659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815eb0a-1849-4fd8-85c1-ab6e77a703d6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:50.786528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815eb0a-1849-4fd8-85c1-ab6e77a703d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:50.787283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815eb0a-1849-4fd8-85c1-ab6e77a703d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:50.788232 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815eb0a-1849-4fd8-85c1-ab6e77a703d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:50.788562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815eb0a-1849-4fd8-85c1-ab6e77a703d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:50.789968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815eb0a-1849-4fd8-85c1-ab6e77a703d6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:50.798782 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 623/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:58:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:58:50.804558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4326f28-6aa9-4079-b22b-a7fcc564e040 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:50.898456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:50.924663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4326f28-6aa9-4079-b22b-a7fcc564e040 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:50.965371 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1b5b-3206-4e66-ba4d-ad02a67f0fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:50.966439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1b5b-3206-4e66-ba4d-ad02a67f0fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:50.966832 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1b5b-3206-4e66-ba4d-ad02a67f0fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:50.967169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1b5b-3206-4e66-ba4d-ad02a67f0fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:50.980786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1b5b-3206-4e66-ba4d-ad02a67f0fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:50.982266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1b5b-3206-4e66-ba4d-ad02a67f0fd2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-df5d1b5b-3206-4e66-ba4d-ad02a67f0fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:58:51.003544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:51.004637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:51.005758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:58:51.005758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:58:51.005758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:51.005758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:51.005758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 628/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:51.012893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815eb0a-1849-4fd8-85c1-ab6e77a703d6 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:51.130959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815eb0a-1849-4fd8-85c1-ab6e77a703d6 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:51.166559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb9f0b-dc59-45c7-996d-1fa97fb9046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:51.167185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb9f0b-dc59-45c7-996d-1fa97fb9046c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:51.167484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb9f0b-dc59-45c7-996d-1fa97fb9046c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:51.167751 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb9f0b-dc59-45c7-996d-1fa97fb9046c None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:51.168481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb9f0b-dc59-45c7-996d-1fa97fb9046c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:51.168791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb9f0b-dc59-45c7-996d-1fa97fb9046c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:51.170160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb9f0b-dc59-45c7-996d-1fa97fb9046c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:51.184243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 624/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:51.189974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1b5b-3206-4e66-ba4d-ad02a67f0fd2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:51.297377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1b5b-3206-4e66-ba4d-ad02a67f0fd2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:51.327225 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:51.335736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953034b7-d0aa-43f3-8567-91fc51fcef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:51.336568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953034b7-d0aa-43f3-8567-91fc51fcef30 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:51.337392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953034b7-d0aa-43f3-8567-91fc51fcef30 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:51.337669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953034b7-d0aa-43f3-8567-91fc51fcef30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:51.346163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953034b7-d0aa-43f3-8567-91fc51fcef30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:51.348052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953034b7-d0aa-43f3-8567-91fc51fcef30 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-953034b7-d0aa-43f3-8567-91fc51fcef30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:58:51.366189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:51.367389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:51.368826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:51.368826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:51.368826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:58:51.368826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:58:51.368826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:58:51.368826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:58:51.368826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:58:51.368826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:58:51.368826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 16:58:51.368826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:51.368826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 629/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:51.374066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb9f0b-dc59-45c7-996d-1fa97fb9046c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:51.437019 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:51.487469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb9f0b-dc59-45c7-996d-1fa97fb9046c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:51.530710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a625b-b387-45da-b364-b040c7c6da39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:51.531887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a625b-b387-45da-b364-b040c7c6da39 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:51.532329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a625b-b387-45da-b364-b040c7c6da39 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:51.532823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a625b-b387-45da-b364-b040c7c6da39 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:51.534309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a625b-b387-45da-b364-b040c7c6da39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:51.534810 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a625b-b387-45da-b364-b040c7c6da39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:51.536901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a625b-b387-45da-b364-b040c7c6da39 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:51.563009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 625/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Mon May 23 16:58:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:51.568876 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953034b7-d0aa-43f3-8567-91fc51fcef30 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:51.682725 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953034b7-d0aa-43f3-8567-91fc51fcef30 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:51.724394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20318ee-8c34-44aa-ac3a-cc8849e73fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:51.725414 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20318ee-8c34-44aa-ac3a-cc8849e73fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:51.725956 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20318ee-8c34-44aa-ac3a-cc8849e73fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:51.726443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20318ee-8c34-44aa-ac3a-cc8849e73fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:51.794004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:51.808990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20318ee-8c34-44aa-ac3a-cc8849e73fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:51.810544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20318ee-8c34-44aa-ac3a-cc8849e73fa4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:51.918153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 630/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:58:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:58:51.924192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a625b-b387-45da-b364-b040c7c6da39 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:52.031356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a625b-b387-45da-b364-b040c7c6da39 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:52.046874 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:52.068947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60500b28-6092-4ceb-bbbc-707a0e99929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:52.069763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60500b28-6092-4ceb-bbbc-707a0e99929e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:52.070086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60500b28-6092-4ceb-bbbc-707a0e99929e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:52.070388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60500b28-6092-4ceb-bbbc-707a0e99929e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:52.082604 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60500b28-6092-4ceb-bbbc-707a0e99929e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:52.084062 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60500b28-6092-4ceb-bbbc-707a0e99929e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-60500b28-6092-4ceb-bbbc-707a0e99929e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:58:52.104235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:52.105378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:52.106422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:58:52.106422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:58:52.106422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:52.106422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:52.106422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 626/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:52.111519 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20318ee-8c34-44aa-ac3a-cc8849e73fa4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:52.204683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:52.217440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20318ee-8c34-44aa-ac3a-cc8849e73fa4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:52.255483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d6442-48f1-4375-9fe3-fda4f07d7e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:52.256151 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d6442-48f1-4375-9fe3-fda4f07d7e64 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:52.256439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d6442-48f1-4375-9fe3-fda4f07d7e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:52.256716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d6442-48f1-4375-9fe3-fda4f07d7e64 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:52.257438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d6442-48f1-4375-9fe3-fda4f07d7e64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:52.257747 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d6442-48f1-4375-9fe3-fda4f07d7e64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:52.259723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d6442-48f1-4375-9fe3-fda4f07d7e64 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:52.271096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 631/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:52.276825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60500b28-6092-4ceb-bbbc-707a0e99929e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:52.381138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60500b28-6092-4ceb-bbbc-707a0e99929e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:52.417903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def5196-b66d-4e7f-9c72-1d0b6abf6bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:52.418732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def5196-b66d-4e7f-9c72-1d0b6abf6bcc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:52.419022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def5196-b66d-4e7f-9c72-1d0b6abf6bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:52.419297 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def5196-b66d-4e7f-9c72-1d0b6abf6bcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:52.426150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def5196-b66d-4e7f-9c72-1d0b6abf6bcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:52.427660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def5196-b66d-4e7f-9c72-1d0b6abf6bcc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6def5196-b66d-4e7f-9c72-1d0b6abf6bcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:58:52.442006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:52.443184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:52.444287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:58:52.444287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:58:52.444287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:58:52.444287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:58:52.444287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:58:52.444287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:58:52.444287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:58:52.444287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:52.444287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 627/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:52.449595 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d6442-48f1-4375-9fe3-fda4f07d7e64 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:52.556526 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d6442-48f1-4375-9fe3-fda4f07d7e64 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:52.595043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f9244-5f64-4c89-9631-750ad3f55684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:52.595696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f9244-5f64-4c89-9631-750ad3f55684 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:52.595978 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f9244-5f64-4c89-9631-750ad3f55684 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:52.596313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f9244-5f64-4c89-9631-750ad3f55684 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:52.597091 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f9244-5f64-4c89-9631-750ad3f55684 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:52.597407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f9244-5f64-4c89-9631-750ad3f55684 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:52.598858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f9244-5f64-4c89-9631-750ad3f55684 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:52.610677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 632/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:52.616692 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def5196-b66d-4e7f-9c72-1d0b6abf6bcc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:52.642484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:52.716076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def5196-b66d-4e7f-9c72-1d0b6abf6bcc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:52.748029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e27e6-f456-446f-b892-e3f00d2c542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:52.748668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e27e6-f456-446f-b892-e3f00d2c542a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:52.748956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e27e6-f456-446f-b892-e3f00d2c542a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:52.749237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e27e6-f456-446f-b892-e3f00d2c542a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:52.750074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e27e6-f456-446f-b892-e3f00d2c542a None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=81fb8b261e2142fcbf8d23bd010bf715) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:52.750410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e27e6-f456-446f-b892-e3f00d2c542a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:52.751852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e27e6-f456-446f-b892-e3f00d2c542a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:52.757126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 628/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:58:52 2022] GET /identity/v3/role_assignments?user.id=81fb8b261e2142fcbf8d23bd010bf715&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:54.928991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c841aa-78f9-45f8-9774-075518d3121f None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:54.929531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c841aa-78f9-45f8-9774-075518d3121f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:54.929531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c841aa-78f9-45f8-9774-075518d3121f None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:54.931642 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 633/1261] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:58:54.936872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71bf9d-1294-4537-ba07-c6f9d3087507 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:54.937300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71bf9d-1294-4537-ba07-c6f9d3087507 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:54.937438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71bf9d-1294-4537-ba07-c6f9d3087507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:54.954156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5f71bf9d-1294-4537-ba07-c6f9d3087507 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:54.955360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5f71bf9d-1294-4537-ba07-c6f9d3087507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:55.020613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 629/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:58:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:58:55.043895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c841aa-78f9-45f8-9774-075518d3121f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:55.054626 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:55.144235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c841aa-78f9-45f8-9774-075518d3121f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:55.177035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b771c6-a025-427c-a799-5db528836579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:55.177815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b771c6-a025-427c-a799-5db528836579 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:55.178104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b771c6-a025-427c-a799-5db528836579 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:55.178408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b771c6-a025-427c-a799-5db528836579 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:55.188535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b771c6-a025-427c-a799-5db528836579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e2b771c6-a025-427c-a799-5db528836579 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:58:55.196214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:55.197295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:55.198326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 634/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:55.203570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71bf9d-1294-4537-ba07-c6f9d3087507 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:55.221987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:55.301688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71bf9d-1294-4537-ba07-c6f9d3087507 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:55.334089 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811222d1-7e30-4d6e-b6f1-a6f407e478ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:55.334771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811222d1-7e30-4d6e-b6f1-a6f407e478ce None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:55.335061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811222d1-7e30-4d6e-b6f1-a6f407e478ce None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:55.335339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811222d1-7e30-4d6e-b6f1-a6f407e478ce None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:55.336090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811222d1-7e30-4d6e-b6f1-a6f407e478ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:55.336403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811222d1-7e30-4d6e-b6f1-a6f407e478ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:55.338391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811222d1-7e30-4d6e-b6f1-a6f407e478ce None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:55.346349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 630/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:55.352099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b771c6-a025-427c-a799-5db528836579 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:55.416994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:55.448964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b771c6-a025-427c-a799-5db528836579 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:55.482124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4577013-15c1-4c3f-b70d-77fc9ffc50f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:55.482927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4577013-15c1-4c3f-b70d-77fc9ffc50f1 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:55.483219 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4577013-15c1-4c3f-b70d-77fc9ffc50f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:55.483494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4577013-15c1-4c3f-b70d-77fc9ffc50f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:55.493748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4577013-15c1-4c3f-b70d-77fc9ffc50f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:55.495207 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4577013-15c1-4c3f-b70d-77fc9ffc50f1 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b4577013-15c1-4c3f-b70d-77fc9ffc50f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:58:55.511819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:55.513013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:55.514112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:58:55.514112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:58:55.514112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:55.514112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:55.514112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 635/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:55.519867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811222d1-7e30-4d6e-b6f1-a6f407e478ce None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:55.608880 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:55.627721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811222d1-7e30-4d6e-b6f1-a6f407e478ce None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:55.660818 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460544a-c7bb-4be6-8f85-f09c5d8306d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:55.661473 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460544a-c7bb-4be6-8f85-f09c5d8306d2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:55.661754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460544a-c7bb-4be6-8f85-f09c5d8306d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:55.662026 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460544a-c7bb-4be6-8f85-f09c5d8306d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:55.662765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460544a-c7bb-4be6-8f85-f09c5d8306d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:55.663069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460544a-c7bb-4be6-8f85-f09c5d8306d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:55.664417 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460544a-c7bb-4be6-8f85-f09c5d8306d2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:55.675855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 631/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:58:55.681840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4577013-15c1-4c3f-b70d-77fc9ffc50f1 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:55.780649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4577013-15c1-4c3f-b70d-77fc9ffc50f1 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:55.800212 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:55.814094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf7677-aa4a-451b-902b-4fc6246ffa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:55.815186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf7677-aa4a-451b-902b-4fc6246ffa91 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:55.815344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf7677-aa4a-451b-902b-4fc6246ffa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:55.815622 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf7677-aa4a-451b-902b-4fc6246ffa91 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:55.823539 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf7677-aa4a-451b-902b-4fc6246ffa91 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:55.825230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf7677-aa4a-451b-902b-4fc6246ffa91 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-65bf7677-aa4a-451b-902b-4fc6246ffa91 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:58:55.839703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:55.840813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:55.842004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:55.842004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:55.842004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:58:55.842004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:58:55.842004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:58:55.842004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:58:55.842004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:58:55.842004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:58:55.842004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 16:58:55.842004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:55.842004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 636/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:55.846720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460544a-c7bb-4be6-8f85-f09c5d8306d2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:55.943813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460544a-c7bb-4be6-8f85-f09c5d8306d2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:55.977185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b9494-374a-4030-8581-181cfc964411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:55.977878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b9494-374a-4030-8581-181cfc964411 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:55.978168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b9494-374a-4030-8581-181cfc964411 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:55.978478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b9494-374a-4030-8581-181cfc964411 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:55.979324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b9494-374a-4030-8581-181cfc964411 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:55.979637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b9494-374a-4030-8581-181cfc964411 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:55.981056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b9494-374a-4030-8581-181cfc964411 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:55.989361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:55.998354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 632/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Mon May 23 16:58:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:56.004050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf7677-aa4a-451b-902b-4fc6246ffa91 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:56.108611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf7677-aa4a-451b-902b-4fc6246ffa91 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:56.140562 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb6a20-ceaa-41b9-888e-6d6637bdbf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:56.141345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb6a20-ceaa-41b9-888e-6d6637bdbf1f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:56.141630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb6a20-ceaa-41b9-888e-6d6637bdbf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:56.141908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb6a20-ceaa-41b9-888e-6d6637bdbf1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:56.152581 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb6a20-ceaa-41b9-888e-6d6637bdbf1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:56.154003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb6a20-ceaa-41b9-888e-6d6637bdbf1f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-0ebb6a20-ceaa-41b9-888e-6d6637bdbf1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:58:56.171031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:56.172096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:56.173050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:58:56.173050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:58:56.173050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:56.173050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:56.173050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 637/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:56.177894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b9494-374a-4030-8581-181cfc964411 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:56.273730 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b9494-374a-4030-8581-181cfc964411 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:56.307013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03907340-b9ca-4eae-8857-8458b5da84da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:56.307657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03907340-b9ca-4eae-8857-8458b5da84da None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:56.307942 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03907340-b9ca-4eae-8857-8458b5da84da None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:56.308218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03907340-b9ca-4eae-8857-8458b5da84da None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:56.308935 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03907340-b9ca-4eae-8857-8458b5da84da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:56.309243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03907340-b9ca-4eae-8857-8458b5da84da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:56.310615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03907340-b9ca-4eae-8857-8458b5da84da None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:56.322320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 633/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:56.327985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb6a20-ceaa-41b9-888e-6d6637bdbf1f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:56.360969 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:56.440023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb6a20-ceaa-41b9-888e-6d6637bdbf1f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:56.473341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66955232-dbd8-4945-bfce-3dd176bea236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:56.474121 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66955232-dbd8-4945-bfce-3dd176bea236 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:56.474428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66955232-dbd8-4945-bfce-3dd176bea236 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:56.474704 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66955232-dbd8-4945-bfce-3dd176bea236 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:56.481367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66955232-dbd8-4945-bfce-3dd176bea236 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:56.482807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66955232-dbd8-4945-bfce-3dd176bea236 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-66955232-dbd8-4945-bfce-3dd176bea236 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:58:56.496775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:56.497815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:56.498802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:58:56.498802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:58:56.498802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:58:56.498802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:58:56.498802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:58:56.498802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:58:56.498802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:58:56.498802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:58:56.498802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 638/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:56.503946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03907340-b9ca-4eae-8857-8458b5da84da None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:56.568378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:56.610019 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03907340-b9ca-4eae-8857-8458b5da84da None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:56.642572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774608aa-c93d-4361-a678-f88c6aa6cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:56.643227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774608aa-c93d-4361-a678-f88c6aa6cb18 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:56.643514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774608aa-c93d-4361-a678-f88c6aa6cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:56.643794 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774608aa-c93d-4361-a678-f88c6aa6cb18 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:56.644577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774608aa-c93d-4361-a678-f88c6aa6cb18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:56.644891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774608aa-c93d-4361-a678-f88c6aa6cb18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:56.646331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774608aa-c93d-4361-a678-f88c6aa6cb18 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:56.658946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 634/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:56.665079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66955232-dbd8-4945-bfce-3dd176bea236 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:56.764124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:56.773184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66955232-dbd8-4945-bfce-3dd176bea236 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:56.807001 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b0885-bd00-444a-9349-91d23fbc5329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:56.807891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b0885-bd00-444a-9349-91d23fbc5329 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:56.808175 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b0885-bd00-444a-9349-91d23fbc5329 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:56.808448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b0885-bd00-444a-9349-91d23fbc5329 None admin] PATH_INFO: `/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/81fb8b261e2142fcbf8d23bd010bf715/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:56.810397 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b0885-bd00-444a-9349-91d23fbc5329 None admin] RBAC: Authorizing `identity:create_grant(project_id=733d8651e4a74a2ab694091d9fd83e49, user_id=81fb8b261e2142fcbf8d23bd010bf715, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:56.811818 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b0885-bd00-444a-9349-91d23fbc5329 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:56.825174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 639/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Mon May 23 16:58:56 2022] PUT /identity/v3/projects/733d8651e4a74a2ab694091d9fd83e49/users/81fb8b261e2142fcbf8d23bd010bf715/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:58:59.149707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69252c-7bad-4411-875f-3209efe802d5 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:59.150228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69252c-7bad-4411-875f-3209efe802d5 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:59.150404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69252c-7bad-4411-875f-3209efe802d5 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:59.151888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 635/1274] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:58:59.157268 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269fb49-dd58-4325-9b7e-393f15f37ac8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:59.157690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269fb49-dd58-4325-9b7e-393f15f37ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:59.157824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269fb49-dd58-4325-9b7e-393f15f37ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:59.175315 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1269fb49-dd58-4325-9b7e-393f15f37ac8 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:59.176510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1269fb49-dd58-4325-9b7e-393f15f37ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:59.240252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 640/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:58:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:58:59.264661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69252c-7bad-4411-875f-3209efe802d5 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:59.367188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69252c-7bad-4411-875f-3209efe802d5 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:59.386631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:59.403329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e79af-d86f-4c71-9159-e854b1f43d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:59.404048 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e79af-d86f-4c71-9159-e854b1f43d31 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:59.404327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e79af-d86f-4c71-9159-e854b1f43d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:59.404598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e79af-d86f-4c71-9159-e854b1f43d31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:59.414301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e79af-d86f-4c71-9159-e854b1f43d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c81e79af-d86f-4c71-9159-e854b1f43d31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:58:59.422660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:59.423741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:59.424647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 636/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Mon May 23 16:58:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:59.429770 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269fb49-dd58-4325-9b7e-393f15f37ac8 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:59.509450 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:59.529131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269fb49-dd58-4325-9b7e-393f15f37ac8 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:59.566194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17aecf-e538-448e-8776-be0fcde0e224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:59.566905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17aecf-e538-448e-8776-be0fcde0e224 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:59.567168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17aecf-e538-448e-8776-be0fcde0e224 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:59.567438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17aecf-e538-448e-8776-be0fcde0e224 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:59.568225 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17aecf-e538-448e-8776-be0fcde0e224 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:59.568518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17aecf-e538-448e-8776-be0fcde0e224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:59.569983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17aecf-e538-448e-8776-be0fcde0e224 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:59.578987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 641/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Mon May 23 16:58:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:59.584822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e79af-d86f-4c71-9159-e854b1f43d31 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:59.687065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e79af-d86f-4c71-9159-e854b1f43d31 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:59.720580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1b407-052c-4b3e-bb1f-87791d1b3d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:59.721356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1b407-052c-4b3e-bb1f-87791d1b3d78 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:59.721638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1b407-052c-4b3e-bb1f-87791d1b3d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:59.721908 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1b407-052c-4b3e-bb1f-87791d1b3d78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:59.732139 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1b407-052c-4b3e-bb1f-87791d1b3d78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:59.733596 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1b407-052c-4b3e-bb1f-87791d1b3d78 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ddb1b407-052c-4b3e-bb1f-87791d1b3d78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:58:59.750644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:58:59.751664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:58:59.752758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:58:59.752758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:58:59.752758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:58:59.752758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:58:59.752758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 637/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:58:59.757706 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17aecf-e538-448e-8776-be0fcde0e224 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:59.855935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17aecf-e538-448e-8776-be0fcde0e224 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:59.888671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b830a4-4e0b-46a9-9e80-75f177ab9467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:59.889320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b830a4-4e0b-46a9-9e80-75f177ab9467 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:59.889602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b830a4-4e0b-46a9-9e80-75f177ab9467 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:59.889875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b830a4-4e0b-46a9-9e80-75f177ab9467 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:59.890646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b830a4-4e0b-46a9-9e80-75f177ab9467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:59.890949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b830a4-4e0b-46a9-9e80-75f177ab9467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:59.892289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b830a4-4e0b-46a9-9e80-75f177ab9467 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:59.903488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 642/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:59.909168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1b407-052c-4b3e-bb1f-87791d1b3d78 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:59.939594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:00.007757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1b407-052c-4b3e-bb1f-87791d1b3d78 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:00.047003 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66459c6d-b04f-4b68-ac94-1b5b1dca9a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:00.047826 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66459c6d-b04f-4b68-ac94-1b5b1dca9a94 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:00.048107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66459c6d-b04f-4b68-ac94-1b5b1dca9a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:00.048379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66459c6d-b04f-4b68-ac94-1b5b1dca9a94 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:00.056638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66459c6d-b04f-4b68-ac94-1b5b1dca9a94 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:00.058108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66459c6d-b04f-4b68-ac94-1b5b1dca9a94 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-66459c6d-b04f-4b68-ac94-1b5b1dca9a94 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:59:00.073100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:59:00.074552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:59:00.075728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:59:00.075728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:59:00.075728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:59:00.075728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:59:00.075728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:59:00.075728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:59:00.075728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:59:00.075728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:59:00.075728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 16:59:00.075728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:59:00.075728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 638/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:58:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:59:00.080426 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b830a4-4e0b-46a9-9e80-75f177ab9467 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:00.084187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:00.177673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b830a4-4e0b-46a9-9e80-75f177ab9467 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:00.211229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c3b10-42f4-4627-8960-af32795bac2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:00.212048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c3b10-42f4-4627-8960-af32795bac2d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:00.212338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c3b10-42f4-4627-8960-af32795bac2d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:00.212617 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c3b10-42f4-4627-8960-af32795bac2d None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:00.213447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c3b10-42f4-4627-8960-af32795bac2d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:59:00.213762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c3b10-42f4-4627-8960-af32795bac2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:00.215207 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c3b10-42f4-4627-8960-af32795bac2d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:00.232107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 643/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Mon May 23 16:59:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:59:00.237782 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66459c6d-b04f-4b68-ac94-1b5b1dca9a94 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:00.326005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:00.336812 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66459c6d-b04f-4b68-ac94-1b5b1dca9a94 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:00.371822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26a43e-0c0e-40a0-b2cf-025ae8c04d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:00.372465 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26a43e-0c0e-40a0-b2cf-025ae8c04d9a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:00.372745 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26a43e-0c0e-40a0-b2cf-025ae8c04d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:00.373020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26a43e-0c0e-40a0-b2cf-025ae8c04d9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:00.437962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26a43e-0c0e-40a0-b2cf-025ae8c04d9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:00.439434 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26a43e-0c0e-40a0-b2cf-025ae8c04d9a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:00.526172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:00.536675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 639/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Mon May 23 16:59:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:59:00.543122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c3b10-42f4-4627-8960-af32795bac2d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:00.602143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:00.639381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c3b10-42f4-4627-8960-af32795bac2d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:00.674603 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769052-fb12-45f1-9253-ec1b8db5f0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:00.675388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769052-fb12-45f1-9253-ec1b8db5f0bc None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:00.675672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769052-fb12-45f1-9253-ec1b8db5f0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:00.675949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769052-fb12-45f1-9253-ec1b8db5f0bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:00.686002 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92769052-fb12-45f1-9253-ec1b8db5f0bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:00.687468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92769052-fb12-45f1-9253-ec1b8db5f0bc None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-92769052-fb12-45f1-9253-ec1b8db5f0bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:59:00.704889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:59:00.705947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:59:00.707077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:59:00.707077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:59:00.707077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:59:00.707077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:59:00.707077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 644/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 16:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:59:00.711841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26a43e-0c0e-40a0-b2cf-025ae8c04d9a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:00.810342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26a43e-0c0e-40a0-b2cf-025ae8c04d9a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:00.844218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1a3a2-c590-4c0f-980d-1ac00a26b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:00.844875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1a3a2-c590-4c0f-980d-1ac00a26b856 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:00.845160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1a3a2-c590-4c0f-980d-1ac00a26b856 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:00.845439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1a3a2-c590-4c0f-980d-1ac00a26b856 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:00.846154 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1a3a2-c590-4c0f-980d-1ac00a26b856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:59:00.846491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1a3a2-c590-4c0f-980d-1ac00a26b856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:00.847860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1a3a2-c590-4c0f-980d-1ac00a26b856 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:00.859889 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 640/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Mon May 23 16:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:59:00.865417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769052-fb12-45f1-9253-ec1b8db5f0bc None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:00.961244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769052-fb12-45f1-9253-ec1b8db5f0bc None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:00.976040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:00.995777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b46cbc-09dd-4c34-bb85-b95eab9c3a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:00.996554 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b46cbc-09dd-4c34-bb85-b95eab9c3a06 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:00.996837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b46cbc-09dd-4c34-bb85-b95eab9c3a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:00.997113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b46cbc-09dd-4c34-bb85-b95eab9c3a06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:01.003518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b46cbc-09dd-4c34-bb85-b95eab9c3a06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:01.004934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b46cbc-09dd-4c34-bb85-b95eab9c3a06 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-85b46cbc-09dd-4c34-bb85-b95eab9c3a06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:59:01.018828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:59:01.019854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 23 16:59:01.021113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:59:01.021113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:59:01.021113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:59:01.021113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:59:01.021113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:59:01.021113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:59:01.021113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:59:01.021113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 23 16:59:01.021113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 645/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Mon May 23 16:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:59:01.025879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1a3a2-c590-4c0f-980d-1ac00a26b856 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:01.074816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:01.123978 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1a3a2-c590-4c0f-980d-1ac00a26b856 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:01.161857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1466c32-35d4-424a-96ad-dbe97d3fcd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:01.162537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1466c32-35d4-424a-96ad-dbe97d3fcd5f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:01.162823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1466c32-35d4-424a-96ad-dbe97d3fcd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:01.163098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1466c32-35d4-424a-96ad-dbe97d3fcd5f None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:01.163880 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1466c32-35d4-424a-96ad-dbe97d3fcd5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:59:01.164188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1466c32-35d4-424a-96ad-dbe97d3fcd5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:01.165606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1466c32-35d4-424a-96ad-dbe97d3fcd5f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:01.177977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 641/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Mon May 23 16:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:59:01.184199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b46cbc-09dd-4c34-bb85-b95eab9c3a06 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:01.281596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b46cbc-09dd-4c34-bb85-b95eab9c3a06 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:01.315101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bbc8f-7a15-47bc-bf66-e1805f3cb9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:01.315737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bbc8f-7a15-47bc-bf66-e1805f3cb9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:01.316021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bbc8f-7a15-47bc-bf66-e1805f3cb9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:01.316298 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bbc8f-7a15-47bc-bf66-e1805f3cb9c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:01.317120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bbc8f-7a15-47bc-bf66-e1805f3cb9c8 None admin] RBAC: Adding query filter params (role.id=1782947fb0ed4dffa8eb78e32146991d, scope.project.id=733d8651e4a74a2ab694091d9fd83e49, user.id=81fb8b261e2142fcbf8d23bd010bf715) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:59:01.317434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bbc8f-7a15-47bc-bf66-e1805f3cb9c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:01.318874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bbc8f-7a15-47bc-bf66-e1805f3cb9c8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:01.324996 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 646/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Mon May 23 16:59:01 2022] GET /identity/v3/role_assignments?user.id=81fb8b261e2142fcbf8d23bd010bf715&scope.project.id=733d8651e4a74a2ab694091d9fd83e49&role.id=1782947fb0ed4dffa8eb78e32146991d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:59:03.533546 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb9e92-ec51-46b3-b30b-46f8edde21f8 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:03.534133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb9e92-ec51-46b3-b30b-46f8edde21f8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:03.534133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb9e92-ec51-46b3-b30b-46f8edde21f8 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:03.535653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 642/1288] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:59:03.542536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c2940-1ece-415e-b32c-ac8e72227986 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:03.542945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c2940-1ece-415e-b32c-ac8e72227986 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:03.543168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c2940-1ece-415e-b32c-ac8e72227986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:03.563072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-295c2940-1ece-415e-b32c-ac8e72227986 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:59:03.564426 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-295c2940-1ece-415e-b32c-ac8e72227986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:59:03.597825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:03.634485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 647/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:59:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:59:03.656315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb9e92-ec51-46b3-b30b-46f8edde21f8 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:03.755531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb9e92-ec51-46b3-b30b-46f8edde21f8 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:03.765664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:03.792350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e379c9d-d064-49a8-b528-ae527e1e7f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:03.793080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e379c9d-d064-49a8-b528-ae527e1e7f12 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:03.793362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e379c9d-d064-49a8-b528-ae527e1e7f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:03.793634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e379c9d-d064-49a8-b528-ae527e1e7f12 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:03.794305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e379c9d-d064-49a8-b528-ae527e1e7f12 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:03.795688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e379c9d-d064-49a8-b528-ae527e1e7f12 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-2e379c9d-d064-49a8-b528-ae527e1e7f12 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:59:03.807262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:59:03.808555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:59:03.809572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 643/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 23 16:59:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:59:03.815202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c2940-1ece-415e-b32c-ac8e72227986 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:03.911943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c2940-1ece-415e-b32c-ac8e72227986 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:03.944229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aeb24-7ecc-4417-b868-e50355d7953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:03.944884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aeb24-7ecc-4417-b868-e50355d7953a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:03.945174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aeb24-7ecc-4417-b868-e50355d7953a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:03.945455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aeb24-7ecc-4417-b868-e50355d7953a None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:03.946157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2aeb24-7ecc-4417-b868-e50355d7953a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:59:03.946499 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2aeb24-7ecc-4417-b868-e50355d7953a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:03.948480 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2aeb24-7ecc-4417-b868-e50355d7953a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:03.953461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 648/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Mon May 23 16:59:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:59:03.959222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e379c9d-d064-49a8-b528-ae527e1e7f12 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:04.060170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e379c9d-d064-49a8-b528-ae527e1e7f12 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:04.093123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3ecfb-1525-4610-9451-994cbe478c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:04.093779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3ecfb-1525-4610-9451-994cbe478c59 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:04.094072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3ecfb-1525-4610-9451-994cbe478c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:04.094354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3ecfb-1525-4610-9451-994cbe478c59 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:04.095087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3ecfb-1525-4610-9451-994cbe478c59 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:59:04.095400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3ecfb-1525-4610-9451-994cbe478c59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:04.096755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3ecfb-1525-4610-9451-994cbe478c59 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:04.101108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 644/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Mon May 23 16:59:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:59:06.272922 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc799e5-ba40-4d12-8698-41569332ba50 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:06.273497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc799e5-ba40-4d12-8698-41569332ba50 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:06.273497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc799e5-ba40-4d12-8698-41569332ba50 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:06.274881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 649/1293] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:59:06.280614 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba44de-c089-4c2d-a7e8-0b3bba23f4ba None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:06.280989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba44de-c089-4c2d-a7e8-0b3bba23f4ba None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:06.281188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba44de-c089-4c2d-a7e8-0b3bba23f4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:06.298276 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-07ba44de-c089-4c2d-a7e8-0b3bba23f4ba None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:59:06.299487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-07ba44de-c089-4c2d-a7e8-0b3bba23f4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:59:06.329115 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:06.366056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 645/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:59:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:59:06.389400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc799e5-ba40-4d12-8698-41569332ba50 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:06.420373 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:06.488413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc799e5-ba40-4d12-8698-41569332ba50 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:06.522405 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5398af3-8001-4d7a-a71d-ddb366763820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:06.523259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5398af3-8001-4d7a-a71d-ddb366763820 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:06.523561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5398af3-8001-4d7a-a71d-ddb366763820 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:06.523877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5398af3-8001-4d7a-a71d-ddb366763820 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:06.524773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5398af3-8001-4d7a-a71d-ddb366763820 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:06.527051 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5398af3-8001-4d7a-a71d-ddb366763820 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:06.542834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 650/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Mon May 23 16:59:06 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:59:08.736856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a58730-f04a-4285-aa6c-b3409f3370ff None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:08.737424 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a58730-f04a-4285-aa6c-b3409f3370ff None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:08.737424 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a58730-f04a-4285-aa6c-b3409f3370ff None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:08.738821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 646/1296] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:59:08.744620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbf5b3-3c82-4ac5-b364-465ab6d9b709 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:08.745016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbf5b3-3c82-4ac5-b364-465ab6d9b709 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:08.745193 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbf5b3-3c82-4ac5-b364-465ab6d9b709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:08.765090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-cadbf5b3-3c82-4ac5-b364-465ab6d9b709 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:59:08.766286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cadbf5b3-3c82-4ac5-b364-465ab6d9b709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:59:08.837382 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 651/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:59:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:59:08.859603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a58730-f04a-4285-aa6c-b3409f3370ff None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:08.958821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a58730-f04a-4285-aa6c-b3409f3370ff None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:08.992020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1be08-9740-40ab-b6e5-2c9161ff9f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:08.992741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1be08-9740-40ab-b6e5-2c9161ff9f02 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:08.993030 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1be08-9740-40ab-b6e5-2c9161ff9f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:08.993309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1be08-9740-40ab-b6e5-2c9161ff9f02 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:08.994507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1be08-9740-40ab-b6e5-2c9161ff9f02 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:08.995877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1be08-9740-40ab-b6e5-2c9161ff9f02 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-fda1be08-9740-40ab-b6e5-2c9161ff9f02 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:59:09.007457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:59:09.008621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:59:09.009979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 647/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 23 16:59:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:59:09.014713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbf5b3-3c82-4ac5-b364-465ab6d9b709 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:09.032872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:09.113370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbf5b3-3c82-4ac5-b364-465ab6d9b709 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:09.146947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dd2c7-8eb8-4669-a22d-34f16709eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:09.147599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dd2c7-8eb8-4669-a22d-34f16709eec9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:09.147890 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dd2c7-8eb8-4669-a22d-34f16709eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:09.148170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dd2c7-8eb8-4669-a22d-34f16709eec9 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:09.148866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dd2c7-8eb8-4669-a22d-34f16709eec9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:59:09.149172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dd2c7-8eb8-4669-a22d-34f16709eec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:09.151231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dd2c7-8eb8-4669-a22d-34f16709eec9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:09.156227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 652/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Mon May 23 16:59:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:59:09.162012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1be08-9740-40ab-b6e5-2c9161ff9f02 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:09.192482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:09.259004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1be08-9740-40ab-b6e5-2c9161ff9f02 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:09.291970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcd13e-9b08-428a-b969-cc17307b0626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:09.292613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcd13e-9b08-428a-b969-cc17307b0626 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:09.292918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcd13e-9b08-428a-b969-cc17307b0626 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:09.293176 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcd13e-9b08-428a-b969-cc17307b0626 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:09.293963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcd13e-9b08-428a-b969-cc17307b0626 None admin] RBAC: Adding query filter params (interface=public, service_id=8d713a7762724d4d8846e2eda069f5d2, region_id=RegionOne) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:59:09.294273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcd13e-9b08-428a-b969-cc17307b0626 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:09.295659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcd13e-9b08-428a-b969-cc17307b0626 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:09.300557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 648/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Mon May 23 16:59:09 2022] GET /identity/v3/endpoints?service_id=8d713a7762724d4d8846e2eda069f5d2&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:59:09.306286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dd2c7-8eb8-4669-a22d-34f16709eec9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:09.385192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:09.405285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dd2c7-8eb8-4669-a22d-34f16709eec9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:09.439396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324faf0-bcbb-4989-87f6-81e616c79c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:09.440052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324faf0-bcbb-4989-87f6-81e616c79c95 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:09.440341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324faf0-bcbb-4989-87f6-81e616c79c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:09.440621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324faf0-bcbb-4989-87f6-81e616c79c95 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:09.441299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324faf0-bcbb-4989-87f6-81e616c79c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:09.442672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324faf0-bcbb-4989-87f6-81e616c79c95 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:09.450274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 653/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Mon May 23 16:59:09 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:59:11.682782 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e742bce-a4ad-4b2c-9f68-d08a12412f3f None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:11.683377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e742bce-a4ad-4b2c-9f68-d08a12412f3f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:11.683377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e742bce-a4ad-4b2c-9f68-d08a12412f3f None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:11.684684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 649/1302] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 16:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:59:11.689872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b8d19-113f-4717-8ed9-9ea0f09ef45f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:11.690317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b8d19-113f-4717-8ed9-9ea0f09ef45f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:11.690460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b8d19-113f-4717-8ed9-9ea0f09ef45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:11.709275 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6f7b8d19-113f-4717-8ed9-9ea0f09ef45f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:59:11.710491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6f7b8d19-113f-4717-8ed9-9ea0f09ef45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:59:11.775987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 654/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 16:59:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:59:11.801898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e742bce-a4ad-4b2c-9f68-d08a12412f3f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:11.894021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:11.900685 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e742bce-a4ad-4b2c-9f68-d08a12412f3f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:11.933073 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f979d-e5f8-408d-98fb-33e6be2a7beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:11.933786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f979d-e5f8-408d-98fb-33e6be2a7beb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:11.934066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f979d-e5f8-408d-98fb-33e6be2a7beb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:11.934336 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f979d-e5f8-408d-98fb-33e6be2a7beb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:11.935007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f979d-e5f8-408d-98fb-33e6be2a7beb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:11.936354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f979d-e5f8-408d-98fb-33e6be2a7beb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c97f979d-e5f8-408d-98fb-33e6be2a7beb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:59:11.948091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:59:11.949600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 23 16:59:11.950897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 650/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Mon May 23 16:59:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:59:11.955542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b8d19-113f-4717-8ed9-9ea0f09ef45f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:12.029807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:12.051970 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b8d19-113f-4717-8ed9-9ea0f09ef45f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:12.085623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68d517-45c0-45ba-86cd-e88a6b997d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:12.086307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68d517-45c0-45ba-86cd-e88a6b997d01 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:12.086624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68d517-45c0-45ba-86cd-e88a6b997d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:12.086898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68d517-45c0-45ba-86cd-e88a6b997d01 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:12.088610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68d517-45c0-45ba-86cd-e88a6b997d01 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:59:12.088924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68d517-45c0-45ba-86cd-e88a6b997d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:12.090278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68d517-45c0-45ba-86cd-e88a6b997d01 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:12.095688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 655/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Mon May 23 16:59:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:59:12.103374 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f979d-e5f8-408d-98fb-33e6be2a7beb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:12.200578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f979d-e5f8-408d-98fb-33e6be2a7beb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:12.233146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626aba7d-3f2a-4ee6-8b51-12b392be64cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:12.233780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aba7d-3f2a-4ee6-8b51-12b392be64cc None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:12.234064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aba7d-3f2a-4ee6-8b51-12b392be64cc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:12.234338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aba7d-3f2a-4ee6-8b51-12b392be64cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:12.235103 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aba7d-3f2a-4ee6-8b51-12b392be64cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:12.236451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aba7d-3f2a-4ee6-8b51-12b392be64cc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:12.254003 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 651/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Mon May 23 16:59:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:59:22.092510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=30 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:22.250044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:16.455395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443df736-9d03-455a-9fa5-e3afc607d894 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:16.455958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443df736-9d03-455a-9fa5-e3afc607d894 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:16.455958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443df736-9d03-455a-9fa5-e3afc607d894 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:16.461217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 656/1307] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:16.463491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1cab2-0385-443c-8cb6-390361ab0c0e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:16.463938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1cab2-0385-443c-8cb6-390361ab0c0e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:16.464066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1cab2-0385-443c-8cb6-390361ab0c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:16.566475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-99d1cab2-0385-443c-8cb6-390361ab0c0e None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:16.568258 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-99d1cab2-0385-443c-8cb6-390361ab0c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:16.723189 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 652/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:16.768520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f9317-da00-4b25-9cd8-5415485b009a None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:16.768715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f9317-da00-4b25-9cd8-5415485b009a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:16.769091 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f9317-da00-4b25-9cd8-5415485b009a None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:16.770581 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 657/1309] 10.222.0.49 () {54 vars in 964 bytes} [Mon May 23 17:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:16.779374 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69716c8c-c396-4e0c-aaed-588a2ed019fe None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:16.779758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69716c8c-c396-4e0c-aaed-588a2ed019fe None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:16.780109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69716c8c-c396-4e0c-aaed-588a2ed019fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:16.874315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-69716c8c-c396-4e0c-aaed-588a2ed019fe None None] MFA Rules not processed for user `73bdfedb6d9e4ddab18a8143ba7142fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:16.875792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-69716c8c-c396-4e0c-aaed-588a2ed019fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:16.898275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:16.961531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 653/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Mon May 23 17:00:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:16.971087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f9317-da00-4b25-9cd8-5415485b009a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:16.972996 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-164f9317-da00-4b25-9cd8-5415485b009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:17.091025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f9317-da00-4b25-9cd8-5415485b009a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:17.170659 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d6620-8fe8-48e4-8e73-33597289f6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:17.171318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d6620-8fe8-48e4-8e73-33597289f6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:17.171600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d6620-8fe8-48e4-8e73-33597289f6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:17.171871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d6620-8fe8-48e4-8e73-33597289f6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:17.174217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b89d6620-8fe8-48e4-8e73-33597289f6e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:17.232176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:17.302115 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d6620-8fe8-48e4-8e73-33597289f6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:17.303592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d6620-8fe8-48e4-8e73-33597289f6e9 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:17.324807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 658/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:00:19.900692 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fe356-8b63-4854-9055-ead54492c831 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:19.901236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fe356-8b63-4854-9055-ead54492c831 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:19.901236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fe356-8b63-4854-9055-ead54492c831 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:19.902884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 654/1312] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:19.908761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261ec1-bf6a-41c0-aee7-fcf306228d3d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:19.909244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261ec1-bf6a-41c0-aee7-fcf306228d3d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:19.909397 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261ec1-bf6a-41c0-aee7-fcf306228d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:20.000607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b0261ec1-bf6a-41c0-aee7-fcf306228d3d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:20.001804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b0261ec1-bf6a-41c0-aee7-fcf306228d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:20.110394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 659/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:20.158337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed6a6-3987-4b6f-b904-c7b9cee6b373 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:20.158642 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed6a6-3987-4b6f-b904-c7b9cee6b373 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:20.158836 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed6a6-3987-4b6f-b904-c7b9cee6b373 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:20.160354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 655/1314] 10.222.0.49 () {54 vars in 964 bytes} [Mon May 23 17:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:20.166701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e1137-4652-47b7-9905-a9dc51920de8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:20.167061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e1137-4652-47b7-9905-a9dc51920de8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:20.167412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e1137-4652-47b7-9905-a9dc51920de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:20.178086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:20.245490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b07e1137-4652-47b7-9905-a9dc51920de8 None None] MFA Rules not processed for user `73bdfedb6d9e4ddab18a8143ba7142fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:20.246745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b07e1137-4652-47b7-9905-a9dc51920de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:20.333008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 660/1315] 10.222.0.49 () {58 vars in 1061 bytes} [Mon May 23 17:00:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:20.342976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ed6a6-3987-4b6f-b904-c7b9cee6b373 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:20.344520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-907ed6a6-3987-4b6f-b904-c7b9cee6b373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:20.465387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ed6a6-3987-4b6f-b904-c7b9cee6b373 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:20.549574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:20.553018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec93ae-27cc-4cda-af3f-203cf689634f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:20.553661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec93ae-27cc-4cda-af3f-203cf689634f service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:20.554452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec93ae-27cc-4cda-af3f-203cf689634f service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:20.554736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec93ae-27cc-4cda-af3f-203cf689634f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:20.557913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5cec93ae-27cc-4cda-af3f-203cf689634f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:20.675045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec93ae-27cc-4cda-af3f-203cf689634f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:20.676496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec93ae-27cc-4cda-af3f-203cf689634f service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:20.696802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 656/1316] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:00:23.465674 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cd028-2957-455a-813b-0fa7751a5729 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:23.466202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cd028-2957-455a-813b-0fa7751a5729 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:23.466202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cd028-2957-455a-813b-0fa7751a5729 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:23.467560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 661/1317] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:23.472785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85a5fc-b27d-41d7-8b22-8379ba559e49 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:23.473220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85a5fc-b27d-41d7-8b22-8379ba559e49 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:23.473353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85a5fc-b27d-41d7-8b22-8379ba559e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:23.539877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-db85a5fc-b27d-41d7-8b22-8379ba559e49 None None] MFA Rules not processed for user `0c86a729247645e9904a177f85de34a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:23.541257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-db85a5fc-b27d-41d7-8b22-8379ba559e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:23.593134 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:23.637740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 657/1318] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:23.677150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cd028-2957-455a-813b-0fa7751a5729 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:23.678705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c31cd028-2957-455a-813b-0fa7751a5729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:23.784731 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cd028-2957-455a-813b-0fa7751a5729 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:23.787608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:23.857588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba51a73-5647-4f0f-9224-957307976713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:23.858230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba51a73-5647-4f0f-9224-957307976713 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:23.858573 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba51a73-5647-4f0f-9224-957307976713 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:23.858848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba51a73-5647-4f0f-9224-957307976713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:23.860484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2ba51a73-5647-4f0f-9224-957307976713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:23.968636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba51a73-5647-4f0f-9224-957307976713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:23.970103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba51a73-5647-4f0f-9224-957307976713 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:23.988574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 662/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:26.753263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff671b8-98a9-4312-9933-4893b3eb58f4 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:26.753770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff671b8-98a9-4312-9933-4893b3eb58f4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:26.753770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff671b8-98a9-4312-9933-4893b3eb58f4 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:26.755159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 658/1320] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:26.760418 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581d9ac-dcd0-4a65-83e4-e6d46a45cea3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:26.760842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581d9ac-dcd0-4a65-83e4-e6d46a45cea3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:26.760980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581d9ac-dcd0-4a65-83e4-e6d46a45cea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:26.801645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:26.826690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2581d9ac-dcd0-4a65-83e4-e6d46a45cea3 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:26.827926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2581d9ac-dcd0-4a65-83e4-e6d46a45cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:26.922458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 663/1321] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:26.960925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff671b8-98a9-4312-9933-4893b3eb58f4 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:26.962523 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dff671b8-98a9-4312-9933-4893b3eb58f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:27.088159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff671b8-98a9-4312-9933-4893b3eb58f4 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:27.159483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666d169-880c-42bd-b0b4-22084b6bf87c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:27.160125 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666d169-880c-42bd-b0b4-22084b6bf87c service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:27.160413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666d169-880c-42bd-b0b4-22084b6bf87c service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:27.160690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666d169-880c-42bd-b0b4-22084b6bf87c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:27.162353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f666d169-880c-42bd-b0b4-22084b6bf87c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:27.169717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:27.269351 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666d169-880c-42bd-b0b4-22084b6bf87c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:27.270830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666d169-880c-42bd-b0b4-22084b6bf87c service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:27.288555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 659/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:30.404963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509152b-0de4-4a55-a5e1-db8476de3258 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:30.405453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509152b-0de4-4a55-a5e1-db8476de3258 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:30.405546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509152b-0de4-4a55-a5e1-db8476de3258 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:30.406928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 664/1323] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:30.412311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f5ef6-e71c-48ab-bc57-fa64314ae23a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:30.412743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f5ef6-e71c-48ab-bc57-fa64314ae23a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:30.412933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f5ef6-e71c-48ab-bc57-fa64314ae23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:30.478540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4c3f5ef6-e71c-48ab-bc57-fa64314ae23a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:30.479755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4c3f5ef6-e71c-48ab-bc57-fa64314ae23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:30.538173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:30.577132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 660/1324] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:30.612866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509152b-0de4-4a55-a5e1-db8476de3258 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:30.614431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2509152b-0de4-4a55-a5e1-db8476de3258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:30.718863 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509152b-0de4-4a55-a5e1-db8476de3258 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:30.731576 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:30.797138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6af60-d675-43f5-b590-1c7a0eacd28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:30.797784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6af60-d675-43f5-b590-1c7a0eacd28d service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:30.798066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6af60-d675-43f5-b590-1c7a0eacd28d service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:30.798338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6af60-d675-43f5-b590-1c7a0eacd28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:30.800126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b9e6af60-d675-43f5-b590-1c7a0eacd28d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:30.908904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6af60-d675-43f5-b590-1c7a0eacd28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:30.910339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6af60-d675-43f5-b590-1c7a0eacd28d service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:30.928783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 665/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:33.176947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29568052-89ff-4418-8b03-0e4a7e31d633 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:33.177489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29568052-89ff-4418-8b03-0e4a7e31d633 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:33.177489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29568052-89ff-4418-8b03-0e4a7e31d633 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:33.178944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 661/1326] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:33.184754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015acef3-1eed-4f34-acf7-647099ca13c7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:33.185172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015acef3-1eed-4f34-acf7-647099ca13c7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:33.185306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015acef3-1eed-4f34-acf7-647099ca13c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:33.234441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:33.252954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-015acef3-1eed-4f34-acf7-647099ca13c7 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:33.254148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-015acef3-1eed-4f34-acf7-647099ca13c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:33.352797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 666/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:33.388910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29568052-89ff-4418-8b03-0e4a7e31d633 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:33.390484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-29568052-89ff-4418-8b03-0e4a7e31d633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:33.496025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29568052-89ff-4418-8b03-0e4a7e31d633 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:33.570974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677fd8e-f806-4d4f-8c50-a199064a2dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:33.571631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677fd8e-f806-4d4f-8c50-a199064a2dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:33.571977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677fd8e-f806-4d4f-8c50-a199064a2dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:33.572252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677fd8e-f806-4d4f-8c50-a199064a2dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:33.574344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c677fd8e-f806-4d4f-8c50-a199064a2dc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:33.591678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:33.682888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677fd8e-f806-4d4f-8c50-a199064a2dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:33.684329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677fd8e-f806-4d4f-8c50-a199064a2dc8 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:33.702223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 662/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:35.943568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5de57-da4b-4d7f-bd7d-8b87e7a33569 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:35.944096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5de57-da4b-4d7f-bd7d-8b87e7a33569 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:35.944207 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5de57-da4b-4d7f-bd7d-8b87e7a33569 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:35.945655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 667/1329] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:35.951389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979741e-3f47-4995-9c83-1d2f96b755e1 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:35.951799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979741e-3f47-4995-9c83-1d2f96b755e1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:35.951955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979741e-3f47-4995-9c83-1d2f96b755e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:36.015118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3979741e-3f47-4995-9c83-1d2f96b755e1 None None] MFA Rules not processed for user `0c86a729247645e9904a177f85de34a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:36.016316 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3979741e-3f47-4995-9c83-1d2f96b755e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:36.080800 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:36.112752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 663/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:36.150005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5de57-da4b-4d7f-bd7d-8b87e7a33569 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:36.151807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-caa5de57-da4b-4d7f-bd7d-8b87e7a33569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:36.256408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5de57-da4b-4d7f-bd7d-8b87e7a33569 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:36.276264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:36.330943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04703e31-e137-4643-8976-62e71d7ec735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:36.331575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04703e31-e137-4643-8976-62e71d7ec735 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:36.331802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04703e31-e137-4643-8976-62e71d7ec735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:36.332088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04703e31-e137-4643-8976-62e71d7ec735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:36.333842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-04703e31-e137-4643-8976-62e71d7ec735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:36.449296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04703e31-e137-4643-8976-62e71d7ec735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:36.450767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04703e31-e137-4643-8976-62e71d7ec735 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:36.468875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 668/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:38.928528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edd357-258e-4b05-926c-6320031b42b4 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:38.929125 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edd357-258e-4b05-926c-6320031b42b4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:38.929125 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edd357-258e-4b05-926c-6320031b42b4 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:38.930484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 664/1332] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:38.936455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ae930-f110-4c31-9f3c-0fa3dd335495 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:38.936859 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ae930-f110-4c31-9f3c-0fa3dd335495 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:38.937022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ae930-f110-4c31-9f3c-0fa3dd335495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:39.017490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:39.021012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-267ae930-f110-4c31-9f3c-0fa3dd335495 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:39.022649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-267ae930-f110-4c31-9f3c-0fa3dd335495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:39.125671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 669/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:39.162094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edd357-258e-4b05-926c-6320031b42b4 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:39.163690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-06edd357-258e-4b05-926c-6320031b42b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:39.268921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edd357-258e-4b05-926c-6320031b42b4 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:39.345078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7becc-eb1b-4890-9afd-d9bb93da93c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:39.345734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7becc-eb1b-4890-9afd-d9bb93da93c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:39.346012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7becc-eb1b-4890-9afd-d9bb93da93c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:39.346285 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7becc-eb1b-4890-9afd-d9bb93da93c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:39.348048 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-71a7becc-eb1b-4890-9afd-d9bb93da93c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:39.377868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:39.460844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7becc-eb1b-4890-9afd-d9bb93da93c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:39.462322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7becc-eb1b-4890-9afd-d9bb93da93c5 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:39.480323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 665/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:41.755242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c9e0-6042-49bc-9160-04540f626385 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:41.755891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c9e0-6042-49bc-9160-04540f626385 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:41.755891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c9e0-6042-49bc-9160-04540f626385 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:41.757194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 670/1335] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:41.762456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee8101-b269-44dd-b4e9-0db16a7a2dae None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:41.762901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee8101-b269-44dd-b4e9-0db16a7a2dae None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:41.763031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee8101-b269-44dd-b4e9-0db16a7a2dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:41.827267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-10ee8101-b269-44dd-b4e9-0db16a7a2dae None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:41.828591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-10ee8101-b269-44dd-b4e9-0db16a7a2dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:41.901044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:41.923553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 666/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:41.963301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47c9e0-6042-49bc-9160-04540f626385 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:41.964802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3c47c9e0-6042-49bc-9160-04540f626385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:42.066639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47c9e0-6042-49bc-9160-04540f626385 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:42.094712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:42.139632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd560149-2ce1-4429-8d48-5b09246787cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:42.140270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd560149-2ce1-4429-8d48-5b09246787cb service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:42.140551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd560149-2ce1-4429-8d48-5b09246787cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:42.140825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd560149-2ce1-4429-8d48-5b09246787cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:42.142477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bd560149-2ce1-4429-8d48-5b09246787cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:42.254441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd560149-2ce1-4429-8d48-5b09246787cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:42.255872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd560149-2ce1-4429-8d48-5b09246787cb service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:42.273935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 671/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:44.817383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12867e6-7bc9-4c4f-869e-137fd7275fdb None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:44.817880 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12867e6-7bc9-4c4f-869e-137fd7275fdb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:44.817991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12867e6-7bc9-4c4f-869e-137fd7275fdb None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:44.819349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 667/1338] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:44.825364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12cf6-74ac-42e5-aaeb-951dce7b1201 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:44.825799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12cf6-74ac-42e5-aaeb-951dce7b1201 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:44.825930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12cf6-74ac-42e5-aaeb-951dce7b1201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:44.889536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-52d12cf6-74ac-42e5-aaeb-951dce7b1201 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:44.890767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-52d12cf6-74ac-42e5-aaeb-951dce7b1201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:44.898888 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:44.987083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 672/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:45.023087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12867e6-7bc9-4c4f-869e-137fd7275fdb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:45.024649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b12867e6-7bc9-4c4f-869e-137fd7275fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:45.129390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12867e6-7bc9-4c4f-869e-137fd7275fdb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:45.201807 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b05b5-4a5d-4517-8931-a751c248459b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:45.202475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b05b5-4a5d-4517-8931-a751c248459b service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:45.202762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b05b5-4a5d-4517-8931-a751c248459b service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:45.203039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b05b5-4a5d-4517-8931-a751c248459b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:45.204685 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f94b05b5-4a5d-4517-8931-a751c248459b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:45.239422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:45.312596 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b05b5-4a5d-4517-8931-a751c248459b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:45.314054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b05b5-4a5d-4517-8931-a751c248459b service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:45.331879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 668/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:49.582927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8dff5-3452-43ce-b0de-a605998060e9 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:49.583504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8dff5-3452-43ce-b0de-a605998060e9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:49.583504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8dff5-3452-43ce-b0de-a605998060e9 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:49.584906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 673/1341] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:49.590309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632f07-5811-48c6-a827-1442b8649714 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:49.590732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632f07-5811-48c6-a827-1442b8649714 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:49.590900 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632f07-5811-48c6-a827-1442b8649714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:49.660281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b0632f07-5811-48c6-a827-1442b8649714 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:49.661466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b0632f07-5811-48c6-a827-1442b8649714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:49.756045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:49.777313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 669/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:49.809436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8dff5-3452-43ce-b0de-a605998060e9 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:49.811645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-dbb8dff5-3452-43ce-b0de-a605998060e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:49.909897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8dff5-3452-43ce-b0de-a605998060e9 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:49.913504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d88618-e159-44c4-94fb-59bff7258ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:49.914154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88618-e159-44c4-94fb-59bff7258ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:49.914472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88618-e159-44c4-94fb-59bff7258ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:49.914751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88618-e159-44c4-94fb-59bff7258ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:49.923796 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d88618-e159-44c4-94fb-59bff7258ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:49.925199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d88618-e159-44c4-94fb-59bff7258ee2 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:49.935182 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 674/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:52.724936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3adfab-9c6c-4ce0-9d70-abfcf9d38a57 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:52.725460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3adfab-9c6c-4ce0-9d70-abfcf9d38a57 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:52.725460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3adfab-9c6c-4ce0-9d70-abfcf9d38a57 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:52.726811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 670/1344] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:52.732739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e5763-9e7e-4ba2-9522-f53a988c5361 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:52.733159 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e5763-9e7e-4ba2-9522-f53a988c5361 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:52.733274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e5763-9e7e-4ba2-9522-f53a988c5361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:52.762099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b89e5763-9e7e-4ba2-9522-f53a988c5361 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:52.763341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b89e5763-9e7e-4ba2-9522-f53a988c5361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:52.793323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:52.842941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 675/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:52.879907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3adfab-9c6c-4ce0-9d70-abfcf9d38a57 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:52.890845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3adfab-9c6c-4ce0-9d70-abfcf9d38a57 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:52.894261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685b84e-acbb-4591-98f0-cf5f094fa0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:52.894927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685b84e-acbb-4591-98f0-cf5f094fa0aa service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:52.895212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685b84e-acbb-4591-98f0-cf5f094fa0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:52.895490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685b84e-acbb-4591-98f0-cf5f094fa0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:52.905117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685b84e-acbb-4591-98f0-cf5f094fa0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:52.906567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685b84e-acbb-4591-98f0-cf5f094fa0aa service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:52.916224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 671/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:57.118716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197b91a-e654-4084-a87a-5f524b5b3006 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:57.119222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197b91a-e654-4084-a87a-5f524b5b3006 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:57.119312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197b91a-e654-4084-a87a-5f524b5b3006 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:57.120754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 676/1347] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:00:57.125904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25433be6-7b3b-4469-8a0f-c35e4c81c06a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:57.126294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25433be6-7b3b-4469-8a0f-c35e4c81c06a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:57.126509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25433be6-7b3b-4469-8a0f-c35e4c81c06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:57.145812 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-25433be6-7b3b-4469-8a0f-c35e4c81c06a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:57.145972 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-25433be6-7b3b-4469-8a0f-c35e4c81c06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:57.154644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 672/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:57.191258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197b91a-e654-4084-a87a-5f524b5b3006 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:57.202825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197b91a-e654-4084-a87a-5f524b5b3006 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:57.206348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf139b4-90c2-4dc0-84b6-c2f90b361cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:57.207072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf139b4-90c2-4dc0-84b6-c2f90b361cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:57.207449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf139b4-90c2-4dc0-84b6-c2f90b361cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:57.207804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf139b4-90c2-4dc0-84b6-c2f90b361cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:57.217562 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf139b4-90c2-4dc0-84b6-c2f90b361cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:57.219037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf139b4-90c2-4dc0-84b6-c2f90b361cb3 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:57.228778 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 677/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:02.785669 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c532460-a704-4619-af5f-f1b45067c633 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:02.786484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c532460-a704-4619-af5f-f1b45067c633 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:02.786943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c532460-a704-4619-af5f-f1b45067c633 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:02.788739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 673/1350] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 23 17:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:02.794130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1932686-5a57-49c8-a767-b182af3fb4e9 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:02.794609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1932686-5a57-49c8-a767-b182af3fb4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:02.794706 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1932686-5a57-49c8-a767-b182af3fb4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:02.902131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a1932686-5a57-49c8-a767-b182af3fb4e9 None None] MFA Rules not processed for user `81fb8b261e2142fcbf8d23bd010bf715`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:02.904740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a1932686-5a57-49c8-a767-b182af3fb4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:03.013407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 678/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 23 17:01:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:07.091167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb0cc7-4e49-44d5-bd92-5bac2a5019be None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:07.091677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb0cc7-4e49-44d5-bd92-5bac2a5019be None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:07.091677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb0cc7-4e49-44d5-bd92-5bac2a5019be None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:07.093303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 674/1352] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 23 17:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:07.099812 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40b78c-3b7f-488e-9263-33a76c2d386c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:07.100276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40b78c-3b7f-488e-9263-33a76c2d386c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:07.100573 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40b78c-3b7f-488e-9263-33a76c2d386c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:07.119777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ea40b78c-3b7f-488e-9263-33a76c2d386c None None] MFA Rules not processed for user `81fb8b261e2142fcbf8d23bd010bf715`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:07.121124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ea40b78c-3b7f-488e-9263-33a76c2d386c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:07.130539 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 679/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 23 17:01:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:07.139756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=13 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:08.803154 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8e6ef-27a3-4a80-a286-cf083f0fa55a None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:08.803796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8e6ef-27a3-4a80-a286-cf083f0fa55a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:08.803796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8e6ef-27a3-4a80-a286-cf083f0fa55a None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:08.805088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 675/1354] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 23 17:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:08.810316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9a58-c5ba-4c09-851e-ee5a3a7e27ad None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:08.810791 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9a58-c5ba-4c09-851e-ee5a3a7e27ad None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:08.811023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9a58-c5ba-4c09-851e-ee5a3a7e27ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:08.829084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-81ef9a58-c5ba-4c09-851e-ee5a3a7e27ad None None] MFA Rules not processed for user `81fb8b261e2142fcbf8d23bd010bf715`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:08.830335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-81ef9a58-c5ba-4c09-851e-ee5a3a7e27ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:08.839431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 680/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 23 17:01:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:12.806688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f84e7a-5cde-4c4d-adf9-e5ce0e88ecd3 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:12.807306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f84e7a-5cde-4c4d-adf9-e5ce0e88ecd3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:12.807447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f84e7a-5cde-4c4d-adf9-e5ce0e88ecd3 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:12.809285 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 676/1356] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:12.814792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c18a2-ebdd-4b44-8a11-c28c5db89c4f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:12.815238 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c18a2-ebdd-4b44-8a11-c28c5db89c4f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:12.815456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c18a2-ebdd-4b44-8a11-c28c5db89c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:12.834191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0d6c18a2-ebdd-4b44-8a11-c28c5db89c4f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:12.835427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0d6c18a2-ebdd-4b44-8a11-c28c5db89c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:12.843440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 681/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:12.897969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149db779-f227-423b-94c8-c3e9bed99230 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:12.898212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149db779-f227-423b-94c8-c3e9bed99230 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:12.898681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149db779-f227-423b-94c8-c3e9bed99230 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:12.900987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 677/1358] 10.222.0.49 () {54 vars in 961 bytes} [Mon May 23 17:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:12.910464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fdd1b-5896-43fc-a748-37ef3b11974f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:12.910764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fdd1b-5896-43fc-a748-37ef3b11974f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:12.911052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fdd1b-5896-43fc-a748-37ef3b11974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:12.955945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:12.963696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b32fdd1b-5896-43fc-a748-37ef3b11974f None None] MFA Rules not processed for user `9884780c88aa48ffa92a696740761387`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:12.964928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b32fdd1b-5896-43fc-a748-37ef3b11974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:13.050984 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 682/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Mon May 23 17:01:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:13.059167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149db779-f227-423b-94c8-c3e9bed99230 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:13.076662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149db779-f227-423b-94c8-c3e9bed99230 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:13.082774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35276ad0-dfac-4574-9712-b706e6ef051a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:13.083810 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35276ad0-dfac-4574-9712-b706e6ef051a service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:13.084168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35276ad0-dfac-4574-9712-b706e6ef051a service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:13.084551 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35276ad0-dfac-4574-9712-b706e6ef051a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:13.094288 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35276ad0-dfac-4574-9712-b706e6ef051a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:13.095979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35276ad0-dfac-4574-9712-b706e6ef051a service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:13.106650 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 678/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:15.567425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34cf0c-88bb-4fba-bb7b-e8f97ed042bc None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:15.568346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34cf0c-88bb-4fba-bb7b-e8f97ed042bc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:15.568702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34cf0c-88bb-4fba-bb7b-e8f97ed042bc None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:15.570171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 683/1361] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:15.577126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f92cc9-93cb-4aa4-97d5-b0cc65585e8a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:15.578612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f92cc9-93cb-4aa4-97d5-b0cc65585e8a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:15.579688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f92cc9-93cb-4aa4-97d5-b0cc65585e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:15.597897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-73f92cc9-93cb-4aa4-97d5-b0cc65585e8a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:15.599462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-73f92cc9-93cb-4aa4-97d5-b0cc65585e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:15.607914 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 679/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:01:15.653069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34cf0c-88bb-4fba-bb7b-e8f97ed042bc None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:15.670760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34cf0c-88bb-4fba-bb7b-e8f97ed042bc None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:15.676455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bd6b1-f9e5-47c4-99f1-f270ef0b7929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:15.677109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bd6b1-f9e5-47c4-99f1-f270ef0b7929 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:15.677402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bd6b1-f9e5-47c4-99f1-f270ef0b7929 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:15.677685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bd6b1-f9e5-47c4-99f1-f270ef0b7929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:15.687342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bd6b1-f9e5-47c4-99f1-f270ef0b7929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:15.688946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bd6b1-f9e5-47c4-99f1-f270ef0b7929 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:15.702137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 684/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:18.266526 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bc3aa-dbab-4dcc-8fa6-0c3f13d1d177 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:18.267065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bc3aa-dbab-4dcc-8fa6-0c3f13d1d177 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:18.267191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bc3aa-dbab-4dcc-8fa6-0c3f13d1d177 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:18.268531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 680/1364] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:18.273938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723543-614d-478d-95be-87d5a520c663 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:18.275038 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723543-614d-478d-95be-87d5a520c663 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:18.275604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723543-614d-478d-95be-87d5a520c663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:18.303661 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8e723543-614d-478d-95be-87d5a520c663 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:18.304904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8e723543-614d-478d-95be-87d5a520c663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:18.313028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 685/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:18.360938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011ddc-37dc-4602-9b05-bf1c9c5cd7e2 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:18.361517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011ddc-37dc-4602-9b05-bf1c9c5cd7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:18.362010 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011ddc-37dc-4602-9b05-bf1c9c5cd7e2 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:18.368766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 681/1366] 10.222.0.49 () {54 vars in 961 bytes} [Mon May 23 17:01:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:18.375921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffae984-190e-461c-a300-5b3d5714785c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:18.375921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffae984-190e-461c-a300-5b3d5714785c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:18.376177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffae984-190e-461c-a300-5b3d5714785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:18.398685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-bffae984-190e-461c-a300-5b3d5714785c None None] MFA Rules not processed for user `9884780c88aa48ffa92a696740761387`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:18.400681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bffae984-190e-461c-a300-5b3d5714785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:18.410514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 686/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Mon May 23 17:01:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:18.418697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c011ddc-37dc-4602-9b05-bf1c9c5cd7e2 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:18.433889 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c011ddc-37dc-4602-9b05-bf1c9c5cd7e2 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:18.439366 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca25a4-6c74-4b12-b039-b9b587c84d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:18.440009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca25a4-6c74-4b12-b039-b9b587c84d57 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:18.440296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca25a4-6c74-4b12-b039-b9b587c84d57 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:18.440574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca25a4-6c74-4b12-b039-b9b587c84d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:18.449685 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca25a4-6c74-4b12-b039-b9b587c84d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:18.451571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca25a4-6c74-4b12-b039-b9b587c84d57 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:18.465016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 682/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:20.799734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb83a4-2373-4511-b73a-4a65a4e3eb70 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:20.800250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb83a4-2373-4511-b73a-4a65a4e3eb70 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:20.800333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb83a4-2373-4511-b73a-4a65a4e3eb70 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:20.801877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 687/1369] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:20.807788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d98b3-080e-448f-9466-79474b5bb268 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:20.808287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d98b3-080e-448f-9466-79474b5bb268 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:20.808442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d98b3-080e-448f-9466-79474b5bb268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:20.832471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e42d98b3-080e-448f-9466-79474b5bb268 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:20.834253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e42d98b3-080e-448f-9466-79474b5bb268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:20.846613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 683/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:01:20.897352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb83a4-2373-4511-b73a-4a65a4e3eb70 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:20.913781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb83a4-2373-4511-b73a-4a65a4e3eb70 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:20.920323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c4d99-638d-4804-986e-abe5d77dafa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:20.920988 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c4d99-638d-4804-986e-abe5d77dafa9 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:20.921276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c4d99-638d-4804-986e-abe5d77dafa9 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:20.921556 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c4d99-638d-4804-986e-abe5d77dafa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:20.930961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c4d99-638d-4804-986e-abe5d77dafa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:20.932553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c4d99-638d-4804-986e-abe5d77dafa9 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:20.942608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 688/1371] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:21.089763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ebb2d-0deb-4e35-925c-5bb124989101 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:21.090395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ebb2d-0deb-4e35-925c-5bb124989101 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:21.090770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ebb2d-0deb-4e35-925c-5bb124989101 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:21.092517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 684/1372] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:21.098688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de89e9-0a51-49eb-9619-f9f43c545a82 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:21.099115 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de89e9-0a51-49eb-9619-f9f43c545a82 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:21.099531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de89e9-0a51-49eb-9619-f9f43c545a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:21.119660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-22de89e9-0a51-49eb-9619-f9f43c545a82 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:21.120895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-22de89e9-0a51-49eb-9619-f9f43c545a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:21.129538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 689/1373] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:21.439950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6ac01-b8b9-46ad-bc19-97e3cd4d7652 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:21.440243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6ac01-b8b9-46ad-bc19-97e3cd4d7652 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:21.440525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6ac01-b8b9-46ad-bc19-97e3cd4d7652 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:21.442040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 685/1374] 10.222.0.49 () {54 vars in 963 bytes} [Mon May 23 17:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:21.448919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222cead-be83-4e9c-8bbf-af7316f5fa25 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:21.449335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222cead-be83-4e9c-8bbf-af7316f5fa25 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:21.449704 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222cead-be83-4e9c-8bbf-af7316f5fa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:21.502448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d222cead-be83-4e9c-8bbf-af7316f5fa25 None None] MFA Rules not processed for user `c91dcf97796941718e251912271aea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:21.503922 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d222cead-be83-4e9c-8bbf-af7316f5fa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:21.573962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 690/1375] 10.222.0.49 () {58 vars in 1060 bytes} [Mon May 23 17:01:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:01:21.579126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6ac01-b8b9-46ad-bc19-97e3cd4d7652 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:21.591031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6ac01-b8b9-46ad-bc19-97e3cd4d7652 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:21.594824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e92e1-b068-498c-95fd-46330cd4e8e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:21.595470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e92e1-b068-498c-95fd-46330cd4e8e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:21.595755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e92e1-b068-498c-95fd-46330cd4e8e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:21.596243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e92e1-b068-498c-95fd-46330cd4e8e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:21.606491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e92e1-b068-498c-95fd-46330cd4e8e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:21.607940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e92e1-b068-498c-95fd-46330cd4e8e4 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:21.618291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 686/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:23.207951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988d368-b125-4d0d-8cd2-a1712ccb7e75 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:23.208540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988d368-b125-4d0d-8cd2-a1712ccb7e75 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:23.208540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988d368-b125-4d0d-8cd2-a1712ccb7e75 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:23.209965 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 691/1377] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:23.216665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e3751-4e52-430d-af36-1f652163c664 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:23.217257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e3751-4e52-430d-af36-1f652163c664 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:23.217381 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e3751-4e52-430d-af36-1f652163c664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:23.236640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-1e8e3751-4e52-430d-af36-1f652163c664 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:23.237879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1e8e3751-4e52-430d-af36-1f652163c664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:23.246024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 687/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:23.292841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988d368-b125-4d0d-8cd2-a1712ccb7e75 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:23.308462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988d368-b125-4d0d-8cd2-a1712ccb7e75 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:23.314176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dcb2a-c63e-4a05-baf6-05a21392db6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:23.315180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dcb2a-c63e-4a05-baf6-05a21392db6a service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:23.315468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dcb2a-c63e-4a05-baf6-05a21392db6a service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:23.315740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dcb2a-c63e-4a05-baf6-05a21392db6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:23.325832 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dcb2a-c63e-4a05-baf6-05a21392db6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:23.327534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dcb2a-c63e-4a05-baf6-05a21392db6a service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:23.331923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:23.339868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 692/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:25.608406 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131431c-ae4f-447a-b916-7139c1c49977 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:25.608967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131431c-ae4f-447a-b916-7139c1c49977 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:25.608967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131431c-ae4f-447a-b916-7139c1c49977 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:25.610308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 688/1380] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:25.615550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1655-2c25-420e-82d0-97352d446498 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:25.616042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1655-2c25-420e-82d0-97352d446498 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:25.616141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1655-2c25-420e-82d0-97352d446498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:25.634758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6a7f1655-2c25-420e-82d0-97352d446498 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:25.635949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6a7f1655-2c25-420e-82d0-97352d446498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:25.643897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 693/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:25.688426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131431c-ae4f-447a-b916-7139c1c49977 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:25.704479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131431c-ae4f-447a-b916-7139c1c49977 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:25.710435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4a79c-ab68-4835-8dc0-ab7d8ce53499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:25.711257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a79c-ab68-4835-8dc0-ab7d8ce53499 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:25.712273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a79c-ab68-4835-8dc0-ab7d8ce53499 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:25.712810 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a79c-ab68-4835-8dc0-ab7d8ce53499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:25.722422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4a79c-ab68-4835-8dc0-ab7d8ce53499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:25.724406 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4a79c-ab68-4835-8dc0-ab7d8ce53499 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:25.735153 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 689/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:27.985443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f61b2-15cf-4a89-bef0-59ca8403f750 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:27.985986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f61b2-15cf-4a89-bef0-59ca8403f750 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:27.985986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f61b2-15cf-4a89-bef0-59ca8403f750 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:27.987502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 694/1383] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:27.992738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbc615-b926-4812-a0de-2b45e7c3fd17 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:27.993140 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbc615-b926-4812-a0de-2b45e7c3fd17 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:27.993306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbc615-b926-4812-a0de-2b45e7c3fd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:28.012631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9dbbc615-b926-4812-a0de-2b45e7c3fd17 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:28.013825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9dbbc615-b926-4812-a0de-2b45e7c3fd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:28.023396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 690/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:28.064955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f61b2-15cf-4a89-bef0-59ca8403f750 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:28.084154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f61b2-15cf-4a89-bef0-59ca8403f750 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:28.091388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bec4d-ee6f-4e13-826f-09546eb3856a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:28.092250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bec4d-ee6f-4e13-826f-09546eb3856a service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:28.092712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bec4d-ee6f-4e13-826f-09546eb3856a service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:28.093156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bec4d-ee6f-4e13-826f-09546eb3856a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:28.102755 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bec4d-ee6f-4e13-826f-09546eb3856a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:28.104583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bec4d-ee6f-4e13-826f-09546eb3856a service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:28.131137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 695/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:30.368558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714fd84-136d-47db-af6b-bebd734a9821 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:30.369314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714fd84-136d-47db-af6b-bebd734a9821 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:30.369314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714fd84-136d-47db-af6b-bebd734a9821 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:30.370828 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 691/1386] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:30.376243 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf13b9f-f4ae-4ded-9398-dac32adb3c03 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:30.376730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf13b9f-f4ae-4ded-9398-dac32adb3c03 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:30.376912 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf13b9f-f4ae-4ded-9398-dac32adb3c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:30.395449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9bf13b9f-f4ae-4ded-9398-dac32adb3c03 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:30.396645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9bf13b9f-f4ae-4ded-9398-dac32adb3c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:30.404926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 696/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:30.450806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714fd84-136d-47db-af6b-bebd734a9821 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:30.469870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714fd84-136d-47db-af6b-bebd734a9821 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:30.477400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b45b7d-2e41-41d7-ba13-06d7488600b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:30.478227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b45b7d-2e41-41d7-ba13-06d7488600b1 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:30.478705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b45b7d-2e41-41d7-ba13-06d7488600b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:30.479073 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b45b7d-2e41-41d7-ba13-06d7488600b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:30.490073 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b45b7d-2e41-41d7-ba13-06d7488600b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:30.492216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b45b7d-2e41-41d7-ba13-06d7488600b1 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:30.504682 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 692/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:33.185323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d9e12-0e43-453a-b0be-8f1fba4712c5 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:33.185860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d9e12-0e43-453a-b0be-8f1fba4712c5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:33.186054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d9e12-0e43-453a-b0be-8f1fba4712c5 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:33.187551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 697/1389] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:01:33.193249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9bd05-8aef-4198-ab16-da3bb8c9b9eb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:33.193660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9bd05-8aef-4198-ab16-da3bb8c9b9eb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:33.194148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9bd05-8aef-4198-ab16-da3bb8c9b9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:33.213253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d6f9bd05-8aef-4198-ab16-da3bb8c9b9eb None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:33.214484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d6f9bd05-8aef-4198-ab16-da3bb8c9b9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:33.222220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 693/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:33.267583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d9e12-0e43-453a-b0be-8f1fba4712c5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:33.285957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d9e12-0e43-453a-b0be-8f1fba4712c5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:33.293979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ab937-c311-43e5-954a-427718a99ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:33.294820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ab937-c311-43e5-954a-427718a99ce0 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:33.295185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ab937-c311-43e5-954a-427718a99ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:33.295549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ab937-c311-43e5-954a-427718a99ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:33.306955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ab937-c311-43e5-954a-427718a99ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:33.309049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ab937-c311-43e5-954a-427718a99ce0 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:33.321819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 698/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:35.609915 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0a50d-891d-45a3-beb3-59acedf4ee95 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:35.610591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0a50d-891d-45a3-beb3-59acedf4ee95 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:35.610591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0a50d-891d-45a3-beb3-59acedf4ee95 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:35.611994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 694/1392] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:35.617102 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bb4e0-7363-460f-aa38-7ee6bf9e2f30 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:35.618035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bb4e0-7363-460f-aa38-7ee6bf9e2f30 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:35.618282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bb4e0-7363-460f-aa38-7ee6bf9e2f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:35.636647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6e7bb4e0-7363-460f-aa38-7ee6bf9e2f30 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:35.637846 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6e7bb4e0-7363-460f-aa38-7ee6bf9e2f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:35.645591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 699/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:35.689710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0a50d-891d-45a3-beb3-59acedf4ee95 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:35.704959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0a50d-891d-45a3-beb3-59acedf4ee95 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:35.710412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca13bc5-c1f8-48f1-afec-b6985031c060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:35.711082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca13bc5-c1f8-48f1-afec-b6985031c060 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:35.711527 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca13bc5-c1f8-48f1-afec-b6985031c060 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:35.711832 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca13bc5-c1f8-48f1-afec-b6985031c060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:35.720001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca13bc5-c1f8-48f1-afec-b6985031c060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:35.721583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca13bc5-c1f8-48f1-afec-b6985031c060 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:35.731013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 695/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:37.363510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e9d97-10e4-48c8-b626-008280c7af68 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:37.364083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e9d97-10e4-48c8-b626-008280c7af68 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:37.364083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e9d97-10e4-48c8-b626-008280c7af68 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:37.365471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 700/1395] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:37.371299 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35213a81-af63-41d6-98f9-fea7c2168d63 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:37.371779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35213a81-af63-41d6-98f9-fea7c2168d63 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:37.371959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35213a81-af63-41d6-98f9-fea7c2168d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:37.378141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=52 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:37.391487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-35213a81-af63-41d6-98f9-fea7c2168d63 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:37.392686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-35213a81-af63-41d6-98f9-fea7c2168d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:37.400893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 696/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:37.456376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc9069-7b10-42bc-83ce-ffa2453f9a5d None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:37.456739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc9069-7b10-42bc-83ce-ffa2453f9a5d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:37.457086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc9069-7b10-42bc-83ce-ffa2453f9a5d None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:37.458553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 701/1397] 10.222.0.49 () {54 vars in 962 bytes} [Mon May 23 17:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:37.463918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e55eb-dbe5-437e-9714-33f6199b6929 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:37.464215 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e55eb-dbe5-437e-9714-33f6199b6929 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:37.464521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e55eb-dbe5-437e-9714-33f6199b6929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:37.514976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-924e55eb-dbe5-437e-9714-33f6199b6929 None None] MFA Rules not processed for user `a6a5b9c982724df0b88ce6ad46dc37e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:37.516178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-924e55eb-dbe5-437e-9714-33f6199b6929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:37.578544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 697/1398] 10.222.0.49 () {58 vars in 1059 bytes} [Mon May 23 17:01:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:37.586993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc9069-7b10-42bc-83ce-ffa2453f9a5d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:37.597690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc9069-7b10-42bc-83ce-ffa2453f9a5d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:37.601198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0b9e9-ec2e-460a-ab82-e130b472695c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5b9c982724df0b88ce6ad46dc37e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:37.601839 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0b9e9-ec2e-460a-ab82-e130b472695c service glance] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:37.602126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0b9e9-ec2e-460a-ab82-e130b472695c service glance] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:37.602435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0b9e9-ec2e-460a-ab82-e130b472695c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:37.611378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0b9e9-ec2e-460a-ab82-e130b472695c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:37.612788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0b9e9-ec2e-460a-ab82-e130b472695c service glance] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:37.624695 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 702/1399] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:37.971155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b2be-dd39-4843-a91c-2999120f03a0 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:37.971473 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b2be-dd39-4843-a91c-2999120f03a0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:37.971757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b2be-dd39-4843-a91c-2999120f03a0 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:37.973203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 698/1400] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:37.979115 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebd78a-3593-4554-89c0-e32448bacba2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:37.979411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebd78a-3593-4554-89c0-e32448bacba2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:37.979719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebd78a-3593-4554-89c0-e32448bacba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:37.998046 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-42ebd78a-3593-4554-89c0-e32448bacba2 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:37.999257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-42ebd78a-3593-4554-89c0-e32448bacba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:38.007028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 703/1401] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:01:38.051160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9b2be-dd39-4843-a91c-2999120f03a0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:38.065735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9b2be-dd39-4843-a91c-2999120f03a0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:38.072126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b48cfb-ba23-4c33-a533-ea0eb0888579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:38.072764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48cfb-ba23-4c33-a533-ea0eb0888579 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:38.073051 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48cfb-ba23-4c33-a533-ea0eb0888579 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:38.073327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48cfb-ba23-4c33-a533-ea0eb0888579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:38.081981 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b48cfb-ba23-4c33-a533-ea0eb0888579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:38.083589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b48cfb-ba23-4c33-a533-ea0eb0888579 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:38.093707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 699/1402] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:38.202312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191d10c-6f61-4809-a918-80c2c518b09f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:38.202680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191d10c-6f61-4809-a918-80c2c518b09f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:38.202968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191d10c-6f61-4809-a918-80c2c518b09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:38.256933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2191d10c-6f61-4809-a918-80c2c518b09f None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:38.258771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2191d10c-6f61-4809-a918-80c2c518b09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:38.339532 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 704/1403] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:01:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:38.379803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dedded-85a0-45cb-9273-5fefff3ea109 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:38.380277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dedded-85a0-45cb-9273-5fefff3ea109 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:38.380496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dedded-85a0-45cb-9273-5fefff3ea109 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:38.382008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 700/1404] 10.222.0.49 () {54 vars in 942 bytes} [Mon May 23 17:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:38.389226 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa98236-692e-4731-9b49-a44cd55a9bc2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:38.389683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa98236-692e-4731-9b49-a44cd55a9bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:38.389793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa98236-692e-4731-9b49-a44cd55a9bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:38.441685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3fa98236-692e-4731-9b49-a44cd55a9bc2 None None] MFA Rules not processed for user `c22f94b1abe248c3969b68e17755f113`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:38.442908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3fa98236-692e-4731-9b49-a44cd55a9bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:38.477437 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:38.518047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 705/1405] 10.222.0.49 () {58 vars in 1039 bytes} [Mon May 23 17:01:38 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:01:38.535967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dedded-85a0-45cb-9273-5fefff3ea109 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:38.550862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dedded-85a0-45cb-9273-5fefff3ea109 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:38.556114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14216939-0f13-40ed-b373-46804de756c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:38.556792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14216939-0f13-40ed-b373-46804de756c4 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:38.557080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14216939-0f13-40ed-b373-46804de756c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:38.557359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14216939-0f13-40ed-b373-46804de756c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:38.565656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14216939-0f13-40ed-b373-46804de756c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:38.567514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14216939-0f13-40ed-b373-46804de756c4 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:38.577306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 701/1406] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:01:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:01:40.361217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c61b-6f71-4903-9a39-ff77335ce954 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:40.361787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c61b-6f71-4903-9a39-ff77335ce954 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:40.361787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c61b-6f71-4903-9a39-ff77335ce954 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:40.369228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 706/1407] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:01:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:01:40.369609 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16285508-61c3-422a-8759-8d058cbc5459 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:40.370543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16285508-61c3-422a-8759-8d058cbc5459 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:40.370837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16285508-61c3-422a-8759-8d058cbc5459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:40.394946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-16285508-61c3-422a-8759-8d058cbc5459 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:01:40.396464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-16285508-61c3-422a-8759-8d058cbc5459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:40.405552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 702/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:01:40.456313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791c61b-6f71-4903-9a39-ff77335ce954 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:40.474173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791c61b-6f71-4903-9a39-ff77335ce954 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:40.488577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee618b0-b65f-4df9-a9c6-ab16b6c4b28f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:40.489544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee618b0-b65f-4df9-a9c6-ab16b6c4b28f service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:40.489826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee618b0-b65f-4df9-a9c6-ab16b6c4b28f service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:40.490110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee618b0-b65f-4df9-a9c6-ab16b6c4b28f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:40.500070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee618b0-b65f-4df9-a9c6-ab16b6c4b28f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:40.501679 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee618b0-b65f-4df9-a9c6-ab16b6c4b28f service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:40.512453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 707/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:50.386670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=55 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:50.507553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=21 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:02:02.353293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01aae26-384e-4b38-8900-4fd52248ecd0 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:02.353998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01aae26-384e-4b38-8900-4fd52248ecd0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:02.353998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01aae26-384e-4b38-8900-4fd52248ecd0 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:02.355267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 703/1410] 10.222.0.49 () {54 vars in 918 bytes} [Mon May 23 17:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:02.360229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14749890-422e-4bdc-98d5-b145227053a5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:02.360669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14749890-422e-4bdc-98d5-b145227053a5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:02.360800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14749890-422e-4bdc-98d5-b145227053a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:02.378822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-14749890-422e-4bdc-98d5-b145227053a5 None None] MFA Rules not processed for user `81fb8b261e2142fcbf8d23bd010bf715`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:02.380021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-14749890-422e-4bdc-98d5-b145227053a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:02.388989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 708/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Mon May 23 17:02:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:02.403580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014929f-6ad4-4947-a519-09928907445d None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:02.403870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014929f-6ad4-4947-a519-09928907445d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:02.404151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014929f-6ad4-4947-a519-09928907445d None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:02.405478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 704/1412] 10.222.0.49 () {54 vars in 918 bytes} [Mon May 23 17:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:02.409872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ef441-6a45-4d5b-9d2a-d6dabb85e7f0 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:02.410165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ef441-6a45-4d5b-9d2a-d6dabb85e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:02.410477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ef441-6a45-4d5b-9d2a-d6dabb85e7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:02.427894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1e4ef441-6a45-4d5b-9d2a-d6dabb85e7f0 None None] MFA Rules not processed for user `9884780c88aa48ffa92a696740761387`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:02.429085 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1e4ef441-6a45-4d5b-9d2a-d6dabb85e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:02.438180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 709/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Mon May 23 17:02:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:02:05.102946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461c7e3-55f2-46c8-a266-ec596ee78676 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:05.103528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461c7e3-55f2-46c8-a266-ec596ee78676 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:05.103646 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461c7e3-55f2-46c8-a266-ec596ee78676 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:05.104959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:05.110527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4d019-c056-435e-9ea3-a19ab6e5884c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:05.110957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4d019-c056-435e-9ea3-a19ab6e5884c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:05.111084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4d019-c056-435e-9ea3-a19ab6e5884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:05.129044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e5a4d019-c056-435e-9ea3-a19ab6e5884c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:05.130245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e5a4d019-c056-435e-9ea3-a19ab6e5884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:05.138990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:05.182762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461c7e3-55f2-46c8-a266-ec596ee78676 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:05.198002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461c7e3-55f2-46c8-a266-ec596ee78676 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:05.203669 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50446bc-6830-475d-8db2-b1d57dd01de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:05.204303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50446bc-6830-475d-8db2-b1d57dd01de0 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:05.204589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50446bc-6830-475d-8db2-b1d57dd01de0 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:05.204866 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50446bc-6830-475d-8db2-b1d57dd01de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:05.213252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50446bc-6830-475d-8db2-b1d57dd01de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:05.214853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50446bc-6830-475d-8db2-b1d57dd01de0 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:05.224044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 706/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:06.218523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95511ec-5385-4fc7-bfbc-d2b0ca0db168 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:06.219074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95511ec-5385-4fc7-bfbc-d2b0ca0db168 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:06.219074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95511ec-5385-4fc7-bfbc-d2b0ca0db168 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:06.220473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:06.225443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3be5-12e3-4e62-9ba4-d8386dcd3dba None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:06.225870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3be5-12e3-4e62-9ba4-d8386dcd3dba None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:06.226080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3be5-12e3-4e62-9ba4-d8386dcd3dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:06.243771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-857e3be5-12e3-4e62-9ba4-d8386dcd3dba None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:06.244966 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-857e3be5-12e3-4e62-9ba4-d8386dcd3dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:06.252784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:06.418564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95511ec-5385-4fc7-bfbc-d2b0ca0db168 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:06.433521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95511ec-5385-4fc7-bfbc-d2b0ca0db168 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:06.438812 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13395f-4329-4f6b-8b11-c1ddbcb7690d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:06.439468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13395f-4329-4f6b-8b11-c1ddbcb7690d service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:06.439748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13395f-4329-4f6b-8b11-c1ddbcb7690d service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:06.440018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13395f-4329-4f6b-8b11-c1ddbcb7690d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:06.448918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13395f-4329-4f6b-8b11-c1ddbcb7690d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:06.450503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13395f-4329-4f6b-8b11-c1ddbcb7690d service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:06.459788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 712/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:07.393645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b78e3-f3d3-48bd-aef6-a36728cb025c None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:07.394235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b78e3-f3d3-48bd-aef6-a36728cb025c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:07.394235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b78e3-f3d3-48bd-aef6-a36728cb025c None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:07.395580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:07.400724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f64b02-8589-4951-8e18-fe6e7ac381d1 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:07.401134 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f64b02-8589-4951-8e18-fe6e7ac381d1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:07.401280 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f64b02-8589-4951-8e18-fe6e7ac381d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:07.418847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f4f64b02-8589-4951-8e18-fe6e7ac381d1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:07.420024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f4f64b02-8589-4951-8e18-fe6e7ac381d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:07.427619 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:07.580384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b78e3-f3d3-48bd-aef6-a36728cb025c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:07.594932 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b78e3-f3d3-48bd-aef6-a36728cb025c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:07.600247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94652e7a-7e49-46f1-97fc-2765afb73b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:07.600879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94652e7a-7e49-46f1-97fc-2765afb73b90 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:07.601779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94652e7a-7e49-46f1-97fc-2765afb73b90 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:07.601986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94652e7a-7e49-46f1-97fc-2765afb73b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:07.610006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94652e7a-7e49-46f1-97fc-2765afb73b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:07.611607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94652e7a-7e49-46f1-97fc-2765afb73b90 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:07.621414 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 709/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:08.529146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a855a88-b05f-4567-8e4f-f96de3c0b7ec None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:08.529762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a855a88-b05f-4567-8e4f-f96de3c0b7ec None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:08.529762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a855a88-b05f-4567-8e4f-f96de3c0b7ec None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:08.531245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:02:08.536170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59681663-2b7b-412a-88c3-ae95415d3eed None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:08.536565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59681663-2b7b-412a-88c3-ae95415d3eed None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:08.536730 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59681663-2b7b-412a-88c3-ae95415d3eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:08.554915 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-59681663-2b7b-412a-88c3-ae95415d3eed None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:08.556707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-59681663-2b7b-412a-88c3-ae95415d3eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:08.564461 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:08.717645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a855a88-b05f-4567-8e4f-f96de3c0b7ec None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:08.731540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a855a88-b05f-4567-8e4f-f96de3c0b7ec None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:08.736935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd055494-726f-4261-a9cd-44db44163c90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:08.737567 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd055494-726f-4261-a9cd-44db44163c90 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:08.737855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd055494-726f-4261-a9cd-44db44163c90 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:08.738134 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd055494-726f-4261-a9cd-44db44163c90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:08.746835 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd055494-726f-4261-a9cd-44db44163c90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:08.748391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd055494-726f-4261-a9cd-44db44163c90 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:08.757535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 715/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:09.659893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263edda2-dd89-46e8-978e-e320ce3cf51a None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:09.660445 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263edda2-dd89-46e8-978e-e320ce3cf51a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:09.660445 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263edda2-dd89-46e8-978e-e320ce3cf51a None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:09.661837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:09.667412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3e173-39f3-4c63-85a7-78f4bb6403fa None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:09.667824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3e173-39f3-4c63-85a7-78f4bb6403fa None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:09.667984 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3e173-39f3-4c63-85a7-78f4bb6403fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:09.685820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a5d3e173-39f3-4c63-85a7-78f4bb6403fa None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:09.687054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a5d3e173-39f3-4c63-85a7-78f4bb6403fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:09.694708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:09.844918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263edda2-dd89-46e8-978e-e320ce3cf51a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:09.859435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263edda2-dd89-46e8-978e-e320ce3cf51a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:09.864712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9ba44-918c-4851-92f6-b8d5e00a8d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:09.865342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ba44-918c-4851-92f6-b8d5e00a8d5b service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:09.865628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ba44-918c-4851-92f6-b8d5e00a8d5b service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:09.865905 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ba44-918c-4851-92f6-b8d5e00a8d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:09.874021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9ba44-918c-4851-92f6-b8d5e00a8d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:09.875630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9ba44-918c-4851-92f6-b8d5e00a8d5b service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:09.885359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 712/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:10.738649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5349ebf-a2b6-4694-a474-aaff53a3ccb3 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:10.739185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5349ebf-a2b6-4694-a474-aaff53a3ccb3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:10.739185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5349ebf-a2b6-4694-a474-aaff53a3ccb3 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:10.740527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:10.745855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba08552-3445-48a0-8dbf-cd3dbdfc5fb5 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:10.746271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba08552-3445-48a0-8dbf-cd3dbdfc5fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:10.746447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba08552-3445-48a0-8dbf-cd3dbdfc5fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:10.764760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6ba08552-3445-48a0-8dbf-cd3dbdfc5fb5 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:10.765945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6ba08552-3445-48a0-8dbf-cd3dbdfc5fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:10.774610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:10.922388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5349ebf-a2b6-4694-a474-aaff53a3ccb3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:10.937425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5349ebf-a2b6-4694-a474-aaff53a3ccb3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:10.942815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aab6d9-7a1d-4a1d-b3ee-a4f71b7617ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:10.943450 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aab6d9-7a1d-4a1d-b3ee-a4f71b7617ca service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:10.943737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aab6d9-7a1d-4a1d-b3ee-a4f71b7617ca service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:10.944016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aab6d9-7a1d-4a1d-b3ee-a4f71b7617ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:10.952856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aab6d9-7a1d-4a1d-b3ee-a4f71b7617ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:10.954448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aab6d9-7a1d-4a1d-b3ee-a4f71b7617ca service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:10.963952 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 718/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:11.818717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1a211-469e-4813-8860-f62e1bcde8c7 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:11.819196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1a211-469e-4813-8860-f62e1bcde8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:11.819343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1a211-469e-4813-8860-f62e1bcde8c7 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:11.820680 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:11.825611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477ea6-b7b7-4a89-a69b-9c184c3d3f16 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:11.826257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477ea6-b7b7-4a89-a69b-9c184c3d3f16 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:11.826454 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477ea6-b7b7-4a89-a69b-9c184c3d3f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:11.844946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b5477ea6-b7b7-4a89-a69b-9c184c3d3f16 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:11.846135 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b5477ea6-b7b7-4a89-a69b-9c184c3d3f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:11.854444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:12.000651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1a211-469e-4813-8860-f62e1bcde8c7 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:12.015983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1a211-469e-4813-8860-f62e1bcde8c7 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:12.021228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29c1c2-9fca-40f5-bdce-270a625c6827 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:12.021857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29c1c2-9fca-40f5-bdce-270a625c6827 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:12.022141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29c1c2-9fca-40f5-bdce-270a625c6827 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:12.022455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29c1c2-9fca-40f5-bdce-270a625c6827 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:12.031236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29c1c2-9fca-40f5-bdce-270a625c6827 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:12.032803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29c1c2-9fca-40f5-bdce-270a625c6827 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:12.042330 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 715/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:12.904893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaee24-30fe-4b35-b7e8-893880abfa26 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:12.905461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaee24-30fe-4b35-b7e8-893880abfa26 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:12.905461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaee24-30fe-4b35-b7e8-893880abfa26 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:12.906864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:12.911825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1890f2-14fd-4957-974f-13582f25759e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:12.912207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1890f2-14fd-4957-974f-13582f25759e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:12.912393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1890f2-14fd-4957-974f-13582f25759e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:12.930816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0e1890f2-14fd-4957-974f-13582f25759e None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:12.932704 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0e1890f2-14fd-4957-974f-13582f25759e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:12.940724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:13.090278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaee24-30fe-4b35-b7e8-893880abfa26 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:13.105398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaee24-30fe-4b35-b7e8-893880abfa26 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:13.110705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30081811-7fd2-480c-a457-35e715b2a47d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:13.111332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30081811-7fd2-480c-a457-35e715b2a47d service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:13.111613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30081811-7fd2-480c-a457-35e715b2a47d service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:13.111884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30081811-7fd2-480c-a457-35e715b2a47d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:13.119994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30081811-7fd2-480c-a457-35e715b2a47d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:13.121552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30081811-7fd2-480c-a457-35e715b2a47d service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:13.130691 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 721/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:13.985778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55e863-a3d0-4472-bf0a-ae61a1da6f92 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:13.986348 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55e863-a3d0-4472-bf0a-ae61a1da6f92 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:13.986348 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55e863-a3d0-4472-bf0a-ae61a1da6f92 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:13.987779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:13.992939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb456b-2807-4204-9404-352fdc780334 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:13.993368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb456b-2807-4204-9404-352fdc780334 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:13.993551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb456b-2807-4204-9404-352fdc780334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:14.011429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-70bb456b-2807-4204-9404-352fdc780334 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:14.012608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-70bb456b-2807-4204-9404-352fdc780334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:14.020136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:14.173405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55e863-a3d0-4472-bf0a-ae61a1da6f92 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:14.187670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55e863-a3d0-4472-bf0a-ae61a1da6f92 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:14.192917 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092f71a-10c8-4091-9c98-cf1baf2e09a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:14.193547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f71a-10c8-4091-9c98-cf1baf2e09a0 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:14.193831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f71a-10c8-4091-9c98-cf1baf2e09a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:14.194108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f71a-10c8-4091-9c98-cf1baf2e09a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:14.203012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092f71a-10c8-4091-9c98-cf1baf2e09a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:14.204577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092f71a-10c8-4091-9c98-cf1baf2e09a0 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:14.214618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 718/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:16.326891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e18f3b-9ca3-4208-9ea5-3da8aed7ee8e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:16.327432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e18f3b-9ca3-4208-9ea5-3da8aed7ee8e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:16.327432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e18f3b-9ca3-4208-9ea5-3da8aed7ee8e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:16.328837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:16.334069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5fbf2-2c08-4407-8257-0c97306c4813 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:16.334512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5fbf2-2c08-4407-8257-0c97306c4813 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:16.334661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5fbf2-2c08-4407-8257-0c97306c4813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:16.352210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c6b5fbf2-2c08-4407-8257-0c97306c4813 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:16.353546 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c6b5fbf2-2c08-4407-8257-0c97306c4813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:16.363532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:16.403422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e18f3b-9ca3-4208-9ea5-3da8aed7ee8e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:16.415093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e18f3b-9ca3-4208-9ea5-3da8aed7ee8e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:16.419441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c459a-e818-47ee-9748-fbc4a5eb42a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:16.420080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c459a-e818-47ee-9748-fbc4a5eb42a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:16.420370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c459a-e818-47ee-9748-fbc4a5eb42a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:16.420649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c459a-e818-47ee-9748-fbc4a5eb42a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:16.429394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c459a-e818-47ee-9748-fbc4a5eb42a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:16.430849 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c459a-e818-47ee-9748-fbc4a5eb42a0 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:16.441307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 724/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:18.803700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741af421-6c24-4ff4-99fe-5c0edc32cd83 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:18.804161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741af421-6c24-4ff4-99fe-5c0edc32cd83 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:18.804259 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741af421-6c24-4ff4-99fe-5c0edc32cd83 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:18.805615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:18.811747 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a361d7-749b-4715-9bcd-44df7741b54d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:18.812188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a361d7-749b-4715-9bcd-44df7741b54d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:18.812343 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a361d7-749b-4715-9bcd-44df7741b54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:18.830167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-58a361d7-749b-4715-9bcd-44df7741b54d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:18.831415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-58a361d7-749b-4715-9bcd-44df7741b54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:18.839452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:18.877285 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741af421-6c24-4ff4-99fe-5c0edc32cd83 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:18.888196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741af421-6c24-4ff4-99fe-5c0edc32cd83 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:18.891689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cb8ce-2c60-422c-a7c5-59dcf429a071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:18.892320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cb8ce-2c60-422c-a7c5-59dcf429a071 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:18.892607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cb8ce-2c60-422c-a7c5-59dcf429a071 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:18.892883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cb8ce-2c60-422c-a7c5-59dcf429a071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:18.902163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cb8ce-2c60-422c-a7c5-59dcf429a071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:18.903635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cb8ce-2c60-422c-a7c5-59dcf429a071 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:18.912951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 721/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:21.453359 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96fee7-9c3f-4ea5-a69a-bd8b5e5af2a3 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:21.453908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96fee7-9c3f-4ea5-a69a-bd8b5e5af2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:21.453908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96fee7-9c3f-4ea5-a69a-bd8b5e5af2a3 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:21.455330 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:21.460507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74284d2e-49f5-4e85-9866-a0f3bc465357 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:21.460956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74284d2e-49f5-4e85-9866-a0f3bc465357 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:21.461063 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74284d2e-49f5-4e85-9866-a0f3bc465357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:21.479768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-74284d2e-49f5-4e85-9866-a0f3bc465357 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:21.480959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-74284d2e-49f5-4e85-9866-a0f3bc465357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:21.488846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:21.527105 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96fee7-9c3f-4ea5-a69a-bd8b5e5af2a3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:21.537849 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96fee7-9c3f-4ea5-a69a-bd8b5e5af2a3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:21.542140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fd7c6-5c4b-46d3-81a0-a9a2d0b557d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:21.542820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fd7c6-5c4b-46d3-81a0-a9a2d0b557d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:21.543104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fd7c6-5c4b-46d3-81a0-a9a2d0b557d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:21.543380 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fd7c6-5c4b-46d3-81a0-a9a2d0b557d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:21.552161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fd7c6-5c4b-46d3-81a0-a9a2d0b557d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:21.553580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fd7c6-5c4b-46d3-81a0-a9a2d0b557d5 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:21.563378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 727/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:23.916945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e568573-84cd-4278-bfb9-b5c3474562c6 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:23.917537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e568573-84cd-4278-bfb9-b5c3474562c6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:23.917537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e568573-84cd-4278-bfb9-b5c3474562c6 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:23.918912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:23.924230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dec02-c080-4d54-a8f9-43058ce4d033 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:23.924657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dec02-c080-4d54-a8f9-43058ce4d033 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:23.924794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dec02-c080-4d54-a8f9-43058ce4d033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:23.942836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0e1dec02-c080-4d54-a8f9-43058ce4d033 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:23.944034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0e1dec02-c080-4d54-a8f9-43058ce4d033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:23.952025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:23.989640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e568573-84cd-4278-bfb9-b5c3474562c6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:24.000263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e568573-84cd-4278-bfb9-b5c3474562c6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:24.003746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ac7dd-5dd2-4123-aa87-d6c4c22556f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:24.004373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ac7dd-5dd2-4123-aa87-d6c4c22556f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:24.004655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ac7dd-5dd2-4123-aa87-d6c4c22556f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:24.004930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ac7dd-5dd2-4123-aa87-d6c4c22556f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:24.014112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ac7dd-5dd2-4123-aa87-d6c4c22556f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:24.015579 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ac7dd-5dd2-4123-aa87-d6c4c22556f9 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:24.024844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 724/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:26.269091 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789de93f-ff87-4db5-ba06-0f587f4b562e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:26.269665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789de93f-ff87-4db5-ba06-0f587f4b562e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:26.269665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789de93f-ff87-4db5-ba06-0f587f4b562e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:26.271057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:26.277145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcd4ae-20b0-4dbd-9440-cdd86f63855c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:26.277626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcd4ae-20b0-4dbd-9440-cdd86f63855c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:26.277736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcd4ae-20b0-4dbd-9440-cdd86f63855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:26.295324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e5bcd4ae-20b0-4dbd-9440-cdd86f63855c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:26.296804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e5bcd4ae-20b0-4dbd-9440-cdd86f63855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:26.304620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:26.343939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789de93f-ff87-4db5-ba06-0f587f4b562e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:26.355151 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789de93f-ff87-4db5-ba06-0f587f4b562e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:26.358683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecb926-d8fe-4271-adc0-37b87a322926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:26.359321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecb926-d8fe-4271-adc0-37b87a322926 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:26.359627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecb926-d8fe-4271-adc0-37b87a322926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:26.359892 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecb926-d8fe-4271-adc0-37b87a322926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:26.368737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecb926-d8fe-4271-adc0-37b87a322926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:26.370154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecb926-d8fe-4271-adc0-37b87a322926 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:26.379433 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 730/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:28.625052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a8d9-6b0a-4649-b182-cf17d06d2742 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:28.625435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a8d9-6b0a-4649-b182-cf17d06d2742 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:28.625435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a8d9-6b0a-4649-b182-cf17d06d2742 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:28.627079 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:28.632484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686e44-3260-42ae-bd7d-3e396684c1c3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:28.632910 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686e44-3260-42ae-bd7d-3e396684c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:28.633066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686e44-3260-42ae-bd7d-3e396684c1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:28.653634 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-99686e44-3260-42ae-bd7d-3e396684c1c3 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:28.654907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-99686e44-3260-42ae-bd7d-3e396684c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:28.662819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:28.702435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a8d9-6b0a-4649-b182-cf17d06d2742 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:28.704130 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d236a8d9-6b0a-4649-b182-cf17d06d2742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:28.718042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a8d9-6b0a-4649-b182-cf17d06d2742 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:28.721590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0dc07-c52d-470a-a2db-8bba2be0f247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:28.722232 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0dc07-c52d-470a-a2db-8bba2be0f247 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:28.722555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0dc07-c52d-470a-a2db-8bba2be0f247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:28.722832 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0dc07-c52d-470a-a2db-8bba2be0f247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:28.732568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0dc07-c52d-470a-a2db-8bba2be0f247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:28.734080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0dc07-c52d-470a-a2db-8bba2be0f247 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:28.747161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 727/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:31.021264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c07f1b-91b7-4197-8d19-27123d2c78e2 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:31.021831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c07f1b-91b7-4197-8d19-27123d2c78e2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:31.021831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c07f1b-91b7-4197-8d19-27123d2c78e2 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:31.023217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:31.029341 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa9f18-2525-4e40-9ed3-e24fe927f44f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:31.029783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa9f18-2525-4e40-9ed3-e24fe927f44f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:31.029899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa9f18-2525-4e40-9ed3-e24fe927f44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:31.036071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=70 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:02:31.049426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-36aa9f18-2525-4e40-9ed3-e24fe927f44f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:31.050658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-36aa9f18-2525-4e40-9ed3-e24fe927f44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:31.058349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:31.095287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c07f1b-91b7-4197-8d19-27123d2c78e2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:31.100509 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=73 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:02:31.107588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c07f1b-91b7-4197-8d19-27123d2c78e2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:31.111016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442a10d-bf4a-4aa2-b6b0-ea5e4eae30f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:31.111641 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442a10d-bf4a-4aa2-b6b0-ea5e4eae30f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:31.111923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442a10d-bf4a-4aa2-b6b0-ea5e4eae30f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:31.112198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442a10d-bf4a-4aa2-b6b0-ea5e4eae30f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:31.121083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442a10d-bf4a-4aa2-b6b0-ea5e4eae30f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:31.122592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442a10d-bf4a-4aa2-b6b0-ea5e4eae30f7 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:31.131837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 733/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:33.411403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b2b62-e0f8-47bf-92a2-255757208b9c None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:33.411950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b2b62-e0f8-47bf-92a2-255757208b9c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:33.411950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b2b62-e0f8-47bf-92a2-255757208b9c None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:33.413332 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:33.419309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dfca8-8b86-437b-91de-4e2b4c3b9510 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:33.419726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dfca8-8b86-437b-91de-4e2b4c3b9510 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:33.419883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dfca8-8b86-437b-91de-4e2b4c3b9510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:33.437315 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-543dfca8-8b86-437b-91de-4e2b4c3b9510 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:33.438545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-543dfca8-8b86-437b-91de-4e2b4c3b9510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:33.446235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:33.483462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b2b62-e0f8-47bf-92a2-255757208b9c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:33.493873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b2b62-e0f8-47bf-92a2-255757208b9c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:33.497736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5d952-49d6-490d-afb2-2ff5ab259588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:33.498376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5d952-49d6-490d-afb2-2ff5ab259588 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:33.498679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5d952-49d6-490d-afb2-2ff5ab259588 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:33.498954 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5d952-49d6-490d-afb2-2ff5ab259588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:33.507684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5d952-49d6-490d-afb2-2ff5ab259588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:33.509093 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5d952-49d6-490d-afb2-2ff5ab259588 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:33.518542 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 730/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:35.751454 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d904621-89ff-4491-b545-6fceb9c47aae None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:35.752043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d904621-89ff-4491-b545-6fceb9c47aae None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:35.752043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d904621-89ff-4491-b545-6fceb9c47aae None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:35.753394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:35.758684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0326a-0283-41eb-8151-2f9446375e66 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:35.759117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0326a-0283-41eb-8151-2f9446375e66 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:35.759243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0326a-0283-41eb-8151-2f9446375e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:35.777853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-beb0326a-0283-41eb-8151-2f9446375e66 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:35.779111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-beb0326a-0283-41eb-8151-2f9446375e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:35.786865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:35.823257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d904621-89ff-4491-b545-6fceb9c47aae None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:35.834057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d904621-89ff-4491-b545-6fceb9c47aae None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:35.837523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf28e-448d-4d84-9a7c-4358a907f519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:35.838459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf28e-448d-4d84-9a7c-4358a907f519 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:35.838811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf28e-448d-4d84-9a7c-4358a907f519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:35.839094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf28e-448d-4d84-9a7c-4358a907f519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:35.847809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf28e-448d-4d84-9a7c-4358a907f519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:35.849214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf28e-448d-4d84-9a7c-4358a907f519 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:35.858571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 736/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:38.068150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf963680-f0c8-4104-9c4c-384a1889dd51 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:38.068673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf963680-f0c8-4104-9c4c-384a1889dd51 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:38.068673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf963680-f0c8-4104-9c4c-384a1889dd51 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:38.070028 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:02:38.076613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae7db1-607f-49c4-be29-5f76fbee0e49 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:38.077028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae7db1-607f-49c4-be29-5f76fbee0e49 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:38.077174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae7db1-607f-49c4-be29-5f76fbee0e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:38.094746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-82ae7db1-607f-49c4-be29-5f76fbee0e49 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:02:38.095941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-82ae7db1-607f-49c4-be29-5f76fbee0e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:02:38.103772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:02:38.140609 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf963680-f0c8-4104-9c4c-384a1889dd51 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:02:38.151282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf963680-f0c8-4104-9c4c-384a1889dd51 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:02:38.154769 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b21f00-df7e-4aaa-9934-04479e58a01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:02:38.155401 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b21f00-df7e-4aaa-9934-04479e58a01a service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:02:38.155687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b21f00-df7e-4aaa-9934-04479e58a01a service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:02:38.155967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b21f00-df7e-4aaa-9934-04479e58a01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:02:38.164676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b21f00-df7e-4aaa-9934-04479e58a01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:02:38.166714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b21f00-df7e-4aaa-9934-04479e58a01a service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:02:38.175959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 733/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:48.089751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=17 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:02:48.171888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=17 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:11.444135 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7ecbb-3bab-400b-98e2-be49ac95354e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:11.444737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7ecbb-3bab-400b-98e2-be49ac95354e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:11.444737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7ecbb-3bab-400b-98e2-be49ac95354e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:11.446092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 738/1471] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:11.451440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b94425-ea14-4a6a-b3c3-ec52a4297d36 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:11.452142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b94425-ea14-4a6a-b3c3-ec52a4297d36 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:11.452247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b94425-ea14-4a6a-b3c3-ec52a4297d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:11.469873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d4b94425-ea14-4a6a-b3c3-ec52a4297d36 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:11.471111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d4b94425-ea14-4a6a-b3c3-ec52a4297d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:11.479530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 734/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:03:11.526779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d726260-dcc7-4e52-a735-c9bb33ebd774 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:11.527075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d726260-dcc7-4e52-a735-c9bb33ebd774 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:11.527361 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d726260-dcc7-4e52-a735-c9bb33ebd774 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:11.528730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 739/1473] 10.222.0.49 () {54 vars in 962 bytes} [Mon May 23 17:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:03:11.533576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01695b5e-cfde-4fd5-b4fb-62a77c53f1b9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:11.533872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01695b5e-cfde-4fd5-b4fb-62a77c53f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:11.534155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01695b5e-cfde-4fd5-b4fb-62a77c53f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:11.554791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-01695b5e-cfde-4fd5-b4fb-62a77c53f1b9 None None] MFA Rules not processed for user `a6a5b9c982724df0b88ce6ad46dc37e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:11.556298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-01695b5e-cfde-4fd5-b4fb-62a77c53f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:11.564196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 735/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Mon May 23 17:03:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:03:11.572673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d726260-dcc7-4e52-a735-c9bb33ebd774 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:11.583499 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d726260-dcc7-4e52-a735-c9bb33ebd774 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:11.587567 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ab292-d549-41fe-8114-d05bce798c49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5b9c982724df0b88ce6ad46dc37e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:11.588320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ab292-d549-41fe-8114-d05bce798c49 service glance] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:11.588603 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ab292-d549-41fe-8114-d05bce798c49 service glance] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:11.588878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ab292-d549-41fe-8114-d05bce798c49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:11.597561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ab292-d549-41fe-8114-d05bce798c49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:11.598986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ab292-d549-41fe-8114-d05bce798c49 service glance] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:11.608938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 740/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:03:13.898320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06d793-efd3-44e4-a566-3c94373f932d None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:13.898896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06d793-efd3-44e4-a566-3c94373f932d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:13.898896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06d793-efd3-44e4-a566-3c94373f932d None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:13.901080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 736/1476] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:13.906348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1fa97-3679-4cc5-a100-415c2d31db45 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:13.906850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1fa97-3679-4cc5-a100-415c2d31db45 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:13.906991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1fa97-3679-4cc5-a100-415c2d31db45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:13.925240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c7e1fa97-3679-4cc5-a100-415c2d31db45 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:13.926476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c7e1fa97-3679-4cc5-a100-415c2d31db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:13.934297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 741/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:03:13.957143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06d793-efd3-44e4-a566-3c94373f932d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:13.970003 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06d793-efd3-44e4-a566-3c94373f932d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:13.974456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc8c32-3d22-48f8-86f6-d253b619a54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:13.975092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc8c32-3d22-48f8-86f6-d253b619a54f admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:13.975376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc8c32-3d22-48f8-86f6-d253b619a54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:13.975653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc8c32-3d22-48f8-86f6-d253b619a54f admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:13.976379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc8c32-3d22-48f8-86f6-d253b619a54f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:13.978333 dv-cinder-842998-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-95dc8c32-3d22-48f8-86f6-d253b619a54f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:03:13.978333 dv-cinder-842998-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 23 17:03:13.978333 dv-cinder-842998-1-smb devstack@keystone.service[80413]: May 23 17:03:13.979498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc8c32-3d22-48f8-86f6-d253b619a54f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:13.998801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 737/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Mon May 23 17:03:13 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:03:16.225537 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f3de3-698a-4a77-b458-98c0daf7792e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:16.226104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f3de3-698a-4a77-b458-98c0daf7792e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:16.226104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f3de3-698a-4a77-b458-98c0daf7792e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:16.228118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 742/1479] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:16.233550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59555417-d7d8-4bc2-a46a-af4f033beb5f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:16.233959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59555417-d7d8-4bc2-a46a-af4f033beb5f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:16.234121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59555417-d7d8-4bc2-a46a-af4f033beb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:16.251868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-59555417-d7d8-4bc2-a46a-af4f033beb5f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:16.253069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-59555417-d7d8-4bc2-a46a-af4f033beb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:16.261130 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 738/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:03:16.304777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f3de3-698a-4a77-b458-98c0daf7792e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:16.319207 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f3de3-698a-4a77-b458-98c0daf7792e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:16.324807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fc8f6-d183-4876-ab9e-73f249b04e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:16.325435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fc8f6-d183-4876-ab9e-73f249b04e6c service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:16.325717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fc8f6-d183-4876-ab9e-73f249b04e6c service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:16.325988 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fc8f6-d183-4876-ab9e-73f249b04e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:16.334665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fc8f6-d183-4876-ab9e-73f249b04e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:16.336252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fc8f6-d183-4876-ab9e-73f249b04e6c service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:16.346163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 743/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:03:18.722785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311e00d-6a69-4f03-b82a-388b7d66137b None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.723314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311e00d-6a69-4f03-b82a-388b7d66137b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.723314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311e00d-6a69-4f03-b82a-388b7d66137b None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.724660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 739/1482] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:18.730730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8ed37-3465-4d71-9ab7-18b21a0bf09a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.731166 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8ed37-3465-4d71-9ab7-18b21a0bf09a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.731274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8ed37-3465-4d71-9ab7-18b21a0bf09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.749482 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c7f8ed37-3465-4d71-9ab7-18b21a0bf09a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:18.750715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c7f8ed37-3465-4d71-9ab7-18b21a0bf09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:18.758766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 744/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:03:18.794888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311e00d-6a69-4f03-b82a-388b7d66137b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:18.806315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311e00d-6a69-4f03-b82a-388b7d66137b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:18.809890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d37f5b-07b0-4db3-aae6-ec57147e6937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:18.810568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37f5b-07b0-4db3-aae6-ec57147e6937 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.810856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37f5b-07b0-4db3-aae6-ec57147e6937 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.811139 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37f5b-07b0-4db3-aae6-ec57147e6937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.820174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d37f5b-07b0-4db3-aae6-ec57147e6937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:18.821826 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d37f5b-07b0-4db3-aae6-ec57147e6937 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:18.831481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 740/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:03:21.081006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a158c-8ca6-40e6-9254-f5782c997484 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:21.081550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a158c-8ca6-40e6-9254-f5782c997484 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:21.081550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a158c-8ca6-40e6-9254-f5782c997484 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:21.082916 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 745/1485] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:21.090791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91029afb-6daa-4934-90b1-e83c20404673 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:21.091254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91029afb-6daa-4934-90b1-e83c20404673 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:21.091367 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91029afb-6daa-4934-90b1-e83c20404673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:21.108922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-91029afb-6daa-4934-90b1-e83c20404673 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:21.110121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-91029afb-6daa-4934-90b1-e83c20404673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:21.117895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 741/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:03:21.157827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a158c-8ca6-40e6-9254-f5782c997484 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:21.168776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a158c-8ca6-40e6-9254-f5782c997484 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:21.172310 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd63da3-e311-4487-b195-965f9ee2ea8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:21.172944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd63da3-e311-4487-b195-965f9ee2ea8e service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:21.173230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd63da3-e311-4487-b195-965f9ee2ea8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:21.173509 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd63da3-e311-4487-b195-965f9ee2ea8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:21.182287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd63da3-e311-4487-b195-965f9ee2ea8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:21.183708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd63da3-e311-4487-b195-965f9ee2ea8e service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:21.193799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 746/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:03:23.507830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d874b3-8a08-40fe-a550-e8c276363a94 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:23.508411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d874b3-8a08-40fe-a550-e8c276363a94 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:23.508411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d874b3-8a08-40fe-a550-e8c276363a94 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:23.509789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 742/1488] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:23.515193 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2938-344f-498f-aab9-4120a9c9208c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:23.515646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2938-344f-498f-aab9-4120a9c9208c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:23.515763 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2938-344f-498f-aab9-4120a9c9208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:23.533981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e6bb2938-344f-498f-aab9-4120a9c9208c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:23.535257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e6bb2938-344f-498f-aab9-4120a9c9208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:23.544266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 747/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:03:23.583470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d874b3-8a08-40fe-a550-e8c276363a94 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:23.594644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d874b3-8a08-40fe-a550-e8c276363a94 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:23.598095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe31a7-a494-4c4e-9e61-4acc24f33fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:23.598767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe31a7-a494-4c4e-9e61-4acc24f33fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:23.599059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe31a7-a494-4c4e-9e61-4acc24f33fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:23.599357 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe31a7-a494-4c4e-9e61-4acc24f33fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:23.609095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe31a7-a494-4c4e-9e61-4acc24f33fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:23.610560 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe31a7-a494-4c4e-9e61-4acc24f33fe5 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:23.620072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 743/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:03:26.090782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe73f9-e965-47c6-8f11-861c9df7ea88 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:26.091342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe73f9-e965-47c6-8f11-861c9df7ea88 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:26.091342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe73f9-e965-47c6-8f11-861c9df7ea88 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:26.092660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 748/1491] 10.222.0.49 () {54 vars in 926 bytes} [Mon May 23 17:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:26.097889 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ccd0e-fddf-4d2e-94ec-74779f61da95 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:26.098332 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ccd0e-fddf-4d2e-94ec-74779f61da95 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:26.098542 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ccd0e-fddf-4d2e-94ec-74779f61da95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:26.117074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5c0ccd0e-fddf-4d2e-94ec-74779f61da95 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:26.118933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5c0ccd0e-fddf-4d2e-94ec-74779f61da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:26.126602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 744/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Mon May 23 17:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:03:26.166016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe73f9-e965-47c6-8f11-861c9df7ea88 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:26.176729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe73f9-e965-47c6-8f11-861c9df7ea88 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:26.180308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b88b2-8463-45f3-b4f7-56a1cbef29ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:26.180945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b88b2-8463-45f3-b4f7-56a1cbef29ed service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:26.181235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b88b2-8463-45f3-b4f7-56a1cbef29ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:26.181514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b88b2-8463-45f3-b4f7-56a1cbef29ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:26.190262 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b88b2-8463-45f3-b4f7-56a1cbef29ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:26.191712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b88b2-8463-45f3-b4f7-56a1cbef29ed service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:26.202847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 749/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:03:36.112015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=33 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:36.197864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=33 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:06.531377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99b48-14df-40f9-9fd3-b5f36b3340ee None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.531977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99b48-14df-40f9-9fd3-b5f36b3340ee None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.531977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99b48-14df-40f9-9fd3-b5f36b3340ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.550945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e7f99b48-14df-40f9-9fd3-b5f36b3340ee None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:06.552204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e7f99b48-14df-40f9-9fd3-b5f36b3340ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:06.560600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 745/1494] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:05:06.570032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b789f96-e49b-4c9e-b0e9-93960f73b352 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.570946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b789f96-e49b-4c9e-b0e9-93960f73b352 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.571239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b789f96-e49b-4c9e-b0e9-93960f73b352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.590024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5b789f96-e49b-4c9e-b0e9-93960f73b352 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:06.591235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5b789f96-e49b-4c9e-b0e9-93960f73b352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:06.599954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 750/1495] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:05:06.604389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f99b48-14df-40f9-9fd3-b5f36b3340ee None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.613989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f99b48-14df-40f9-9fd3-b5f36b3340ee None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.618599 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a678fa-e424-44fa-8288-5257fdba1ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.619243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a678fa-e424-44fa-8288-5257fdba1ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.619531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a678fa-e424-44fa-8288-5257fdba1ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.619805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a678fa-e424-44fa-8288-5257fdba1ff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.620555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a678fa-e424-44fa-8288-5257fdba1ff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:06.620860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a678fa-e424-44fa-8288-5257fdba1ff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.621860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-27a678fa-e424-44fa-8288-5257fdba1ff4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:05:06.621860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 23 17:05:06.621860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: May 23 17:05:06.622774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a678fa-e424-44fa-8288-5257fdba1ff4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.634582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 746/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:06.642474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b789f96-e49b-4c9e-b0e9-93960f73b352 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.652309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b789f96-e49b-4c9e-b0e9-93960f73b352 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.656850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7ea80-e4e2-4409-8722-7f5133bb5221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.657495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7ea80-e4e2-4409-8722-7f5133bb5221 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.657784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7ea80-e4e2-4409-8722-7f5133bb5221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.658062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7ea80-e4e2-4409-8722-7f5133bb5221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.658783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7ea80-e4e2-4409-8722-7f5133bb5221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.660559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-77e7ea80-e4e2-4409-8722-7f5133bb5221 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:05:06.660559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 23 17:05:06.660559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: May 23 17:05:06.661799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7ea80-e4e2-4409-8722-7f5133bb5221 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.697802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 751/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:05:06 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:06.702021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a678fa-e424-44fa-8288-5257fdba1ff4 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.712826 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a678fa-e424-44fa-8288-5257fdba1ff4 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.767393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b63af-b0f7-431e-934d-9393575c0acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.768065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b63af-b0f7-431e-934d-9393575c0acc admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.768348 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b63af-b0f7-431e-934d-9393575c0acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.768618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b63af-b0f7-431e-934d-9393575c0acc admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.769308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b63af-b0f7-431e-934d-9393575c0acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.770328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-6c7b63af-b0f7-431e-934d-9393575c0acc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:05:06.770328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 23 17:05:06.770328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: May 23 17:05:06.772476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b63af-b0f7-431e-934d-9393575c0acc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.792732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 747/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:05:06 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:06.796967 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7ea80-e4e2-4409-8722-7f5133bb5221 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.807108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7ea80-e4e2-4409-8722-7f5133bb5221 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.811633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649f779-bfce-40a3-b29d-a3285c04394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.812294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649f779-bfce-40a3-b29d-a3285c04394c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.812586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649f779-bfce-40a3-b29d-a3285c04394c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.812869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649f779-bfce-40a3-b29d-a3285c04394c admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.813597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649f779-bfce-40a3-b29d-a3285c04394c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.814629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-c649f779-bfce-40a3-b29d-a3285c04394c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:05:06.814629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 23 17:05:06.814629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: May 23 17:05:06.815510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649f779-bfce-40a3-b29d-a3285c04394c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.828993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 752/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:05:06.833041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b63af-b0f7-431e-934d-9393575c0acc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.843555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b63af-b0f7-431e-934d-9393575c0acc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.848229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85299b5-af08-4b28-8d76-4623bf2b48a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.848875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85299b5-af08-4b28-8d76-4623bf2b48a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.849165 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85299b5-af08-4b28-8d76-4623bf2b48a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.849656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85299b5-af08-4b28-8d76-4623bf2b48a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.850464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85299b5-af08-4b28-8d76-4623bf2b48a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.851482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-f85299b5-af08-4b28-8d76-4623bf2b48a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:05:06.851482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 23 17:05:06.851482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: May 23 17:05:06.852344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85299b5-af08-4b28-8d76-4623bf2b48a4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.866715 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 748/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:05:06.870834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649f779-bfce-40a3-b29d-a3285c04394c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.881194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649f779-bfce-40a3-b29d-a3285c04394c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.885609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e0a6e-43c1-4c02-b48a-439ff9e49160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.886521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e0a6e-43c1-4c02-b48a-439ff9e49160 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.886807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e0a6e-43c1-4c02-b48a-439ff9e49160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.887082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e0a6e-43c1-4c02-b48a-439ff9e49160 admin admin] PATH_INFO: `/v3/projects/49d9e772f9c84e938e96b190f0f81053/users/04e99754cd8a42a6af641e4dfadeb1ac/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.902314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e0a6e-43c1-4c02-b48a-439ff9e49160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d9e772f9c84e938e96b190f0f81053, user_id=04e99754cd8a42a6af641e4dfadeb1ac, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.903364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-ae3e0a6e-43c1-4c02-b48a-439ff9e49160 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:05:06.903364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 23 17:05:06.903364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: May 23 17:05:06.905310 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e0a6e-43c1-4c02-b48a-439ff9e49160 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.918106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 753/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:05:06 2022] PUT /identity/v3/projects/49d9e772f9c84e938e96b190f0f81053/users/04e99754cd8a42a6af641e4dfadeb1ac/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:05:06.929644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb94803-d209-4663-8ae9-e0f4c10990e8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.929938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb94803-d209-4663-8ae9-e0f4c10990e8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.930216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb94803-d209-4663-8ae9-e0f4c10990e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.956198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9cb94803-d209-4663-8ae9-e0f4c10990e8 None None] MFA Rules not processed for user `04e99754cd8a42a6af641e4dfadeb1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:06.957411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9cb94803-d209-4663-8ae9-e0f4c10990e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:07.019459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 749/1502] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:05:07.033365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d373b-08b7-4e8b-b610-160aa5f57be2 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:07.033659 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d373b-08b7-4e8b-b610-160aa5f57be2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:07.033961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d373b-08b7-4e8b-b610-160aa5f57be2 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:07.035441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 754/1503] 10.222.0.49 () {54 vars in 963 bytes} [Mon May 23 17:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:07.040842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3556a-895a-46f3-b502-a362fc98f51c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:07.041133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3556a-895a-46f3-b502-a362fc98f51c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:07.041412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3556a-895a-46f3-b502-a362fc98f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:07.059010 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4dd3556a-895a-46f3-b502-a362fc98f51c None None] MFA Rules not processed for user `c91dcf97796941718e251912271aea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:07.060199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4dd3556a-895a-46f3-b502-a362fc98f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:07.103241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:07.111856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 750/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Mon May 23 17:05:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:05:07.119240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d373b-08b7-4e8b-b610-160aa5f57be2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:07.129495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d373b-08b7-4e8b-b610-160aa5f57be2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:07.133307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a08da7-4c68-418f-b413-bcc30018584f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:07.133932 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a08da7-4c68-418f-b413-bcc30018584f service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:07.134215 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a08da7-4c68-418f-b413-bcc30018584f service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:07.134520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a08da7-4c68-418f-b413-bcc30018584f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:07.142514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a08da7-4c68-418f-b413-bcc30018584f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:07.143931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a08da7-4c68-418f-b413-bcc30018584f service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:07.153179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 755/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:05:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:05:07.195331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bf589-b464-4732-8669-a11a4e33663f None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:07.195624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bf589-b464-4732-8669-a11a4e33663f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:07.195903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bf589-b464-4732-8669-a11a4e33663f None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:07.197180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 751/1506] 10.222.0.49 () {52 vars in 829 bytes} [Mon May 23 17:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:07.200733 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a08da7-4c68-418f-b413-bcc30018584f service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:07.260831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a08da7-4c68-418f-b413-bcc30018584f service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:07.265237 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:07.266093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:07.266384 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:07.266679 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] PATH_INFO: `/v3/users/04e99754cd8a42a6af641e4dfadeb1ac` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:07.267831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e99754cd8a42a6af641e4dfadeb1ac)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:07.268827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:05:07.268827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 23 17:05:07.268827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: May 23 17:05:07.270040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:07.333140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e99754cd8a42a6af641e4dfadeb1ac'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:05:07.334586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e99754cd8a42a6af641e4dfadeb1ac'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:05:07.348192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e99754cd8a42a6af641e4dfadeb1ac'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:05:07.358274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e99754cd8a42a6af641e4dfadeb1ac'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:05:07.358980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e99754cd8a42a6af641e4dfadeb1ac'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:05:07.375128 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:07.385467 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 756/1507] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:05:07 2022] DELETE /identity/v3/users/04e99754cd8a42a6af641e4dfadeb1ac => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:05:07.389843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09a1d4-ebd9-422b-8e83-0428dcd807ae None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:07.390134 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09a1d4-ebd9-422b-8e83-0428dcd807ae None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:07.390447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09a1d4-ebd9-422b-8e83-0428dcd807ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:07.408339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-bf09a1d4-ebd9-422b-8e83-0428dcd807ae None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:07.409535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bf09a1d4-ebd9-422b-8e83-0428dcd807ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:07.469768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 752/1508] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:05:07.479344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:07.480727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:07.537490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17339c-bdc1-4c7e-84f5-113f78c965ff admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:07.541048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5c879-fee4-4837-9cd8-bcf83c80e0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:07.541688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5c879-fee4-4837-9cd8-bcf83c80e0ad service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:07.541971 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5c879-fee4-4837-9cd8-bcf83c80e0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:07.542247 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5c879-fee4-4837-9cd8-bcf83c80e0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:07.550959 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5c879-fee4-4837-9cd8-bcf83c80e0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:07.552948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5c879-fee4-4837-9cd8-bcf83c80e0ad service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:07.562706 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 757/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:05:08.019455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09a1d4-ebd9-422b-8e83-0428dcd807ae None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:08.021399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bf09a1d4-ebd9-422b-8e83-0428dcd807ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:08.033817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09a1d4-ebd9-422b-8e83-0428dcd807ae None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:08.039654 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:08.040511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:08.040795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:08.041160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] PATH_INFO: `/v3/projects/49d9e772f9c84e938e96b190f0f81053` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:08.042334 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d9e772f9c84e938e96b190f0f81053)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:08.043375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:05:08.043375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 23 17:05:08.043375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: May 23 17:05:08.044570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:08.105688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d9e772f9c84e938e96b190f0f81053', 'request_id': 'req-df845671-0f6a-4281-a5a9-10b740de00a1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:05:08.111510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d9e772f9c84e938e96b190f0f81053', 'request_id': 'req-df845671-0f6a-4281-a5a9-10b740de00a1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:05:08.125401 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d9e772f9c84e938e96b190f0f81053', 'request_id': 'req-df845671-0f6a-4281-a5a9-10b740de00a1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:05:08.140963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] The token cache is being invalidate because project 49d9e772f9c84e938e96b190f0f81053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:05:08.141368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:05:08.142080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-df845671-0f6a-4281-a5a9-10b740de00a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:05:08.143646 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 753/1510] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:05:08 2022] DELETE /identity/v3/projects/49d9e772f9c84e938e96b190f0f81053 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:05:17.558579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:18.137996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:57.762882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0d8c9-119d-44c4-9936-58e1a1d8d9dc None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:57.763468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0d8c9-119d-44c4-9936-58e1a1d8d9dc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:57.763468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0d8c9-119d-44c4-9936-58e1a1d8d9dc None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:57.764830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:06:57.769755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dbbe1-f46b-4a31-a7d1-f80fc8e0e44b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:57.770225 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dbbe1-f46b-4a31-a7d1-f80fc8e0e44b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:57.770331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dbbe1-f46b-4a31-a7d1-f80fc8e0e44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:57.789100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-159dbbe1-f46b-4a31-a7d1-f80fc8e0e44b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:57.790299 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-159dbbe1-f46b-4a31-a7d1-f80fc8e0e44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:57.847419 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:06:58.020901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0d8c9-119d-44c4-9936-58e1a1d8d9dc None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:58.022700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-dac0d8c9-119d-44c4-9936-58e1a1d8d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:58.098003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0d8c9-119d-44c4-9936-58e1a1d8d9dc None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:58.103871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebded718-5842-44c7-a802-686e44e6f272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:58.104522 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebded718-5842-44c7-a802-686e44e6f272 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:58.104811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebded718-5842-44c7-a802-686e44e6f272 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:58.105093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebded718-5842-44c7-a802-686e44e6f272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:58.113317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebded718-5842-44c7-a802-686e44e6f272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:58.114949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebded718-5842-44c7-a802-686e44e6f272 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:58.124919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 759/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:06:58.651385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a798d-0673-478e-b069-0c24c4c47751 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:58.651712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a798d-0673-478e-b069-0c24c4c47751 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:58.651998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a798d-0673-478e-b069-0c24c4c47751 None None] PATH_INFO: `/v3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:58.653307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 755/1514] 10.222.0.39 () {54 vars in 925 bytes} [Mon May 23 17:06:58 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:58.660545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f3ee5-0a4f-4599-86f8-2ea0d1404f66 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:58.660840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f3ee5-0a4f-4599-86f8-2ea0d1404f66 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:58.661122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f3ee5-0a4f-4599-86f8-2ea0d1404f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:58.681025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-229f3ee5-0a4f-4599-86f8-2ea0d1404f66 None None] MFA Rules not processed for user `81fb8b261e2142fcbf8d23bd010bf715`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:58.682239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-229f3ee5-0a4f-4599-86f8-2ea0d1404f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:58.752589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 760/1515] 10.222.0.39 () {58 vars in 1015 bytes} [Mon May 23 17:06:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:06:59.014525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb9150-07e0-4282-96ba-3668ea064817 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:59.015133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb9150-07e0-4282-96ba-3668ea064817 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:59.015133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb9150-07e0-4282-96ba-3668ea064817 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:59.016420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 756/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:06:59.021343 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df6b0-f7c3-4216-82a4-7ed89bed03a7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:59.021796 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df6b0-f7c3-4216-82a4-7ed89bed03a7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:59.021902 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df6b0-f7c3-4216-82a4-7ed89bed03a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:59.040949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5c2df6b0-f7c3-4216-82a4-7ed89bed03a7 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:59.042134 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5c2df6b0-f7c3-4216-82a4-7ed89bed03a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:59.049895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 761/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:06:59.200358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb9150-07e0-4282-96ba-3668ea064817 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:59.215514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb9150-07e0-4282-96ba-3668ea064817 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:59.220830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ab42c-2a36-4331-b7e9-54de75c2d033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:59.221464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ab42c-2a36-4331-b7e9-54de75c2d033 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:59.221750 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ab42c-2a36-4331-b7e9-54de75c2d033 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:59.222031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ab42c-2a36-4331-b7e9-54de75c2d033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:59.230043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ab42c-2a36-4331-b7e9-54de75c2d033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:59.231670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ab42c-2a36-4331-b7e9-54de75c2d033 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:59.240954 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 757/1518] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:07:07.535578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e17e2-ec42-4f2b-afeb-58fa812a3502 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:07.536106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e17e2-ec42-4f2b-afeb-58fa812a3502 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:07.536106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e17e2-ec42-4f2b-afeb-58fa812a3502 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:07.537994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 762/1519] 10.222.0.49 () {54 vars in 960 bytes} [Mon May 23 17:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:07:07.543081 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d235f-78ac-4b03-892b-9ea72cdb888f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:07.543526 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d235f-78ac-4b03-892b-9ea72cdb888f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:07.543637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d235f-78ac-4b03-892b-9ea72cdb888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:07.564537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6d5d235f-78ac-4b03-892b-9ea72cdb888f None None] MFA Rules not processed for user `81fb8b261e2142fcbf8d23bd010bf715`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:07.566033 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6d5d235f-78ac-4b03-892b-9ea72cdb888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:07.574850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 758/1520] 10.222.0.49 () {58 vars in 1057 bytes} [Mon May 23 17:07:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:07:07.582444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e17e2-ec42-4f2b-afeb-58fa812a3502 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:07.595964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e17e2-ec42-4f2b-afeb-58fa812a3502 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:07.601463 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4eed7-d3f1-4a84-ba82-16916f07ec81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81fb8b261e2142fcbf8d23bd010bf715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:07.602116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4eed7-d3f1-4a84-ba82-16916f07ec81 service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:07.602436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4eed7-d3f1-4a84-ba82-16916f07ec81 service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:07.602721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4eed7-d3f1-4a84-ba82-16916f07ec81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:07.611194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4eed7-d3f1-4a84-ba82-16916f07ec81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:07.612775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4eed7-d3f1-4a84-ba82-16916f07ec81 service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:07.622891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 763/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:07:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:07:10.523159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a630f-5685-40dc-96f6-91758fd30280 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:10.523757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a630f-5685-40dc-96f6-91758fd30280 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:10.523757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a630f-5685-40dc-96f6-91758fd30280 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:10.525072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:07:10.529845 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0a631-07f5-45c8-8ad1-2bc486257241 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:10.530263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0a631-07f5-45c8-8ad1-2bc486257241 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:10.530462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0a631-07f5-45c8-8ad1-2bc486257241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:10.549033 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e6d0a631-07f5-45c8-8ad1-2bc486257241 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:10.550237 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e6d0a631-07f5-45c8-8ad1-2bc486257241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:10.558812 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:07:10.714732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a630f-5685-40dc-96f6-91758fd30280 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:10.729570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a630f-5685-40dc-96f6-91758fd30280 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:10.734895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32cd65-be39-473d-9cd7-b69d18c1e54d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:10.735531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32cd65-be39-473d-9cd7-b69d18c1e54d service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:10.735821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32cd65-be39-473d-9cd7-b69d18c1e54d service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:10.736102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32cd65-be39-473d-9cd7-b69d18c1e54d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:10.744225 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32cd65-be39-473d-9cd7-b69d18c1e54d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:10.745801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32cd65-be39-473d-9cd7-b69d18c1e54d service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:10.755196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 760/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:07:11.625133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694255c1-ce2c-4153-a314-debfb41b82e1 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:11.625684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694255c1-ce2c-4153-a314-debfb41b82e1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:11.625684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694255c1-ce2c-4153-a314-debfb41b82e1 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:11.627122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:07:11.631982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d79168-597a-4a30-ac6e-4ff873d8c54a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:11.632427 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d79168-597a-4a30-ac6e-4ff873d8c54a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:11.632536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d79168-597a-4a30-ac6e-4ff873d8c54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:11.650950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-77d79168-597a-4a30-ac6e-4ff873d8c54a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:11.652145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-77d79168-597a-4a30-ac6e-4ff873d8c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:11.660009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:07:11.811971 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694255c1-ce2c-4153-a314-debfb41b82e1 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:11.826634 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694255c1-ce2c-4153-a314-debfb41b82e1 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:11.832213 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b75d31-c74b-44b8-afcb-26e6610f680f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:11.832853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b75d31-c74b-44b8-afcb-26e6610f680f service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:11.833143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b75d31-c74b-44b8-afcb-26e6610f680f service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:11.833426 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b75d31-c74b-44b8-afcb-26e6610f680f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:11.842139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b75d31-c74b-44b8-afcb-26e6610f680f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:11.843754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b75d31-c74b-44b8-afcb-26e6610f680f service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:11.853257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 766/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:07:15.942616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a090-5551-4459-802e-afce6fcbf4da None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:15.943208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a090-5551-4459-802e-afce6fcbf4da None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:15.943208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a090-5551-4459-802e-afce6fcbf4da None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:15.945279 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:07:15.950304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33177c85-31b7-4e72-87fb-522ad307daf2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:15.950769 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33177c85-31b7-4e72-87fb-522ad307daf2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:15.950879 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33177c85-31b7-4e72-87fb-522ad307daf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:15.968628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-33177c85-31b7-4e72-87fb-522ad307daf2 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:15.969812 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-33177c85-31b7-4e72-87fb-522ad307daf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:15.977870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:07:16.014859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a090-5551-4459-802e-afce6fcbf4da None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:16.016527 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fa88a090-5551-4459-802e-afce6fcbf4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:16.073218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a090-5551-4459-802e-afce6fcbf4da None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:16.076760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cca791-34bf-4347-9a9f-3bafe07b9389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:16.077398 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca791-34bf-4347-9a9f-3bafe07b9389 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:16.077687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca791-34bf-4347-9a9f-3bafe07b9389 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:16.077964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca791-34bf-4347-9a9f-3bafe07b9389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:16.087703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cca791-34bf-4347-9a9f-3bafe07b9389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:16.089125 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cca791-34bf-4347-9a9f-3bafe07b9389 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:16.098292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 763/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:07:18.278456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe7d1-004d-48c0-af93-6b7913f24d82 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:18.278984 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe7d1-004d-48c0-af93-6b7913f24d82 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:18.279083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe7d1-004d-48c0-af93-6b7913f24d82 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:18.280402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:07:18.285622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007adbc9-afa6-40a7-85bb-f7f156339461 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:18.286050 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007adbc9-afa6-40a7-85bb-f7f156339461 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:18.286190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007adbc9-afa6-40a7-85bb-f7f156339461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:18.293195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=72 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:18.305781 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-007adbc9-afa6-40a7-85bb-f7f156339461 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:18.307010 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-007adbc9-afa6-40a7-85bb-f7f156339461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:18.314747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:07:18.351605 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fe7d1-004d-48c0-af93-6b7913f24d82 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:18.362563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fe7d1-004d-48c0-af93-6b7913f24d82 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:18.366409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d6410-7024-4ce7-864b-50e765bb0942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:18.367053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d6410-7024-4ce7-864b-50e765bb0942 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:18.367344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d6410-7024-4ce7-864b-50e765bb0942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:18.367627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d6410-7024-4ce7-864b-50e765bb0942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:18.376886 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d6410-7024-4ce7-864b-50e765bb0942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:18.378302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d6410-7024-4ce7-864b-50e765bb0942 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:18.387562 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 769/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:07:22.069573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f4159-4d41-46d1-a018-d126f4e68c57 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:22.070114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f4159-4d41-46d1-a018-d126f4e68c57 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:22.070114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f4159-4d41-46d1-a018-d126f4e68c57 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:22.071507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:07:22.076840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc1906-df39-4756-bc93-7b5e469853d8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:22.077289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc1906-df39-4756-bc93-7b5e469853d8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:22.077408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc1906-df39-4756-bc93-7b5e469853d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:22.095514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-38fc1906-df39-4756-bc93-7b5e469853d8 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:22.096727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-38fc1906-df39-4756-bc93-7b5e469853d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:22.104548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:07:22.373283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f4159-4d41-46d1-a018-d126f4e68c57 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:22.374961 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-790f4159-4d41-46d1-a018-d126f4e68c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:22.431587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f4159-4d41-46d1-a018-d126f4e68c57 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:22.435071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d2f9a-b7ee-4cb4-9739-e05abdaff88f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:22.435703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2f9a-b7ee-4cb4-9739-e05abdaff88f service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:22.435984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2f9a-b7ee-4cb4-9739-e05abdaff88f service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:22.436256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2f9a-b7ee-4cb4-9739-e05abdaff88f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:22.445944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d2f9a-b7ee-4cb4-9739-e05abdaff88f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:22.447399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d2f9a-b7ee-4cb4-9739-e05abdaff88f service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:22.456816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 766/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:07:24.706898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38635c4-23b4-4f72-8ca6-a4718f48ad29 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:24.707434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38635c4-23b4-4f72-8ca6-a4718f48ad29 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:24.707434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38635c4-23b4-4f72-8ca6-a4718f48ad29 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:24.708976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:07:24.714710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdbc4b-8d2d-460d-94b4-59a685d5c9b1 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:24.715157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdbc4b-8d2d-460d-94b4-59a685d5c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:24.715265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdbc4b-8d2d-460d-94b4-59a685d5c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:24.733003 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-49bdbc4b-8d2d-460d-94b4-59a685d5c9b1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:24.734219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-49bdbc4b-8d2d-460d-94b4-59a685d5c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:24.741933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:07:25.012101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38635c4-23b4-4f72-8ca6-a4718f48ad29 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:25.013754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e38635c4-23b4-4f72-8ca6-a4718f48ad29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:25.026825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38635c4-23b4-4f72-8ca6-a4718f48ad29 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:25.030301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17838051-992a-41b9-b0b7-e31c51dc9948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:25.030962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17838051-992a-41b9-b0b7-e31c51dc9948 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:25.031255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17838051-992a-41b9-b0b7-e31c51dc9948 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:25.031535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17838051-992a-41b9-b0b7-e31c51dc9948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:25.040227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17838051-992a-41b9-b0b7-e31c51dc9948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:25.041639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17838051-992a-41b9-b0b7-e31c51dc9948 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:25.050804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 772/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:07:34.727865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=31 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:35.046806 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:57.870532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a64f5-d33d-486f-930a-fa36082127b3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:57.871640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a64f5-d33d-486f-930a-fa36082127b3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:57.872144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a64f5-d33d-486f-930a-fa36082127b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:57.904433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f70a64f5-d33d-486f-930a-fa36082127b3 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:57.905995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f70a64f5-d33d-486f-930a-fa36082127b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:57.918793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 768/1540] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:57.929571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3bfbb-cac1-403f-90e3-7aeb000f165f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:57.930170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3bfbb-cac1-403f-90e3-7aeb000f165f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:57.930170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3bfbb-cac1-403f-90e3-7aeb000f165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:57.954970 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-26f3bfbb-cac1-403f-90e3-7aeb000f165f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:57.956534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-26f3bfbb-cac1-403f-90e3-7aeb000f165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:57.969744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 773/1541] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:57.975241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a64f5-d33d-486f-930a-fa36082127b3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:57.990639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a64f5-d33d-486f-930a-fa36082127b3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:57.995852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3005d-2006-43fd-a8be-b53c9005e00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:57.996943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3005d-2006-43fd-a8be-b53c9005e00b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:57.997446 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3005d-2006-43fd-a8be-b53c9005e00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:57.997934 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3005d-2006-43fd-a8be-b53c9005e00b admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:57.998944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3005d-2006-43fd-a8be-b53c9005e00b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:57.999467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3005d-2006-43fd-a8be-b53c9005e00b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.001293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3005d-2006-43fd-a8be-b53c9005e00b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.019582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 769/1542] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:58.027937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3bfbb-cac1-403f-90e3-7aeb000f165f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.029773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd9849-b9f8-4b69-bd0e-e9bcb04bbc26 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.030283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd9849-b9f8-4b69-bd0e-e9bcb04bbc26 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.031423 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd9849-b9f8-4b69-bd0e-e9bcb04bbc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.038335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3bfbb-cac1-403f-90e3-7aeb000f165f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.051921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6ee26-5977-4b20-95ab-77cd3f3b56ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.052179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6ee26-5977-4b20-95ab-77cd3f3b56ef admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.052471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6ee26-5977-4b20-95ab-77cd3f3b56ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.052748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6ee26-5977-4b20-95ab-77cd3f3b56ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.053442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6ee26-5977-4b20-95ab-77cd3f3b56ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.055800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6ee26-5977-4b20-95ab-77cd3f3b56ef admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.063253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e7bd9849-b9f8-4b69-bd0e-e9bcb04bbc26 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.064793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e7bd9849-b9f8-4b69-bd0e-e9bcb04bbc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.081090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 770/1543] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.097467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98290840-a623-498b-9a8b-673ec1996e0e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.098128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98290840-a623-498b-9a8b-673ec1996e0e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.098693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98290840-a623-498b-9a8b-673ec1996e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.113147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 774/1544] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/projects => generated 361 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:58.117288 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6ee26-5977-4b20-95ab-77cd3f3b56ef admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.129588 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-98290840-a623-498b-9a8b-673ec1996e0e None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.131262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-98290840-a623-498b-9a8b-673ec1996e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.225245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6ee26-5977-4b20-95ab-77cd3f3b56ef admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.240271 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bae6c-4fd5-4e0b-8c21-9bc6241700df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.240967 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bae6c-4fd5-4e0b-8c21-9bc6241700df admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.241682 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 771/1545] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:08:58.241920 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bae6c-4fd5-4e0b-8c21-9bc6241700df admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.242222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bae6c-4fd5-4e0b-8c21-9bc6241700df admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.242951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bae6c-4fd5-4e0b-8c21-9bc6241700df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.243982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-294bae6c-4fd5-4e0b-8c21-9bc6241700df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:08:58.243982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 23 17:08:58.243982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: May 23 17:08:58.244526 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040f810-1c15-418c-afd2-7bf3750a8400 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.245025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040f810-1c15-418c-afd2-7bf3750a8400 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.245264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bae6c-4fd5-4e0b-8c21-9bc6241700df admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.245723 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040f810-1c15-418c-afd2-7bf3750a8400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.277922 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 775/1546] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/users => generated 281 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:58.279300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2040f810-1c15-418c-afd2-7bf3750a8400 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.280815 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2040f810-1c15-418c-afd2-7bf3750a8400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.287299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bae6c-4fd5-4e0b-8c21-9bc6241700df admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.295253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 772/1547] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.296498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040f810-1c15-418c-afd2-7bf3750a8400 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.308214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040f810-1c15-418c-afd2-7bf3750a8400 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.308460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bae6c-4fd5-4e0b-8c21-9bc6241700df admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.320486 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abae803-0e39-4d1d-a453-0df018b61a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.321492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abae803-0e39-4d1d-a453-0df018b61a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.321991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abae803-0e39-4d1d-a453-0df018b61a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.322514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abae803-0e39-4d1d-a453-0df018b61a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.323027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4035f-1b32-4caa-9395-162b94caebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.323690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abae803-0e39-4d1d-a453-0df018b61a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.323816 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4035f-1b32-4caa-9395-162b94caebfd admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.323969 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4035f-1b32-4caa-9395-162b94caebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.324247 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4035f-1b32-4caa-9395-162b94caebfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.324988 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4035f-1b32-4caa-9395-162b94caebfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:58.325294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4035f-1b32-4caa-9395-162b94caebfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.326289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-4ee4035f-1b32-4caa-9395-162b94caebfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:08:58.326289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 23 17:08:58.326289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: May 23 17:08:58.326911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abae803-0e39-4d1d-a453-0df018b61a03 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.327183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4035f-1b32-4caa-9395-162b94caebfd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.344248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 773/1548] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:58.346010 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de77af-e65e-43a5-944d-45a317111448 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.347041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de77af-e65e-43a5-944d-45a317111448 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.347545 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de77af-e65e-43a5-944d-45a317111448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.387749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-75de77af-e65e-43a5-944d-45a317111448 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.389331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-75de77af-e65e-43a5-944d-45a317111448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.410964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 774/1549] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.412860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30fb4c-5a75-429c-abd2-712145d6d228 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.413501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30fb4c-5a75-429c-abd2-712145d6d228 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.414006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30fb4c-5a75-429c-abd2-712145d6d228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.441471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7e30fb4c-5a75-429c-abd2-712145d6d228 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.443136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7e30fb4c-5a75-429c-abd2-712145d6d228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.451720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 775/1550] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.453096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30fb4c-5a75-429c-abd2-712145d6d228 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.465179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30fb4c-5a75-429c-abd2-712145d6d228 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.470642 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18273e81-a8c0-4199-9601-80bbabfdb6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.471717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18273e81-a8c0-4199-9601-80bbabfdb6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.472311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18273e81-a8c0-4199-9601-80bbabfdb6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.472803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18273e81-a8c0-4199-9601-80bbabfdb6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.473754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18273e81-a8c0-4199-9601-80bbabfdb6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.475848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18273e81-a8c0-4199-9601-80bbabfdb6e9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.487985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 776/1551] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:58.489681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a94f82-b29c-4a6f-8f00-59fd2534d48a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.490154 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a94f82-b29c-4a6f-8f00-59fd2534d48a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.490791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a94f82-b29c-4a6f-8f00-59fd2534d48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.500181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 776/1552] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:58.501476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7eb48f-29d6-4d0a-a739-b477d8730f8b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.501766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7eb48f-29d6-4d0a-a739-b477d8730f8b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.502045 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7eb48f-29d6-4d0a-a739-b477d8730f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.513568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-95a94f82-b29c-4a6f-8f00-59fd2534d48a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.514820 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-95a94f82-b29c-4a6f-8f00-59fd2534d48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.527869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1b7eb48f-29d6-4d0a-a739-b477d8730f8b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.530455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1b7eb48f-29d6-4d0a-a739-b477d8730f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.530694 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 777/1553] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.531411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a94f82-b29c-4a6f-8f00-59fd2534d48a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.539073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 777/1554] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.540333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2825b6-6476-42ce-b742-a399e9fe4248 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.540618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2825b6-6476-42ce-b742-a399e9fe4248 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.540893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2825b6-6476-42ce-b742-a399e9fe4248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.543587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a94f82-b29c-4a6f-8f00-59fd2534d48a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.558731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2497902-b2aa-48a4-9a55-0f4f1a8d4d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.559437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2497902-b2aa-48a4-9a55-0f4f1a8d4d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.559736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2497902-b2aa-48a4-9a55-0f4f1a8d4d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.559991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2497902-b2aa-48a4-9a55-0f4f1a8d4d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.560744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2497902-b2aa-48a4-9a55-0f4f1a8d4d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:58.561153 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2497902-b2aa-48a4-9a55-0f4f1a8d4d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.561433 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2d2825b6-6476-42ce-b742-a399e9fe4248 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.562691 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2d2825b6-6476-42ce-b742-a399e9fe4248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.562822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2497902-b2aa-48a4-9a55-0f4f1a8d4d93 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.572623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 778/1555] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.574042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949a65-9433-4c4b-abe9-7668c04965ca None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.574434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949a65-9433-4c4b-abe9-7668c04965ca None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.575020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949a65-9433-4c4b-abe9-7668c04965ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.576625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 778/1556] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:58.577587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2497902-b2aa-48a4-9a55-0f4f1a8d4d93 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.590243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2497902-b2aa-48a4-9a55-0f4f1a8d4d93 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.596207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1df17-0c30-4200-96e9-29ba92642b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.597573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1df17-0c30-4200-96e9-29ba92642b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.597951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1df17-0c30-4200-96e9-29ba92642b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.598253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1df17-0c30-4200-96e9-29ba92642b3c admin admin] PATH_INFO: `/v3/projects/bdc2478d21e74f56b1975b69895d93d3/users/dda66613edbf432592545eeef59aeab0/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.599610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-bf949a65-9433-4c4b-abe9-7668c04965ca None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.601024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bf949a65-9433-4c4b-abe9-7668c04965ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.610827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 779/1557] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.615961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf949a65-9433-4c4b-abe9-7668c04965ca None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.617202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1df17-0c30-4200-96e9-29ba92642b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc2478d21e74f56b1975b69895d93d3, user_id=dda66613edbf432592545eeef59aeab0, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.618314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-18b1df17-0c30-4200-96e9-29ba92642b3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:08:58.618314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 23 17:08:58.618314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: May 23 17:08:58.620359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1df17-0c30-4200-96e9-29ba92642b3c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.626452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf949a65-9433-4c4b-abe9-7668c04965ca None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.632786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3209821-1be8-409c-8204-6d2aec8183d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.633452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3209821-1be8-409c-8204-6d2aec8183d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.633736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3209821-1be8-409c-8204-6d2aec8183d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.634011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3209821-1be8-409c-8204-6d2aec8183d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.634737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3209821-1be8-409c-8204-6d2aec8183d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.635104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 779/1558] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:08:58 2022] PUT /identity/v3/projects/bdc2478d21e74f56b1975b69895d93d3/users/dda66613edbf432592545eeef59aeab0/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:08:58.642594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c3c7e-e517-4bd4-822f-897269610fce None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.642721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3209821-1be8-409c-8204-6d2aec8183d5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.642806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c3c7e-e517-4bd4-822f-897269610fce None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.642806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c3c7e-e517-4bd4-822f-897269610fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.658241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ec0c3c7e-e517-4bd4-822f-897269610fce None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.659732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ec0c3c7e-e517-4bd4-822f-897269610fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.664090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 780/1559] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:58.665403 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff131ea5-d314-445a-afc9-27fcd1ae9fa0 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.665698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff131ea5-d314-445a-afc9-27fcd1ae9fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.665978 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff131ea5-d314-445a-afc9-27fcd1ae9fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.685365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ff131ea5-d314-445a-afc9-27fcd1ae9fa0 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.686797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ff131ea5-d314-445a-afc9-27fcd1ae9fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.715521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:58.732695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 780/1560] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.734271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18da9d-9686-419e-9133-c2fd0aab650b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.734811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18da9d-9686-419e-9133-c2fd0aab650b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.735283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18da9d-9686-419e-9133-c2fd0aab650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.754734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5c18da9d-9686-419e-9133-c2fd0aab650b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.755930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5c18da9d-9686-419e-9133-c2fd0aab650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.756292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 781/1561] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.757110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff131ea5-d314-445a-afc9-27fcd1ae9fa0 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.763848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 781/1562] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.764917 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d70c6b-1116-443d-a971-710b87b76c92 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.765205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d70c6b-1116-443d-a971-710b87b76c92 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.765481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d70c6b-1116-443d-a971-710b87b76c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.766824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff131ea5-d314-445a-afc9-27fcd1ae9fa0 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.774154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1684c06-baaa-44a0-98e4-323f4897a790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.775448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1684c06-baaa-44a0-98e4-323f4897a790 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.775742 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1684c06-baaa-44a0-98e4-323f4897a790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.776025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1684c06-baaa-44a0-98e4-323f4897a790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.776724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1684c06-baaa-44a0-98e4-323f4897a790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.778690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1684c06-baaa-44a0-98e4-323f4897a790 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.782170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:58.788667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-07d70c6b-1116-443d-a971-710b87b76c92 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.790068 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-07d70c6b-1116-443d-a971-710b87b76c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.799114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 782/1563] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.800332 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d70c6b-1116-443d-a971-710b87b76c92 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.809936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d70c6b-1116-443d-a971-710b87b76c92 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.810690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 782/1564] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:58.816020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32f672-c4c9-4e84-9b40-e6c0c7fc6cb3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.816314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32f672-c4c9-4e84-9b40-e6c0c7fc6cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.816598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32f672-c4c9-4e84-9b40-e6c0c7fc6cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.841905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4e32f672-c4c9-4e84-9b40-e6c0c7fc6cb3 None None] MFA Rules not processed for user `dda66613edbf432592545eeef59aeab0`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.843144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4e32f672-c4c9-4e84-9b40-e6c0c7fc6cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.868910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0eb6ed-0dfa-47d4-8237-969258bb25f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.869582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0eb6ed-0dfa-47d4-8237-969258bb25f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.869871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0eb6ed-0dfa-47d4-8237-969258bb25f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.870156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0eb6ed-0dfa-47d4-8237-969258bb25f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.870925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0eb6ed-0dfa-47d4-8237-969258bb25f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:58.871521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0eb6ed-0dfa-47d4-8237-969258bb25f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.872967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0eb6ed-0dfa-47d4-8237-969258bb25f0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.885096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 783/1565] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:58.901186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0eb6ed-0dfa-47d4-8237-969258bb25f0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.911445 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 783/1566] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.911624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0eb6ed-0dfa-47d4-8237-969258bb25f0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.912389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32f672-c4c9-4e84-9b40-e6c0c7fc6cb3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.916605 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a34717-04b1-4d44-ae2d-e41094391b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.917271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a34717-04b1-4d44-ae2d-e41094391b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.917597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a34717-04b1-4d44-ae2d-e41094391b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.917874 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a34717-04b1-4d44-ae2d-e41094391b0a admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.918592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a34717-04b1-4d44-ae2d-e41094391b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.920531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a34717-04b1-4d44-ae2d-e41094391b0a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.922785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32f672-c4c9-4e84-9b40-e6c0c7fc6cb3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.927951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7decc53-f4d1-4a8e-8839-830fcea78e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.928599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7decc53-f4d1-4a8e-8839-830fcea78e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.928888 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7decc53-f4d1-4a8e-8839-830fcea78e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.929300 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7decc53-f4d1-4a8e-8839-830fcea78e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.930056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7decc53-f4d1-4a8e-8839-830fcea78e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:58.930814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7decc53-f4d1-4a8e-8839-830fcea78e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.932052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7decc53-f4d1-4a8e-8839-830fcea78e78 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.943328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 784/1567] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/users => generated 285 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:58.944605 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e620bf-d160-4eee-a54f-806be124cf8f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.944901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e620bf-d160-4eee-a54f-806be124cf8f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.945185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e620bf-d160-4eee-a54f-806be124cf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.946606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 784/1568] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:58.947707 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7decc53-f4d1-4a8e-8839-830fcea78e78 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.958104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7decc53-f4d1-4a8e-8839-830fcea78e78 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.962738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ca634-d685-4717-a41e-9c14ee8f3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.963390 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ca634-d685-4717-a41e-9c14ee8f3648 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.963548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-54e620bf-d160-4eee-a54f-806be124cf8f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:58.963683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ca634-d685-4717-a41e-9c14ee8f3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.963968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ca634-d685-4717-a41e-9c14ee8f3648 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.964691 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ca634-d685-4717-a41e-9c14ee8f3648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:58.964784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-54e620bf-d160-4eee-a54f-806be124cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:58.965005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ca634-d685-4717-a41e-9c14ee8f3648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.966645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ca634-d685-4717-a41e-9c14ee8f3648 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.972766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 785/1569] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:08:58.973550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e620bf-d160-4eee-a54f-806be124cf8f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.986187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 785/1570] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:58.986187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ca634-d685-4717-a41e-9c14ee8f3648 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:58.986493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e620bf-d160-4eee-a54f-806be124cf8f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.991076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7893325-de0c-4717-b20d-c705db4e09f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.991879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893325-de0c-4717-b20d-c705db4e09f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.992133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893325-de0c-4717-b20d-c705db4e09f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.992335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ca634-d685-4717-a41e-9c14ee8f3648 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:58.992463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893325-de0c-4717-b20d-c705db4e09f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.993460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7893325-de0c-4717-b20d-c705db4e09f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:58.994022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7893325-de0c-4717-b20d-c705db4e09f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:58.995928 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7893325-de0c-4717-b20d-c705db4e09f7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:58.997629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ebba7-4d56-4263-8f2c-858b5a12ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:58.998505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ebba7-4d56-4263-8f2c-858b5a12ff29 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:58.998793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ebba7-4d56-4263-8f2c-858b5a12ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:58.999070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ebba7-4d56-4263-8f2c-858b5a12ff29 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:58.999782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ebba7-4d56-4263-8f2c-858b5a12ff29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.001781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ebba7-4d56-4263-8f2c-858b5a12ff29 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.017633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 786/1571] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:59.017633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7893325-de0c-4717-b20d-c705db4e09f7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.021353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7893325-de0c-4717-b20d-c705db4e09f7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.025429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 786/1572] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:08:58 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.025949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e191b0e-ee03-434b-bdd8-80d64278679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.026641 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e191b0e-ee03-434b-bdd8-80d64278679e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.026763 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ebba7-4d56-4263-8f2c-858b5a12ff29 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.026928 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e191b0e-ee03-434b-bdd8-80d64278679e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.027212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e191b0e-ee03-434b-bdd8-80d64278679e admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.027902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e191b0e-ee03-434b-bdd8-80d64278679e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.028926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-1e191b0e-ee03-434b-bdd8-80d64278679e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:08:59.028926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 23 17:08:59.028926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: May 23 17:08:59.030110 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e191b0e-ee03-434b-bdd8-80d64278679e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.038169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ebba7-4d56-4263-8f2c-858b5a12ff29 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.042772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095c73c-5bcd-4dca-897f-796f078bf61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.043412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095c73c-5bcd-4dca-897f-796f078bf61b admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.043695 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095c73c-5bcd-4dca-897f-796f078bf61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.043968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095c73c-5bcd-4dca-897f-796f078bf61b admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.044667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095c73c-5bcd-4dca-897f-796f078bf61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.046696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095c73c-5bcd-4dca-897f-796f078bf61b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.058109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 787/1573] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.059113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e191b0e-ee03-434b-bdd8-80d64278679e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.079549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 787/1574] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.080362 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095c73c-5bcd-4dca-897f-796f078bf61b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.129085 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e191b0e-ee03-434b-bdd8-80d64278679e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.141375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:59.142571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095c73c-5bcd-4dca-897f-796f078bf61b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.147684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969de4-5952-4344-8cab-2dbb17dd3c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.148350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969de4-5952-4344-8cab-2dbb17dd3c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.148639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969de4-5952-4344-8cab-2dbb17dd3c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.148915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969de4-5952-4344-8cab-2dbb17dd3c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.149607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969de4-5952-4344-8cab-2dbb17dd3c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.151646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969de4-5952-4344-8cab-2dbb17dd3c84 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.165415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:59.180449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 788/1575] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.181072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969de4-5952-4344-8cab-2dbb17dd3c84 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.188485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623ed86-eb40-4723-b688-7560c995e030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.189186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623ed86-eb40-4723-b688-7560c995e030 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.189469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623ed86-eb40-4723-b688-7560c995e030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.189745 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623ed86-eb40-4723-b688-7560c995e030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.191056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623ed86-eb40-4723-b688-7560c995e030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.192675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623ed86-eb40-4723-b688-7560c995e030 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.206271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 788/1576] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:59.206271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623ed86-eb40-4723-b688-7560c995e030 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.213487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623ed86-eb40-4723-b688-7560c995e030 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.246007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969de4-5952-4344-8cab-2dbb17dd3c84 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.250526 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97819af2-a368-41a6-8135-1ff9793082c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.251184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97819af2-a368-41a6-8135-1ff9793082c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.251484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97819af2-a368-41a6-8135-1ff9793082c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.251737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97819af2-a368-41a6-8135-1ff9793082c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.253017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97819af2-a368-41a6-8135-1ff9793082c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:59.253580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97819af2-a368-41a6-8135-1ff9793082c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.255196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97819af2-a368-41a6-8135-1ff9793082c9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.266919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 789/1577] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:59.267841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97819af2-a368-41a6-8135-1ff9793082c9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.275808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ddd42-8f1c-4c5c-acae-7e0efec8c816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.276483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ddd42-8f1c-4c5c-acae-7e0efec8c816 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.276775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ddd42-8f1c-4c5c-acae-7e0efec8c816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.277058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ddd42-8f1c-4c5c-acae-7e0efec8c816 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.277759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ddd42-8f1c-4c5c-acae-7e0efec8c816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.279710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ddd42-8f1c-4c5c-acae-7e0efec8c816 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.284386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97819af2-a368-41a6-8135-1ff9793082c9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.288889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045184a-c0df-4cb7-b41d-cb093cc217a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.289554 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045184a-c0df-4cb7-b41d-cb093cc217a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.289836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045184a-c0df-4cb7-b41d-cb093cc217a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.290115 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045184a-c0df-4cb7-b41d-cb093cc217a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.290843 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045184a-c0df-4cb7-b41d-cb093cc217a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.292770 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045184a-c0df-4cb7-b41d-cb093cc217a4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.307776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 789/1578] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.308846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ddd42-8f1c-4c5c-acae-7e0efec8c816 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.325228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 790/1579] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.326132 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045184a-c0df-4cb7-b41d-cb093cc217a4 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.374230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ddd42-8f1c-4c5c-acae-7e0efec8c816 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.388541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045184a-c0df-4cb7-b41d-cb093cc217a4 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.394073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1700f-bd9c-48f7-9586-fd924b75e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.394788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1700f-bd9c-48f7-9586-fd924b75e33a admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.395074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1700f-bd9c-48f7-9586-fd924b75e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.395351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1700f-bd9c-48f7-9586-fd924b75e33a admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.396041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1700f-bd9c-48f7-9586-fd924b75e33a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.398004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1700f-bd9c-48f7-9586-fd924b75e33a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.419252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 791/1580] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.419973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1700f-bd9c-48f7-9586-fd924b75e33a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.425990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:59.430331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1700f-bd9c-48f7-9586-fd924b75e33a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.435406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184daab-25e2-48e6-bba3-6df33dc8ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.436084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184daab-25e2-48e6-bba3-6df33dc8ea17 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.436372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184daab-25e2-48e6-bba3-6df33dc8ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.436803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184daab-25e2-48e6-bba3-6df33dc8ea17 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.437503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184daab-25e2-48e6-bba3-6df33dc8ea17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.439458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184daab-25e2-48e6-bba3-6df33dc8ea17 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.443056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac237f-0ddf-42db-9f1b-d15d954bb148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.443756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac237f-0ddf-42db-9f1b-d15d954bb148 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.444042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac237f-0ddf-42db-9f1b-d15d954bb148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.444317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac237f-0ddf-42db-9f1b-d15d954bb148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.445039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac237f-0ddf-42db-9f1b-d15d954bb148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.446653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac237f-0ddf-42db-9f1b-d15d954bb148 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.458850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 790/1581] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:59.459549 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac237f-0ddf-42db-9f1b-d15d954bb148 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.469265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac237f-0ddf-42db-9f1b-d15d954bb148 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.469682 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 792/1582] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.470729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184daab-25e2-48e6-bba3-6df33dc8ea17 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.474160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835130-f3c0-4f73-b63a-7636fb33ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.474887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835130-f3c0-4f73-b63a-7636fb33ede2 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.475170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835130-f3c0-4f73-b63a-7636fb33ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.475448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835130-f3c0-4f73-b63a-7636fb33ede2 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.476126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835130-f3c0-4f73-b63a-7636fb33ede2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.478021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835130-f3c0-4f73-b63a-7636fb33ede2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.480589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184daab-25e2-48e6-bba3-6df33dc8ea17 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.485277 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800416-a373-4751-b405-53adce6f230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.485937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800416-a373-4751-b405-53adce6f230f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.486250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800416-a373-4751-b405-53adce6f230f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.486545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800416-a373-4751-b405-53adce6f230f admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.487833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46800416-a373-4751-b405-53adce6f230f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.489606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46800416-a373-4751-b405-53adce6f230f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.500725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 791/1583] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.501112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 793/1584] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:59.505086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835130-f3c0-4f73-b63a-7636fb33ede2 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.505364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800416-a373-4751-b405-53adce6f230f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.514916 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800416-a373-4751-b405-53adce6f230f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.515086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835130-f3c0-4f73-b63a-7636fb33ede2 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.520075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9f108-20bb-46ea-8b83-519b35ce25ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.520211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30a91a-044c-4efc-8f94-17c1fef38580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.520721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9f108-20bb-46ea-8b83-519b35ce25ab admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.520857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30a91a-044c-4efc-8f94-17c1fef38580 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.521004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9f108-20bb-46ea-8b83-519b35ce25ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.521109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30a91a-044c-4efc-8f94-17c1fef38580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.521276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9f108-20bb-46ea-8b83-519b35ce25ab admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.521373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30a91a-044c-4efc-8f94-17c1fef38580 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.521946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9f108-20bb-46ea-8b83-519b35ce25ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.522049 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30a91a-044c-4efc-8f94-17c1fef38580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.523845 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9f108-20bb-46ea-8b83-519b35ce25ab admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.523957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30a91a-044c-4efc-8f94-17c1fef38580 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.544555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 794/1585] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/users => generated 294 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.548615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9f108-20bb-46ea-8b83-519b35ce25ab admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.553066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 792/1586] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.553066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30a91a-044c-4efc-8f94-17c1fef38580 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.558908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9f108-20bb-46ea-8b83-519b35ce25ab admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.564358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:INSERT=11,keystone:SELECT=89 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:59.619195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30a91a-044c-4efc-8f94-17c1fef38580 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.623835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee29170-fedb-4a9f-acfe-0f0b8604d3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.623998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b3524-beac-41d9-bf15-b3c8b46df16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.624508 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee29170-fedb-4a9f-acfe-0f0b8604d3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.624617 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b3524-beac-41d9-bf15-b3c8b46df16f admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.624787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b3524-beac-41d9-bf15-b3c8b46df16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.624898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee29170-fedb-4a9f-acfe-0f0b8604d3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.625070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee29170-fedb-4a9f-acfe-0f0b8604d3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.625173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b3524-beac-41d9-bf15-b3c8b46df16f admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.625788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b3524-beac-41d9-bf15-b3c8b46df16f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.625909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee29170-fedb-4a9f-acfe-0f0b8604d3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.627439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee29170-fedb-4a9f-acfe-0f0b8604d3f0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.627786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b3524-beac-41d9-bf15-b3c8b46df16f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.637653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 793/1587] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:59.638297 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee29170-fedb-4a9f-acfe-0f0b8604d3f0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.648633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee29170-fedb-4a9f-acfe-0f0b8604d3f0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.652305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 795/1588] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.652305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b3524-beac-41d9-bf15-b3c8b46df16f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.655917 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62756b-b860-47d1-bbca-68e7264bd5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.656577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62756b-b860-47d1-bbca-68e7264bd5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.656868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62756b-b860-47d1-bbca-68e7264bd5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.657155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62756b-b860-47d1-bbca-68e7264bd5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.657883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62756b-b860-47d1-bbca-68e7264bd5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.660361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62756b-b860-47d1-bbca-68e7264bd5dc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.661762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b3524-beac-41d9-bf15-b3c8b46df16f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.666555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6bf36-7e5a-4219-9454-fb3b72b70754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.667203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6bf36-7e5a-4219-9454-fb3b72b70754 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.667488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6bf36-7e5a-4219-9454-fb3b72b70754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.667766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6bf36-7e5a-4219-9454-fb3b72b70754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.668486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6bf36-7e5a-4219-9454-fb3b72b70754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.670146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6bf36-7e5a-4219-9454-fb3b72b70754 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.670681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 794/1589] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:59.675190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62756b-b860-47d1-bbca-68e7264bd5dc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.683861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 796/1590] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:59.683861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6bf36-7e5a-4219-9454-fb3b72b70754 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.685016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62756b-b860-47d1-bbca-68e7264bd5dc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.689689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d845b3f-0c10-48af-9ec0-46ba631a9aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.690391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d845b3f-0c10-48af-9ec0-46ba631a9aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.690692 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d845b3f-0c10-48af-9ec0-46ba631a9aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.690974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d845b3f-0c10-48af-9ec0-46ba631a9aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.691503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6bf36-7e5a-4219-9454-fb3b72b70754 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.691695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d845b3f-0c10-48af-9ec0-46ba631a9aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.693279 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d845b3f-0c10-48af-9ec0-46ba631a9aa8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.696295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5a364-3f78-48a3-b671-e50c00fdbe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.697160 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5a364-3f78-48a3-b671-e50c00fdbe10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.697439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5a364-3f78-48a3-b671-e50c00fdbe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.697710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5a364-3f78-48a3-b671-e50c00fdbe10 admin admin] PATH_INFO: `/v3/projects/f64d9a9308db43f5a76bbd8313ae8a86/users/bad960ae3d4f4d80885a8cd02cdff29a/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.704466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 795/1591] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:59.708955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d845b3f-0c10-48af-9ec0-46ba631a9aa8 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.714309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5a364-3f78-48a3-b671-e50c00fdbe10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64d9a9308db43f5a76bbd8313ae8a86, user_id=bad960ae3d4f4d80885a8cd02cdff29a, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.718009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5a364-3f78-48a3-b671-e50c00fdbe10 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.718470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d845b3f-0c10-48af-9ec0-46ba631a9aa8 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.723744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3378-f817-4a61-8f0c-d0974d15e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.724398 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3378-f817-4a61-8f0c-d0974d15e667 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.724691 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3378-f817-4a61-8f0c-d0974d15e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.724965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3378-f817-4a61-8f0c-d0974d15e667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.725698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c3378-f817-4a61-8f0c-d0974d15e667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.727320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c3378-f817-4a61-8f0c-d0974d15e667 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.732103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 797/1592] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:08:59 2022] PUT /identity/v3/projects/f64d9a9308db43f5a76bbd8313ae8a86/users/bad960ae3d4f4d80885a8cd02cdff29a/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:08:59.732979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5a364-3f78-48a3-b671-e50c00fdbe10 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.746168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 796/1593] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:59.747417 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3378-f817-4a61-8f0c-d0974d15e667 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.758287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3378-f817-4a61-8f0c-d0974d15e667 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.802980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5a364-3f78-48a3-b671-e50c00fdbe10 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.807773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f2062-c8f7-4a0c-90fe-c2db2f21238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.808601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f2062-c8f7-4a0c-90fe-c2db2f21238b admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.808895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f2062-c8f7-4a0c-90fe-c2db2f21238b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.809180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f2062-c8f7-4a0c-90fe-c2db2f21238b admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.810009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f2062-c8f7-4a0c-90fe-c2db2f21238b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.811977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f2062-c8f7-4a0c-90fe-c2db2f21238b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.815377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbf8f1-a989-4b3e-b409-d378d9ed57f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.816054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbf8f1-a989-4b3e-b409-d378d9ed57f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.816338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbf8f1-a989-4b3e-b409-d378d9ed57f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.816616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbf8f1-a989-4b3e-b409-d378d9ed57f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.817349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbf8f1-a989-4b3e-b409-d378d9ed57f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.819123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbf8f1-a989-4b3e-b409-d378d9ed57f3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.834598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 797/1594] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:59.834598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbf8f1-a989-4b3e-b409-d378d9ed57f3 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.834887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 798/1595] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:59.835334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f2062-c8f7-4a0c-90fe-c2db2f21238b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.837739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:59.843567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbf8f1-a989-4b3e-b409-d378d9ed57f3 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.844980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f2062-c8f7-4a0c-90fe-c2db2f21238b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.850862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1103d71-5c41-47f8-95ec-90ccb5b0f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.851027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9fc72-065d-4fc3-8e46-76f4cc208969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.851530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1103d71-5c41-47f8-95ec-90ccb5b0f487 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.851782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9fc72-065d-4fc3-8e46-76f4cc208969 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.852068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9fc72-065d-4fc3-8e46-76f4cc208969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.852352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9fc72-065d-4fc3-8e46-76f4cc208969 admin admin] PATH_INFO: `/v3/projects/73e83b8e77634afe9b24094b9c06fe85/users/8903701eab424530ab822b7e9a1a9181/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.852457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1103d71-5c41-47f8-95ec-90ccb5b0f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.852717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1103d71-5c41-47f8-95ec-90ccb5b0f487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.853452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1103d71-5c41-47f8-95ec-90ccb5b0f487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.856179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1103d71-5c41-47f8-95ec-90ccb5b0f487 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.867003 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 798/1596] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:59.867401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9fc72-065d-4fc3-8e46-76f4cc208969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e83b8e77634afe9b24094b9c06fe85, user_id=8903701eab424530ab822b7e9a1a9181, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.867785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1103d71-5c41-47f8-95ec-90ccb5b0f487 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.870286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9fc72-065d-4fc3-8e46-76f4cc208969 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.883432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1103d71-5c41-47f8-95ec-90ccb5b0f487 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.885136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 799/1597] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:08:59 2022] PUT /identity/v3/projects/73e83b8e77634afe9b24094b9c06fe85/users/8903701eab424530ab822b7e9a1a9181/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:08:59.885704 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9fc72-065d-4fc3-8e46-76f4cc208969 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:59.920789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:59.956383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9fc72-065d-4fc3-8e46-76f4cc208969 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:59.956998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff1476-fb9f-4c69-83fe-382dd9eb13ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.958258 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff1476-fb9f-4c69-83fe-382dd9eb13ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.958575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff1476-fb9f-4c69-83fe-382dd9eb13ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.958856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff1476-fb9f-4c69-83fe-382dd9eb13ab admin admin] PATH_INFO: `/v3/projects/312922aad11041fe8ffd0e759a0dd181/users/e865eb548a4d447e9fa2461cddcd42f5/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.961167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004fb6e-d007-4553-87a6-abe5aed92409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:59.961867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004fb6e-d007-4553-87a6-abe5aed92409 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.962154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004fb6e-d007-4553-87a6-abe5aed92409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.962623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004fb6e-d007-4553-87a6-abe5aed92409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.963354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004fb6e-d007-4553-87a6-abe5aed92409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.964947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004fb6e-d007-4553-87a6-abe5aed92409 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.976689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 800/1598] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:59.977367 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff1476-fb9f-4c69-83fe-382dd9eb13ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=312922aad11041fe8ffd0e759a0dd181, user_id=e865eb548a4d447e9fa2461cddcd42f5, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:59.977984 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0bd8f-cad1-4997-9731-5e2617427e6b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:59.978392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0bd8f-cad1-4997-9731-5e2617427e6b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:59.978687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0bd8f-cad1-4997-9731-5e2617427e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:59.980097 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff1476-fb9f-4c69-83fe-382dd9eb13ab admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:59.994270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 799/1599] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:08:59 2022] PUT /identity/v3/projects/312922aad11041fe8ffd0e759a0dd181/users/e865eb548a4d447e9fa2461cddcd42f5/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:08:59.997613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff1476-fb9f-4c69-83fe-382dd9eb13ab admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.006830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b9a0bd8f-cad1-4997-9731-5e2617427e6b None None] MFA Rules not processed for user `bad960ae3d4f4d80885a8cd02cdff29a`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:00.008033 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b9a0bd8f-cad1-4997-9731-5e2617427e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:00.059160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff1476-fb9f-4c69-83fe-382dd9eb13ab admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.063746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8590a-3665-4933-ac16-903accac4435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.064421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8590a-3665-4933-ac16-903accac4435 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.064713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8590a-3665-4933-ac16-903accac4435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.065081 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8590a-3665-4933-ac16-903accac4435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.065792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8590a-3665-4933-ac16-903accac4435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.067420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8590a-3665-4933-ac16-903accac4435 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.073360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 801/1600] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:08:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:00.074210 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0bd8f-cad1-4997-9731-5e2617427e6b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.077716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 800/1601] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:00.079084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8590a-3665-4933-ac16-903accac4435 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.084995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0bd8f-cad1-4997-9731-5e2617427e6b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.089078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8590a-3665-4933-ac16-903accac4435 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.089587 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17ff4a-4559-4211-b9a2-fe3101ec801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.090502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17ff4a-4559-4211-b9a2-fe3101ec801b admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.090787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17ff4a-4559-4211-b9a2-fe3101ec801b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.091080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17ff4a-4559-4211-b9a2-fe3101ec801b admin admin] PATH_INFO: `/v3/projects/3eae88858fd7487cb48930e899eb63bd/users/e40620f994a84438be8274acfe3eb547/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.093814 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230a67b-1625-4d46-b820-115f47f3f75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.094505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230a67b-1625-4d46-b820-115f47f3f75a admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.094791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230a67b-1625-4d46-b820-115f47f3f75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.095067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230a67b-1625-4d46-b820-115f47f3f75a admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.095789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230a67b-1625-4d46-b820-115f47f3f75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.097952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230a67b-1625-4d46-b820-115f47f3f75a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.107822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 801/1602] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:00.108603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230a67b-1625-4d46-b820-115f47f3f75a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.111784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17ff4a-4559-4211-b9a2-fe3101ec801b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eae88858fd7487cb48930e899eb63bd, user_id=e40620f994a84438be8274acfe3eb547, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.114492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17ff4a-4559-4211-b9a2-fe3101ec801b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.120352 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230a67b-1625-4d46-b820-115f47f3f75a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.125390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b491be6-ffed-418c-9e2d-877505ec59f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.126048 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b491be6-ffed-418c-9e2d-877505ec59f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.126329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b491be6-ffed-418c-9e2d-877505ec59f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.126656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b491be6-ffed-418c-9e2d-877505ec59f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.127991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b491be6-ffed-418c-9e2d-877505ec59f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.128400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 802/1603] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:00 2022] PUT /identity/v3/projects/3eae88858fd7487cb48930e899eb63bd/users/e40620f994a84438be8274acfe3eb547/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:00.129600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b491be6-ffed-418c-9e2d-877505ec59f7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.129718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c8d71-87e2-4700-a4ac-af339e3af787 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.129931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c8d71-87e2-4700-a4ac-af339e3af787 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.130211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c8d71-87e2-4700-a4ac-af339e3af787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.143453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 802/1604] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:00.143453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b491be6-ffed-418c-9e2d-877505ec59f7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.147904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-688c8d71-87e2-4700-a4ac-af339e3af787 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:00.149108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-688c8d71-87e2-4700-a4ac-af339e3af787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:00.152559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b491be6-ffed-418c-9e2d-877505ec59f7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.197289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:00.211133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca486fed-cda6-4a7f-8805-acf9f8bbf8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.212169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca486fed-cda6-4a7f-8805-acf9f8bbf8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.212395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca486fed-cda6-4a7f-8805-acf9f8bbf8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.212673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca486fed-cda6-4a7f-8805-acf9f8bbf8f9 admin admin] PATH_INFO: `/v3/projects/5d074c8378db455baab9f18f191e3b07/users/ed81799983c143eaa48a6a184c0eaf21/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.213675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 803/1605] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:00.214438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c8d71-87e2-4700-a4ac-af339e3af787 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.224094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c8d71-87e2-4700-a4ac-af339e3af787 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.228757 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c345-d7a8-4d4a-8573-f66bf9db7284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.229422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c345-d7a8-4d4a-8573-f66bf9db7284 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.229708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c345-d7a8-4d4a-8573-f66bf9db7284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.229991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c345-d7a8-4d4a-8573-f66bf9db7284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.230752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0c345-d7a8-4d4a-8573-f66bf9db7284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.232333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0c345-d7a8-4d4a-8573-f66bf9db7284 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.233124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca486fed-cda6-4a7f-8805-acf9f8bbf8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d074c8378db455baab9f18f191e3b07, user_id=ed81799983c143eaa48a6a184c0eaf21, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.235851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca486fed-cda6-4a7f-8805-acf9f8bbf8f9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.243162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 804/1606] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:00.246980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c345-d7a8-4d4a-8573-f66bf9db7284 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.249249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 803/1607] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:00 2022] PUT /identity/v3/projects/5d074c8378db455baab9f18f191e3b07/users/ed81799983c143eaa48a6a184c0eaf21/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:00.250016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca486fed-cda6-4a7f-8805-acf9f8bbf8f9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.258677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c345-d7a8-4d4a-8573-f66bf9db7284 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.275586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:00.311876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca486fed-cda6-4a7f-8805-acf9f8bbf8f9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.317317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31eb72-2079-49d3-a08f-32d10a740672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.318224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31eb72-2079-49d3-a08f-32d10a740672 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.318547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31eb72-2079-49d3-a08f-32d10a740672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.318826 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31eb72-2079-49d3-a08f-32d10a740672 admin admin] PATH_INFO: `/v3/projects/47302f58f9304674983357938c169424/users/4ae911b452a04efe98022f47ae9dcbca/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.321857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a550839-98a4-4f76-820a-49a1e06784af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.322894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a550839-98a4-4f76-820a-49a1e06784af admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.323330 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a550839-98a4-4f76-820a-49a1e06784af admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.323754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a550839-98a4-4f76-820a-49a1e06784af admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.324836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a550839-98a4-4f76-820a-49a1e06784af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.327986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a550839-98a4-4f76-820a-49a1e06784af admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.334682 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31eb72-2079-49d3-a08f-32d10a740672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47302f58f9304674983357938c169424, user_id=4ae911b452a04efe98022f47ae9dcbca, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.337335 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31eb72-2079-49d3-a08f-32d10a740672 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.351872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 804/1608] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:00 2022] PUT /identity/v3/projects/47302f58f9304674983357938c169424/users/4ae911b452a04efe98022f47ae9dcbca/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:00.352862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31eb72-2079-49d3-a08f-32d10a740672 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.362233 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 805/1609] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:00 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:00.365489 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86fa0e-9804-44a2-a31c-afa25825b3df None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.365489 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86fa0e-9804-44a2-a31c-afa25825b3df None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.365489 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86fa0e-9804-44a2-a31c-afa25825b3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.382170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2c86fa0e-9804-44a2-a31c-afa25825b3df None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:00.383432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2c86fa0e-9804-44a2-a31c-afa25825b3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:00.419660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31eb72-2079-49d3-a08f-32d10a740672 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.441859 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 806/1610] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:00.442711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86fa0e-9804-44a2-a31c-afa25825b3df None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.451906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86fa0e-9804-44a2-a31c-afa25825b3df None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.456672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35b87c-a7f5-4ea1-99ce-f6d707d414ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.457554 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35b87c-a7f5-4ea1-99ce-f6d707d414ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.457842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35b87c-a7f5-4ea1-99ce-f6d707d414ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.458120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35b87c-a7f5-4ea1-99ce-f6d707d414ae admin admin] PATH_INFO: `/v3/projects/c967927653574aa79799d609a9947926/users/ab4f8cbfaebc4111ab6a692e55f62bf4/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.473846 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35b87c-a7f5-4ea1-99ce-f6d707d414ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c967927653574aa79799d609a9947926, user_id=ab4f8cbfaebc4111ab6a692e55f62bf4, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.476551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35b87c-a7f5-4ea1-99ce-f6d707d414ae admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.478315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a50295-9dc0-4a21-83e5-b9caf62fe2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.479021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a50295-9dc0-4a21-83e5-b9caf62fe2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.479304 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a50295-9dc0-4a21-83e5-b9caf62fe2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.479696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a50295-9dc0-4a21-83e5-b9caf62fe2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.480566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a50295-9dc0-4a21-83e5-b9caf62fe2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.482381 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a50295-9dc0-4a21-83e5-b9caf62fe2c9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.484650 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:00.491091 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 807/1611] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:00 2022] PUT /identity/v3/projects/c967927653574aa79799d609a9947926/users/ab4f8cbfaebc4111ab6a692e55f62bf4/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:00.492007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35b87c-a7f5-4ea1-99ce-f6d707d414ae admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.501575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 805/1612] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:00.501575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a50295-9dc0-4a21-83e5-b9caf62fe2c9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.509653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a50295-9dc0-4a21-83e5-b9caf62fe2c9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.550811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35b87c-a7f5-4ea1-99ce-f6d707d414ae admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.554491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b95b9-adc2-4f06-9efe-c622bd0547bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.555155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b95b9-adc2-4f06-9efe-c622bd0547bf service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.555440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b95b9-adc2-4f06-9efe-c622bd0547bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.555716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b95b9-adc2-4f06-9efe-c622bd0547bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.565914 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf444bb-4c34-440b-a3a6-4c05f0ca8af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.566836 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf444bb-4c34-440b-a3a6-4c05f0ca8af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.567122 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf444bb-4c34-440b-a3a6-4c05f0ca8af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.567402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf444bb-4c34-440b-a3a6-4c05f0ca8af8 admin admin] PATH_INFO: `/v3/projects/312922aad11041fe8ffd0e759a0dd181/users/e865eb548a4d447e9fa2461cddcd42f5/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.569359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf444bb-4c34-440b-a3a6-4c05f0ca8af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=312922aad11041fe8ffd0e759a0dd181, user_id=e865eb548a4d447e9fa2461cddcd42f5, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.572650 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf444bb-4c34-440b-a3a6-4c05f0ca8af8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.583552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 806/1613] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:00 2022] PUT /identity/v3/projects/312922aad11041fe8ffd0e759a0dd181/users/e865eb548a4d447e9fa2461cddcd42f5/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:00.584965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1bdbf-91dd-4ec9-b6b7-4f16e4198b14 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.585322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1bdbf-91dd-4ec9-b6b7-4f16e4198b14 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.585674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1bdbf-91dd-4ec9-b6b7-4f16e4198b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.590409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:00.606741 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-96c1bdbf-91dd-4ec9-b6b7-4f16e4198b14 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:00.608104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-96c1bdbf-91dd-4ec9-b6b7-4f16e4198b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:00.623971 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b95b9-adc2-4f06-9efe-c622bd0547bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.625406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b95b9-adc2-4f06-9efe-c622bd0547bf service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.635848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 808/1614] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:00.637249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61b090-a62a-4305-a69b-3e129f150090 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.637539 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61b090-a62a-4305-a69b-3e129f150090 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.637824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61b090-a62a-4305-a69b-3e129f150090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.656063 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2c61b090-a62a-4305-a69b-3e129f150090 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:00.657350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2c61b090-a62a-4305-a69b-3e129f150090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:00.669430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 807/1615] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:00.674002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1bdbf-91dd-4ec9-b6b7-4f16e4198b14 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.686882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1bdbf-91dd-4ec9-b6b7-4f16e4198b14 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.692289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bf169-b095-4537-aa53-9883c817af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.693007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bf169-b095-4537-aa53-9883c817af23 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.693295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bf169-b095-4537-aa53-9883c817af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.693675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bf169-b095-4537-aa53-9883c817af23 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.694404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bf169-b095-4537-aa53-9883c817af23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.696524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bf169-b095-4537-aa53-9883c817af23 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.719155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 808/1616] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:00 2022] POST /identity/v3/users => generated 291 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:00.723211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bf169-b095-4537-aa53-9883c817af23 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.738697 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 809/1617] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:00.744052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c66c8d-a063-4e41-a21d-15dcb314ccb4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.744415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c66c8d-a063-4e41-a21d-15dcb314ccb4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.744779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c66c8d-a063-4e41-a21d-15dcb314ccb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.775988 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f6c66c8d-a063-4e41-a21d-15dcb314ccb4 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:00.777346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f6c66c8d-a063-4e41-a21d-15dcb314ccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:00.784048 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bf169-b095-4537-aa53-9883c817af23 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.788141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bbc97-d82c-4e26-a8ba-386193bf163d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.788811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bbc97-d82c-4e26-a8ba-386193bf163d service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.789104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bbc97-d82c-4e26-a8ba-386193bf163d service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.789388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bbc97-d82c-4e26-a8ba-386193bf163d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.791280 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 810/1618] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:00.792786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c66c8d-a063-4e41-a21d-15dcb314ccb4 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.800063 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bbc97-d82c-4e26-a8ba-386193bf163d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.801655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bbc97-d82c-4e26-a8ba-386193bf163d service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.812370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c66c8d-a063-4e41-a21d-15dcb314ccb4 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.813120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 809/1619] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:00.814408 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704d73-69e3-44e5-b765-71fa2d3386fb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.815277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704d73-69e3-44e5-b765-71fa2d3386fb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.815654 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704d73-69e3-44e5-b765-71fa2d3386fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.819559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cfd51-93d4-4454-9b39-9c17a7485fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.820669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cfd51-93d4-4454-9b39-9c17a7485fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.820952 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cfd51-93d4-4454-9b39-9c17a7485fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.821226 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cfd51-93d4-4454-9b39-9c17a7485fd4 admin admin] PATH_INFO: `/v3/projects/731647b0bf314e08a2c81f11e336c517/users/d606302f219a4aee9afe4d728221acbe/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.838790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100cfd51-93d4-4454-9b39-9c17a7485fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731647b0bf314e08a2c81f11e336c517, user_id=d606302f219a4aee9afe4d728221acbe, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:00.841408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100cfd51-93d4-4454-9b39-9c17a7485fd4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:00.846771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-58704d73-69e3-44e5-b765-71fa2d3386fb None None] MFA Rules not processed for user `e865eb548a4d447e9fa2461cddcd42f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:00.848496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-58704d73-69e3-44e5-b765-71fa2d3386fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:00.855568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:00.863157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 811/1620] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:00 2022] PUT /identity/v3/projects/731647b0bf314e08a2c81f11e336c517/users/d606302f219a4aee9afe4d728221acbe/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:00.874201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cfd51-93d4-4454-9b39-9c17a7485fd4 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.877406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-100cfd51-93d4-4454-9b39-9c17a7485fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:00.943061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cfd51-93d4-4454-9b39-9c17a7485fd4 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:00.946310 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b14c8-8634-4e83-b952-dbb2f62278d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:00.947105 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b14c8-8634-4e83-b952-dbb2f62278d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:00.947565 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b14c8-8634-4e83-b952-dbb2f62278d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:00.947882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b14c8-8634-4e83-b952-dbb2f62278d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:00.953187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 810/1621] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:00.956289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704d73-69e3-44e5-b765-71fa2d3386fb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:00.973544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704d73-69e3-44e5-b765-71fa2d3386fb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:01.012046 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:01.022697 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b14c8-8634-4e83-b952-dbb2f62278d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.025358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b14c8-8634-4e83-b952-dbb2f62278d2 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.035955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 812/1622] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:01.036579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b14c8-8634-4e83-b952-dbb2f62278d2 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.043686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be81a2-5709-432c-bc4c-b892875f6b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:01.044857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be81a2-5709-432c-bc4c-b892875f6b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.045359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be81a2-5709-432c-bc4c-b892875f6b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.045994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be81a2-5709-432c-bc4c-b892875f6b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.046734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b14c8-8634-4e83-b952-dbb2f62278d2 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:01.047251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be81a2-5709-432c-bc4c-b892875f6b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.050387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be81a2-5709-432c-bc4c-b892875f6b97 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.052320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d506e9-b872-47ca-b624-5dc1fcf0a59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:01.052977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d506e9-b872-47ca-b624-5dc1fcf0a59b service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.053264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d506e9-b872-47ca-b624-5dc1fcf0a59b service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.053540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d506e9-b872-47ca-b624-5dc1fcf0a59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.064162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 811/1623] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:01.065667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be81a2-5709-432c-bc4c-b892875f6b97 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.066715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d506e9-b872-47ca-b624-5dc1fcf0a59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.068519 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d506e9-b872-47ca-b624-5dc1fcf0a59b service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.082521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be81a2-5709-432c-bc4c-b892875f6b97 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:01.085625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 813/1624] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:01.086479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69175d7-5617-42b1-a1d4-afbe3d716552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:01.087225 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69175d7-5617-42b1-a1d4-afbe3d716552 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.087348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b762d-61b3-459b-b6e6-0686e0fa96ee None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.087640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69175d7-5617-42b1-a1d4-afbe3d716552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.087767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b762d-61b3-459b-b6e6-0686e0fa96ee None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.088045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69175d7-5617-42b1-a1d4-afbe3d716552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.088170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b762d-61b3-459b-b6e6-0686e0fa96ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.101035 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69175d7-5617-42b1-a1d4-afbe3d716552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.103047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69175d7-5617-42b1-a1d4-afbe3d716552 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.116645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 812/1625] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:01.117578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69175d7-5617-42b1-a1d4-afbe3d716552 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.125491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d32b762d-61b3-459b-b6e6-0686e0fa96ee None None] MFA Rules not processed for user `d606302f219a4aee9afe4d728221acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:01.127062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d32b762d-61b3-459b-b6e6-0686e0fa96ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:01.181715 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69175d7-5617-42b1-a1d4-afbe3d716552 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:01.186912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff61b56-0dfa-4242-bea6-21c8d496b9ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:01.187767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff61b56-0dfa-4242-bea6-21c8d496b9ac service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.188137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff61b56-0dfa-4242-bea6-21c8d496b9ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.188569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff61b56-0dfa-4242-bea6-21c8d496b9ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.208217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 814/1626] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:01.209415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b762d-61b3-459b-b6e6-0686e0fa96ee None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.221221 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b762d-61b3-459b-b6e6-0686e0fa96ee None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:01.227364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8d87a-1add-43a7-88d5-e2fe926470b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:01.229264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8d87a-1add-43a7-88d5-e2fe926470b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.229817 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8d87a-1add-43a7-88d5-e2fe926470b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.230283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8d87a-1add-43a7-88d5-e2fe926470b8 admin admin] PATH_INFO: `/v3/projects/46e2ed0e855d4cc684c3b218bd7d3fd4/users/dd1406fd772541d894b5b4f5ffde6830/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.246624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:01.255569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8d87a-1add-43a7-88d5-e2fe926470b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e2ed0e855d4cc684c3b218bd7d3fd4, user_id=dd1406fd772541d894b5b4f5ffde6830, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.259664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8d87a-1add-43a7-88d5-e2fe926470b8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.278576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff61b56-0dfa-4242-bea6-21c8d496b9ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.283157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff61b56-0dfa-4242-bea6-21c8d496b9ac service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.289866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 815/1627] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:01 2022] PUT /identity/v3/projects/46e2ed0e855d4cc684c3b218bd7d3fd4/users/dd1406fd772541d894b5b4f5ffde6830/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:01.292979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8d87a-1add-43a7-88d5-e2fe926470b8 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.315759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 813/1628] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:01.318585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff61b56-0dfa-4242-bea6-21c8d496b9ac service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.347245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff61b56-0dfa-4242-bea6-21c8d496b9ac service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:01.421586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8d87a-1add-43a7-88d5-e2fe926470b8 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:01.432640 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fcddd-b9cd-4253-acfb-2e8261074fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:01.433330 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fcddd-b9cd-4253-acfb-2e8261074fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.433618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fcddd-b9cd-4253-acfb-2e8261074fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.433903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fcddd-b9cd-4253-acfb-2e8261074fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.434617 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fcddd-b9cd-4253-acfb-2e8261074fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.441476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fcddd-b9cd-4253-acfb-2e8261074fe2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.445808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d7369-e0be-4888-b200-dff03bdc82b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:01.447295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d7369-e0be-4888-b200-dff03bdc82b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.447724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d7369-e0be-4888-b200-dff03bdc82b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.448155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d7369-e0be-4888-b200-dff03bdc82b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.449149 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d7369-e0be-4888-b200-dff03bdc82b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.451707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d7369-e0be-4888-b200-dff03bdc82b1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.466056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 814/1629] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:01.466870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d7369-e0be-4888-b200-dff03bdc82b1 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.492755 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 816/1630] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:01 2022] POST /identity/v3/projects => generated 403 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:01.493762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fcddd-b9cd-4253-acfb-2e8261074fe2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.536763 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:01.549206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d7369-e0be-4888-b200-dff03bdc82b1 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:01.575826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fcddd-b9cd-4253-acfb-2e8261074fe2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:01.581278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175792b3-f130-48bc-ada5-80b1269045a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:01.582265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175792b3-f130-48bc-ada5-80b1269045a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.582649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175792b3-f130-48bc-ada5-80b1269045a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.583067 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175792b3-f130-48bc-ada5-80b1269045a3 admin admin] PATH_INFO: `/v3/projects/46e2ed0e855d4cc684c3b218bd7d3fd4/users/dd1406fd772541d894b5b4f5ffde6830/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.585104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175792b3-f130-48bc-ada5-80b1269045a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e2ed0e855d4cc684c3b218bd7d3fd4, user_id=dd1406fd772541d894b5b4f5ffde6830, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.587798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175792b3-f130-48bc-ada5-80b1269045a3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.600441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 817/1631] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:01 2022] PUT /identity/v3/projects/46e2ed0e855d4cc684c3b218bd7d3fd4/users/dd1406fd772541d894b5b4f5ffde6830/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:01.601346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175792b3-f130-48bc-ada5-80b1269045a3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.629502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db6602-31a5-4546-b9b2-b2c9ba41690d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:01.630088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db6602-31a5-4546-b9b2-b2c9ba41690d service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.630909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db6602-31a5-4546-b9b2-b2c9ba41690d service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.631360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db6602-31a5-4546-b9b2-b2c9ba41690d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.710783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:01.720372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175792b3-f130-48bc-ada5-80b1269045a3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:01.726494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4871e6-a668-452a-aa1a-153ded6b510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:01.727457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4871e6-a668-452a-aa1a-153ded6b510c admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.728044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4871e6-a668-452a-aa1a-153ded6b510c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.728501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4871e6-a668-452a-aa1a-153ded6b510c admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.729546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4871e6-a668-452a-aa1a-153ded6b510c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.731678 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4871e6-a668-452a-aa1a-153ded6b510c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.752845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db6602-31a5-4546-b9b2-b2c9ba41690d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.754892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db6602-31a5-4546-b9b2-b2c9ba41690d service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.759703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 818/1632] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:01 2022] POST /identity/v3/users => generated 308 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:01.762589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a500c-2e2b-46cc-81cb-7421680e1c5a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.762928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a500c-2e2b-46cc-81cb-7421680e1c5a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.763232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a500c-2e2b-46cc-81cb-7421680e1c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.782576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 815/1633] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:01.782576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db6602-31a5-4546-b9b2-b2c9ba41690d service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.807684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db6602-31a5-4546-b9b2-b2c9ba41690d service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:01.821624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fec38-f90e-4647-a745-2acbc28727b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:01.822611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fec38-f90e-4647-a745-2acbc28727b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.823003 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fec38-f90e-4647-a745-2acbc28727b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.823381 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fec38-f90e-4647-a745-2acbc28727b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.824121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fec38-f90e-4647-a745-2acbc28727b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.826637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fec38-f90e-4647-a745-2acbc28727b2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.835054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-332a500c-2e2b-46cc-81cb-7421680e1c5a None None] MFA Rules not processed for user `dd1406fd772541d894b5b4f5ffde6830`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:01.836475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-332a500c-2e2b-46cc-81cb-7421680e1c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:01.853855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 816/1634] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:01.857636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fec38-f90e-4647-a745-2acbc28727b2 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.879782 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fec38-f90e-4647-a745-2acbc28727b2 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:01.897141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0103e-b611-4544-ad09-3299dd58ee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:01.898249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0103e-b611-4544-ad09-3299dd58ee79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:01.898583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0103e-b611-4544-ad09-3299dd58ee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:01.898835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0103e-b611-4544-ad09-3299dd58ee79 admin admin] PATH_INFO: `/v3/projects/692e755130d54e369b81c140bb799da7/users/22eda302541a4d3992a1672d6be7cbd1/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:01.936395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0103e-b611-4544-ad09-3299dd58ee79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=692e755130d54e369b81c140bb799da7, user_id=22eda302541a4d3992a1672d6be7cbd1, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:01.939201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0103e-b611-4544-ad09-3299dd58ee79 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:01.966186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 819/1635] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:01.968974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 817/1636] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:01 2022] PUT /identity/v3/projects/692e755130d54e369b81c140bb799da7/users/22eda302541a4d3992a1672d6be7cbd1/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:01.974289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a500c-2e2b-46cc-81cb-7421680e1c5a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.980529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0103e-b611-4544-ad09-3299dd58ee79 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:01.989071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a500c-2e2b-46cc-81cb-7421680e1c5a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:02.059286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:02.106203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6b789-21b3-4aaa-9071-e896f46b22fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:02.107195 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6b789-21b3-4aaa-9071-e896f46b22fc admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:02.107481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6b789-21b3-4aaa-9071-e896f46b22fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:02.107758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6b789-21b3-4aaa-9071-e896f46b22fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:02.108547 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6b789-21b3-4aaa-9071-e896f46b22fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:02.112933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6b789-21b3-4aaa-9071-e896f46b22fc admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:02.134038 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 820/1637] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:02.136072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6b789-21b3-4aaa-9071-e896f46b22fc admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:02.153111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0103e-b611-4544-ad09-3299dd58ee79 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:02.156355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6b789-21b3-4aaa-9071-e896f46b22fc admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:02.161806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0986b7-c61a-4048-a5c4-c42ccc6924f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:02.162540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0986b7-c61a-4048-a5c4-c42ccc6924f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:02.164045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0986b7-c61a-4048-a5c4-c42ccc6924f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:02.164287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0986b7-c61a-4048-a5c4-c42ccc6924f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:02.167267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf3eae-2e49-4f8f-9b9f-4cf09aee735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:02.171770 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3eae-2e49-4f8f-9b9f-4cf09aee735a admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:02.172440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3eae-2e49-4f8f-9b9f-4cf09aee735a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:02.173061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3eae-2e49-4f8f-9b9f-4cf09aee735a admin admin] PATH_INFO: `/v3/projects/692e755130d54e369b81c140bb799da7/users/22eda302541a4d3992a1672d6be7cbd1/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:02.191921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf3eae-2e49-4f8f-9b9f-4cf09aee735a admin admin] RBAC: Authorizing `identity:create_grant(project_id=692e755130d54e369b81c140bb799da7, user_id=22eda302541a4d3992a1672d6be7cbd1, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:02.207971 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf3eae-2e49-4f8f-9b9f-4cf09aee735a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:02.232903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 821/1638] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:02 2022] PUT /identity/v3/projects/692e755130d54e369b81c140bb799da7/users/22eda302541a4d3992a1672d6be7cbd1/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:02.246597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c045c-35b2-4322-9206-27b58e854aa8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:02.247008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c045c-35b2-4322-9206-27b58e854aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:02.247381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c045c-35b2-4322-9206-27b58e854aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:02.321472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-646c045c-35b2-4322-9206-27b58e854aa8 None None] MFA Rules not processed for user `22eda302541a4d3992a1672d6be7cbd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:02.326197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0986b7-c61a-4048-a5c4-c42ccc6924f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:02.326305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-646c045c-35b2-4322-9206-27b58e854aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:02.327849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0986b7-c61a-4048-a5c4-c42ccc6924f8 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:02.356311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 818/1639] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:01 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:02.622112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 822/1640] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:02.631437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0986b7-c61a-4048-a5c4-c42ccc6924f8 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:02.646001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0986b7-c61a-4048-a5c4-c42ccc6924f8 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:02.813733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27cc2d-d4c8-46f5-a506-1de8f7395460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:02.815613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27cc2d-d4c8-46f5-a506-1de8f7395460 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:02.816545 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27cc2d-d4c8-46f5-a506-1de8f7395460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:02.817878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27cc2d-d4c8-46f5-a506-1de8f7395460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:02.846535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27cc2d-d4c8-46f5-a506-1de8f7395460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:02.848573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27cc2d-d4c8-46f5-a506-1de8f7395460 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:02.858013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:02.884066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 819/1641] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:02 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:03.295259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c045c-35b2-4322-9206-27b58e854aa8 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:03.481943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c045c-35b2-4322-9206-27b58e854aa8 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:03.497752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:03.500200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:03.500933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:03.501320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] PATH_INFO: `/v3/users/d606302f219a4aee9afe4d728221acbe` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:03.505947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d606302f219a4aee9afe4d728221acbe)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:03.514680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:03.620717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd606302f219a4aee9afe4d728221acbe'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:03.622054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd606302f219a4aee9afe4d728221acbe'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:03.624055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:03.638965 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd606302f219a4aee9afe4d728221acbe'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:03.652507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd606302f219a4aee9afe4d728221acbe'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:03.653360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd606302f219a4aee9afe4d728221acbe'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:03.682227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 823/1642] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:03 2022] DELETE /identity/v3/users/d606302f219a4aee9afe4d728221acbe => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:03.684216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543453b-3c42-4ebb-952b-d8e587186c3b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:03.684688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543453b-3c42-4ebb-952b-d8e587186c3b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:03.684793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543453b-3c42-4ebb-952b-d8e587186c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:03.710203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9543453b-3c42-4ebb-952b-d8e587186c3b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:03.712234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9543453b-3c42-4ebb-952b-d8e587186c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:03.885743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 820/1643] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:03.948865 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:03.950329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:04.072992 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad15da-03ee-4954-a8e0-898a583cc324 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:04.085997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0bef8-199a-4696-9d93-161f8e6b8904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:04.086724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0bef8-199a-4696-9d93-161f8e6b8904 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:04.087076 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0bef8-199a-4696-9d93-161f8e6b8904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:04.087304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0bef8-199a-4696-9d93-161f8e6b8904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:04.119270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0bef8-199a-4696-9d93-161f8e6b8904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:04.120698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0bef8-199a-4696-9d93-161f8e6b8904 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:04.150263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 824/1644] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:04.278188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d755-f886-4fa2-a226-b4ce17a5ec33 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:04.278502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d755-f886-4fa2-a226-b4ce17a5ec33 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:04.278911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d755-f886-4fa2-a226-b4ce17a5ec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:04.338571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5202d755-f886-4fa2-a226-b4ce17a5ec33 None None] MFA Rules not processed for user `ab4f8cbfaebc4111ab6a692e55f62bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:04.339801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5202d755-f886-4fa2-a226-b4ce17a5ec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:04.532197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 821/1645] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:04.544366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5cc76-971f-4bc9-a987-207d1d336969 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:04.544876 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5cc76-971f-4bc9-a987-207d1d336969 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:04.544959 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5cc76-971f-4bc9-a987-207d1d336969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:04.578517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3da5cc76-971f-4bc9-a987-207d1d336969 None None] MFA Rules not processed for user `ab4f8cbfaebc4111ab6a692e55f62bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:04.580000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3da5cc76-971f-4bc9-a987-207d1d336969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:04.596746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 825/1646] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:04.657370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58059cc1-ca19-448d-a622-db7adfef2b92 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:04.657659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58059cc1-ca19-448d-a622-db7adfef2b92 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:04.657945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58059cc1-ca19-448d-a622-db7adfef2b92 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:04.659905 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 822/1647] 10.222.0.49 () {54 vars in 961 bytes} [Mon May 23 17:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:04.717294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a5d79-a669-4c54-8fb6-ad14213bd180 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:04.717586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a5d79-a669-4c54-8fb6-ad14213bd180 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:04.717931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a5d79-a669-4c54-8fb6-ad14213bd180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:04.765972 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-cb2a5d79-a669-4c54-8fb6-ad14213bd180 None None] MFA Rules not processed for user `9884780c88aa48ffa92a696740761387`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:04.775289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cb2a5d79-a669-4c54-8fb6-ad14213bd180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:04.936352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 826/1648] 10.222.0.49 () {58 vars in 1058 bytes} [Mon May 23 17:09:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:04.946446 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58059cc1-ca19-448d-a622-db7adfef2b92 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:04.973933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58059cc1-ca19-448d-a622-db7adfef2b92 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:04.984396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbab21f-8661-40a0-9379-a5170dde5406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:04.985142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbab21f-8661-40a0-9379-a5170dde5406 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:04.985495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbab21f-8661-40a0-9379-a5170dde5406 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:04.985843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbab21f-8661-40a0-9379-a5170dde5406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:05.003627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbab21f-8661-40a0-9379-a5170dde5406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:05.008973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbab21f-8661-40a0-9379-a5170dde5406 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:05.042892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 823/1649] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:05.479420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a5d79-a669-4c54-8fb6-ad14213bd180 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:05.481185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cb2a5d79-a669-4c54-8fb6-ad14213bd180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:05.512039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a5d79-a669-4c54-8fb6-ad14213bd180 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:05.537089 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96ba4c-fe04-4cac-9cf8-3ea7083828a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:05.541474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96ba4c-fe04-4cac-9cf8-3ea7083828a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:05.541474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96ba4c-fe04-4cac-9cf8-3ea7083828a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:05.546163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96ba4c-fe04-4cac-9cf8-3ea7083828a2 admin admin] PATH_INFO: `/v3/users/bad960ae3d4f4d80885a8cd02cdff29a` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:05.552783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96ba4c-fe04-4cac-9cf8-3ea7083828a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad960ae3d4f4d80885a8cd02cdff29a)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:05.558565 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96ba4c-fe04-4cac-9cf8-3ea7083828a2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:05.609761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f5afb-9201-4468-b651-94a8963e460b None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:05.610060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f5afb-9201-4468-b651-94a8963e460b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:05.610339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f5afb-9201-4468-b651-94a8963e460b None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:05.619179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 824/1650] 10.222.0.49 () {54 vars in 912 bytes} [Mon May 23 17:09:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:05.629716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ccd9a-a950-44a1-89ff-3dc28b333b60 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:05.630000 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ccd9a-a950-44a1-89ff-3dc28b333b60 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:05.630458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ccd9a-a950-44a1-89ff-3dc28b333b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:05.669334 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-537ccd9a-a950-44a1-89ff-3dc28b333b60 None None] MFA Rules not processed for user `9884780c88aa48ffa92a696740761387`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:05.671205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-537ccd9a-a950-44a1-89ff-3dc28b333b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:05.714993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 825/1651] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:05.724480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ccd9a-a950-44a1-89ff-3dc28b333b60 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:05.726874 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-537ccd9a-a950-44a1-89ff-3dc28b333b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:05.734341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6a96ba4c-fe04-4cac-9cf8-3ea7083828a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad960ae3d4f4d80885a8cd02cdff29a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:05.735506 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6a96ba4c-fe04-4cac-9cf8-3ea7083828a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad960ae3d4f4d80885a8cd02cdff29a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:05.737154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:05.773607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6a96ba4c-fe04-4cac-9cf8-3ea7083828a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad960ae3d4f4d80885a8cd02cdff29a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:05.792901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6a96ba4c-fe04-4cac-9cf8-3ea7083828a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad960ae3d4f4d80885a8cd02cdff29a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:05.795271 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6a96ba4c-fe04-4cac-9cf8-3ea7083828a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad960ae3d4f4d80885a8cd02cdff29a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:05.855347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 827/1652] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:05 2022] DELETE /identity/v3/users/bad960ae3d4f4d80885a8cd02cdff29a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:05.868613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ccd9a-a950-44a1-89ff-3dc28b333b60 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:05.869266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26995021-f48a-4999-aa60-a11fae3fb56a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:05.869696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26995021-f48a-4999-aa60-a11fae3fb56a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:05.869979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26995021-f48a-4999-aa60-a11fae3fb56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:05.917676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-26995021-f48a-4999-aa60-a11fae3fb56a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:05.919013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-26995021-f48a-4999-aa60-a11fae3fb56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:05.932362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:05.996595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb4c53-6f16-4cef-9c85-9685727936e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5b9c982724df0b88ce6ad46dc37e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:05.997275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb4c53-6f16-4cef-9c85-9685727936e5 service glance] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:05.998137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb4c53-6f16-4cef-9c85-9685727936e5 service glance] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:05.998457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb4c53-6f16-4cef-9c85-9685727936e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:06.005008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c6bb4c53-6f16-4cef-9c85-9685727936e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:06.073676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 828/1653] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:06.076051 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26995021-f48a-4999-aa60-a11fae3fb56a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:06.093691 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-26995021-f48a-4999-aa60-a11fae3fb56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:06.147741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26995021-f48a-4999-aa60-a11fae3fb56a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:06.170113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:06.173633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:06.176285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:06.176914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] PATH_INFO: `/v3/projects/731647b0bf314e08a2c81f11e336c517` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:06.178748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] RBAC: Authorizing `identity:delete_project(project_id=731647b0bf314e08a2c81f11e336c517)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:06.180164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:09:06.180164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 23 17:09:06.180164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: May 23 17:09:06.182305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:06.193146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb4c53-6f16-4cef-9c85-9685727936e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:06.194938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb4c53-6f16-4cef-9c85-9685727936e5 service glance] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:06.219687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 826/1654] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:06.220618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb4c53-6f16-4cef-9c85-9685727936e5 service glance] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:06.224487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c6bb4c53-6f16-4cef-9c85-9685727936e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:06.333093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731647b0bf314e08a2c81f11e336c517', 'request_id': 'req-94aea3b7-0918-4e71-9a46-243a88fd101f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:06.347591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731647b0bf314e08a2c81f11e336c517', 'request_id': 'req-94aea3b7-0918-4e71-9a46-243a88fd101f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:06.358507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb4c53-6f16-4cef-9c85-9685727936e5 service glance] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:06.373906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731647b0bf314e08a2c81f11e336c517', 'request_id': 'req-94aea3b7-0918-4e71-9a46-243a88fd101f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:06.394644 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] The token cache is being invalidate because project 731647b0bf314e08a2c81f11e336c517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:06.395036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:06.396113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:06.397859 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 829/1655] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:06 2022] DELETE /identity/v3/projects/731647b0bf314e08a2c81f11e336c517 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:06.402155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:06.404175 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:06.472240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6c9bf-a261-4a20-8104-c1ff3d76f276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:06.472924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6c9bf-a261-4a20-8104-c1ff3d76f276 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:06.473216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6c9bf-a261-4a20-8104-c1ff3d76f276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:06.473496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6c9bf-a261-4a20-8104-c1ff3d76f276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:06.481312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-63a6c9bf-a261-4a20-8104-c1ff3d76f276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:06.513953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:06.560518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea3b7-0918-4e71-9a46-243a88fd101f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:06.572838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2f97c-6cdb-4ab9-af5e-2283f5cb58ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:06.573703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2f97c-6cdb-4ab9-af5e-2283f5cb58ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:06.573986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2f97c-6cdb-4ab9-af5e-2283f5cb58ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:06.577003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2f97c-6cdb-4ab9-af5e-2283f5cb58ff admin admin] PATH_INFO: `/v3/users/22eda302541a4d3992a1672d6be7cbd1` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:06.579367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2f97c-6cdb-4ab9-af5e-2283f5cb58ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=22eda302541a4d3992a1672d6be7cbd1)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:06.581734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2f97c-6cdb-4ab9-af5e-2283f5cb58ff admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:06.640551 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:06.699070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6c9bf-a261-4a20-8104-c1ff3d76f276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:06.700713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6c9bf-a261-4a20-8104-c1ff3d76f276 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:06.740470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 827/1656] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:06.752327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9fd2f97c-6cdb-4ab9-af5e-2283f5cb58ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22eda302541a4d3992a1672d6be7cbd1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:06.754948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9fd2f97c-6cdb-4ab9-af5e-2283f5cb58ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22eda302541a4d3992a1672d6be7cbd1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:06.788352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9fd2f97c-6cdb-4ab9-af5e-2283f5cb58ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22eda302541a4d3992a1672d6be7cbd1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:06.808260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9fd2f97c-6cdb-4ab9-af5e-2283f5cb58ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22eda302541a4d3992a1672d6be7cbd1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:06.809322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9fd2f97c-6cdb-4ab9-af5e-2283f5cb58ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22eda302541a4d3992a1672d6be7cbd1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:06.845158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 830/1657] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:06 2022] DELETE /identity/v3/users/22eda302541a4d3992a1672d6be7cbd1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:08.633301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d91653-8dfc-4258-adfa-deb3e05f0552 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:08.634216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d91653-8dfc-4258-adfa-deb3e05f0552 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:08.634670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d91653-8dfc-4258-adfa-deb3e05f0552 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:08.636571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 828/1658] 10.222.0.49 () {54 vars in 912 bytes} [Mon May 23 17:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:08.647798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4058579-0163-40b8-b495-f151d8885406 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:08.648296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4058579-0163-40b8-b495-f151d8885406 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:08.651512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4058579-0163-40b8-b495-f151d8885406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:08.743859 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f4058579-0163-40b8-b495-f151d8885406 None None] MFA Rules not processed for user `73bdfedb6d9e4ddab18a8143ba7142fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:08.745348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f4058579-0163-40b8-b495-f151d8885406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:08.896086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 831/1659] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:09:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:08.983399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d91653-8dfc-4258-adfa-deb3e05f0552 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:08.985757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-12d91653-8dfc-4258-adfa-deb3e05f0552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:09.015320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d91653-8dfc-4258-adfa-deb3e05f0552 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:09.027842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f71359-e16b-4413-8c2a-a90781e05841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:09.028907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71359-e16b-4413-8c2a-a90781e05841 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:09.029414 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71359-e16b-4413-8c2a-a90781e05841 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:09.032418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71359-e16b-4413-8c2a-a90781e05841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:09.056891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f71359-e16b-4413-8c2a-a90781e05841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:09.060084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f71359-e16b-4413-8c2a-a90781e05841 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:09.093490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 829/1660] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:09.220652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4058579-0163-40b8-b495-f151d8885406 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:09.223324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f4058579-0163-40b8-b495-f151d8885406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:09.370929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4058579-0163-40b8-b495-f151d8885406 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:09.378143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:09.379867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:09.380394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:09.380960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] PATH_INFO: `/v3/projects/692e755130d54e369b81c140bb799da7` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:09.382788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] RBAC: Authorizing `identity:delete_project(project_id=692e755130d54e369b81c140bb799da7)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:09.385499 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:09.395223 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:09.497110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692e755130d54e369b81c140bb799da7', 'request_id': 'req-c8a61e98-de91-48d3-84a8-070b9322b86f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:09.537620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692e755130d54e369b81c140bb799da7', 'request_id': 'req-c8a61e98-de91-48d3-84a8-070b9322b86f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:09.555709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692e755130d54e369b81c140bb799da7', 'request_id': 'req-c8a61e98-de91-48d3-84a8-070b9322b86f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:09.592885 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] The token cache is being invalidate because project 692e755130d54e369b81c140bb799da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:09.593208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:09.595531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:09.605581 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 832/1661] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:09 2022] DELETE /identity/v3/projects/692e755130d54e369b81c140bb799da7 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:09.610637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862d699-431d-4f8b-bab0-3ff2bb23d4d4 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:09.611016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862d699-431d-4f8b-bab0-3ff2bb23d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:09.611494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862d699-431d-4f8b-bab0-3ff2bb23d4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:09.626173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:09.632044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:09.692184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9862d699-431d-4f8b-bab0-3ff2bb23d4d4 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:09.699040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9862d699-431d-4f8b-bab0-3ff2bb23d4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:09.839893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61e98-de91-48d3-84a8-070b9322b86f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:09.855168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:09.856311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:09.856660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:09.856955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] PATH_INFO: `/v3/projects/f64d9a9308db43f5a76bbd8313ae8a86` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:09.859120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64d9a9308db43f5a76bbd8313ae8a86)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:09.861250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:09.866813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 830/1662] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:09.875179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b35bbd-80ce-4a49-a546-aaea43bfe3b6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:09.875486 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b35bbd-80ce-4a49-a546-aaea43bfe3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:09.875828 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b35bbd-80ce-4a49-a546-aaea43bfe3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:09.904814 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-30b35bbd-80ce-4a49-a546-aaea43bfe3b6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:09.906314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-30b35bbd-80ce-4a49-a546-aaea43bfe3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:09.919639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 831/1663] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:09.923610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b35bbd-80ce-4a49-a546-aaea43bfe3b6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:09.939852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b35bbd-80ce-4a49-a546-aaea43bfe3b6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:09.949291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6cc8-2045-4de2-9622-e9c8a0722b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:09.949913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6cc8-2045-4de2-9622-e9c8a0722b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:09.950300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6cc8-2045-4de2-9622-e9c8a0722b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:09.950784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6cc8-2045-4de2-9622-e9c8a0722b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:09.951890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d6cc8-2045-4de2-9622-e9c8a0722b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:09.952432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d6cc8-2045-4de2-9622-e9c8a0722b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:09.956693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d6cc8-2045-4de2-9622-e9c8a0722b00 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:09.975572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 832/1664] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:09:09.982049 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6cc8-2045-4de2-9622-e9c8a0722b00 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:09.994948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64d9a9308db43f5a76bbd8313ae8a86', 'request_id': 'req-12c83906-2da6-4817-8eb8-fa8234b723d0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:10.008890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6cc8-2045-4de2-9622-e9c8a0722b00 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:10.038472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64d9a9308db43f5a76bbd8313ae8a86', 'request_id': 'req-12c83906-2da6-4817-8eb8-fa8234b723d0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:10.091020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64d9a9308db43f5a76bbd8313ae8a86', 'request_id': 'req-12c83906-2da6-4817-8eb8-fa8234b723d0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:10.112628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] The token cache is being invalidate because project f64d9a9308db43f5a76bbd8313ae8a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:10.113166 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:10.114098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:10.118225 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 833/1665] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:09 2022] DELETE /identity/v3/projects/f64d9a9308db43f5a76bbd8313ae8a86 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:10.121976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:10.125024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:10.162455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a3a43-38df-4283-812f-ab0674c3ec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:10.163139 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a3a43-38df-4283-812f-ab0674c3ec1e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:10.163446 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a3a43-38df-4283-812f-ab0674c3ec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:10.163722 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a3a43-38df-4283-812f-ab0674c3ec1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:10.164450 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a3a43-38df-4283-812f-ab0674c3ec1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:10.166398 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a3a43-38df-4283-812f-ab0674c3ec1e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:10.219756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:10.225919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 833/1666] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:09 2022] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:10.229750 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a3a43-38df-4283-812f-ab0674c3ec1e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:10.238631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9c8a3a43-38df-4283-812f-ab0674c3ec1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:10.305933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:10.332661 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c83906-2da6-4817-8eb8-fa8234b723d0 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:10.391944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a3a43-38df-4283-812f-ab0674c3ec1e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:10.406746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f6361-e69c-421b-9f5b-078d2da755b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:10.407457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f6361-e69c-421b-9f5b-078d2da755b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:10.407755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f6361-e69c-421b-9f5b-078d2da755b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:10.408041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f6361-e69c-421b-9f5b-078d2da755b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:10.408988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f6361-e69c-421b-9f5b-078d2da755b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:10.413269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f6361-e69c-421b-9f5b-078d2da755b5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:10.475941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 834/1667] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:10 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:09:10.477099 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f6361-e69c-421b-9f5b-078d2da755b5 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:10.493609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eab17-c0ee-4a01-b7e5-b31b3b1fe63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:10.500093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eab17-c0ee-4a01-b7e5-b31b3b1fe63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:10.500224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eab17-c0ee-4a01-b7e5-b31b3b1fe63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:10.500447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eab17-c0ee-4a01-b7e5-b31b3b1fe63f admin admin] PATH_INFO: `/v3/users/dd1406fd772541d894b5b4f5ffde6830` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:10.504393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2eab17-c0ee-4a01-b7e5-b31b3b1fe63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1406fd772541d894b5b4f5ffde6830)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:10.525216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2eab17-c0ee-4a01-b7e5-b31b3b1fe63f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:10.525447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f6361-e69c-421b-9f5b-078d2da755b5 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:10.548229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7862057-b536-4f1c-8626-3032522cd707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:10.549484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7862057-b536-4f1c-8626-3032522cd707 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:10.549789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7862057-b536-4f1c-8626-3032522cd707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:10.550080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7862057-b536-4f1c-8626-3032522cd707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:10.550863 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7862057-b536-4f1c-8626-3032522cd707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:10.552629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7862057-b536-4f1c-8626-3032522cd707 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:10.598240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 835/1668] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:10.605113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7862057-b536-4f1c-8626-3032522cd707 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:10.653871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7862057-b536-4f1c-8626-3032522cd707 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:10.704303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f644c24-7cc0-4243-a578-946bc3d45d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:10.706597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f644c24-7cc0-4243-a578-946bc3d45d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:10.707668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f644c24-7cc0-4243-a578-946bc3d45d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:10.708458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f644c24-7cc0-4243-a578-946bc3d45d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:10.710784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f644c24-7cc0-4243-a578-946bc3d45d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:10.718944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f644c24-7cc0-4243-a578-946bc3d45d2b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:10.726862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a2eab17-c0ee-4a01-b7e5-b31b3b1fe63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1406fd772541d894b5b4f5ffde6830'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:10.729286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a2eab17-c0ee-4a01-b7e5-b31b3b1fe63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1406fd772541d894b5b4f5ffde6830'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:10.749394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a2eab17-c0ee-4a01-b7e5-b31b3b1fe63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1406fd772541d894b5b4f5ffde6830'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:10.751861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 836/1669] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:10.753563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f91ae-3f89-4a91-bca9-7992742c6e0f None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:10.755249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f91ae-3f89-4a91-bca9-7992742c6e0f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:10.755697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f91ae-3f89-4a91-bca9-7992742c6e0f None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:10.761467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 837/1670] 10.222.0.49 () {54 vars in 960 bytes} [Mon May 23 17:09:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:10.762686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f91ae-3f89-4a91-bca9-7992742c6e0f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:10.774989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a2eab17-c0ee-4a01-b7e5-b31b3b1fe63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1406fd772541d894b5b4f5ffde6830'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:10.775368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a2eab17-c0ee-4a01-b7e5-b31b3b1fe63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1406fd772541d894b5b4f5ffde6830'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:10.811930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f91ae-3f89-4a91-bca9-7992742c6e0f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:10.827057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 834/1671] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:10 2022] DELETE /identity/v3/users/dd1406fd772541d894b5b4f5ffde6830 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:10.827980 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2ed7-756f-41aa-9d97-3ec37f518957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:10.831346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4c193-b5d4-464c-af92-c61ab0d9ac8f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:10.831635 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4c193-b5d4-464c-af92-c61ab0d9ac8f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:10.831936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4c193-b5d4-464c-af92-c61ab0d9ac8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:10.833263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2ed7-756f-41aa-9d97-3ec37f518957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:10.833595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2ed7-756f-41aa-9d97-3ec37f518957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:10.833878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2ed7-756f-41aa-9d97-3ec37f518957 admin admin] PATH_INFO: `/v3/projects/7025c30b2aab4992b5965404ed2ab42e/users/3d3379580b184252bd9c8aedc24a1ffe/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:10.881143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba2ed7-756f-41aa-9d97-3ec37f518957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7025c30b2aab4992b5965404ed2ab42e, user_id=3d3379580b184252bd9c8aedc24a1ffe, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:10.883948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba2ed7-756f-41aa-9d97-3ec37f518957 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:10.886478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-cca4c193-b5d4-464c-af92-c61ab0d9ac8f None None] MFA Rules not processed for user `81fb8b261e2142fcbf8d23bd010bf715`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:10.887962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cca4c193-b5d4-464c-af92-c61ab0d9ac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:10.911306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 838/1672] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:10 2022] PUT /identity/v3/projects/7025c30b2aab4992b5965404ed2ab42e/users/3d3379580b184252bd9c8aedc24a1ffe/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:10.929136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c625fa8-b7ca-4aa0-9cc2-26a3e9d113cf None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:10.929616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c625fa8-b7ca-4aa0-9cc2-26a3e9d113cf None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:10.930047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c625fa8-b7ca-4aa0-9cc2-26a3e9d113cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:10.989737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:11.019031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4c625fa8-b7ca-4aa0-9cc2-26a3e9d113cf None None] MFA Rules not processed for user `3d3379580b184252bd9c8aedc24a1ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:11.024679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4c625fa8-b7ca-4aa0-9cc2-26a3e9d113cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:11.026439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 835/1673] 10.222.0.49 () {58 vars in 1057 bytes} [Mon May 23 17:09:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:11.037681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4c193-b5d4-464c-af92-c61ab0d9ac8f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:11.059457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4c193-b5d4-464c-af92-c61ab0d9ac8f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:11.187797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748dc9e-812d-4839-aeec-f7fcfe229cc0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81fb8b261e2142fcbf8d23bd010bf715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:11.188513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748dc9e-812d-4839-aeec-f7fcfe229cc0 service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:11.188803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748dc9e-812d-4839-aeec-f7fcfe229cc0 service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:11.189087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748dc9e-812d-4839-aeec-f7fcfe229cc0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:11.191893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e748dc9e-812d-4839-aeec-f7fcfe229cc0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:11.212643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748dc9e-812d-4839-aeec-f7fcfe229cc0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:11.214458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748dc9e-812d-4839-aeec-f7fcfe229cc0 service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:11.241155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 839/1674] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:11.242582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96080fbd-1e97-4848-9760-6bf5c7d66bd6 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:11.242884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96080fbd-1e97-4848-9760-6bf5c7d66bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:11.242994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 836/1675] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:11.243170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96080fbd-1e97-4848-9760-6bf5c7d66bd6 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:11.245302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748dc9e-812d-4839-aeec-f7fcfe229cc0 service placement] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:11.247880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e748dc9e-812d-4839-aeec-f7fcfe229cc0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:11.250336 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 840/1676] 10.222.0.49 () {54 vars in 961 bytes} [Mon May 23 17:09:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:11.255684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30388a2-9637-48cd-a3a5-2b3d608b8270 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:11.256078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30388a2-9637-48cd-a3a5-2b3d608b8270 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:11.256332 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30388a2-9637-48cd-a3a5-2b3d608b8270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:11.290194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a30388a2-9637-48cd-a3a5-2b3d608b8270 None None] MFA Rules not processed for user `9884780c88aa48ffa92a696740761387`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:11.295886 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a30388a2-9637-48cd-a3a5-2b3d608b8270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:11.408861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748dc9e-812d-4839-aeec-f7fcfe229cc0 service placement] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:11.422310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:11.424892 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0014b-ab6e-4193-affc-97ad404cb820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:11.425627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0014b-ab6e-4193-affc-97ad404cb820 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:11.425766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0014b-ab6e-4193-affc-97ad404cb820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:11.426004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0014b-ab6e-4193-affc-97ad404cb820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:11.426745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0014b-ab6e-4193-affc-97ad404cb820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:11.432995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0014b-ab6e-4193-affc-97ad404cb820 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:11.478774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 841/1677] 10.222.0.49 () {58 vars in 1058 bytes} [Mon May 23 17:09:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:11.485896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4136d-9891-45c0-99f9-c593ed87e9d7 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:11.486200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4136d-9891-45c0-99f9-c593ed87e9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:11.487025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4136d-9891-45c0-99f9-c593ed87e9d7 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:11.489235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 842/1678] 10.222.0.49 () {54 vars in 912 bytes} [Mon May 23 17:09:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:09:11.497315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1abb5-a528-4bd3-9de7-4990be098aee None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:11.497804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1abb5-a528-4bd3-9de7-4990be098aee None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:11.499311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1abb5-a528-4bd3-9de7-4990be098aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:11.539163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 837/1679] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:11 2022] POST /identity/v3/projects => generated 379 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:11.540511 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0014b-ab6e-4193-affc-97ad404cb820 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:11.546404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-82b1abb5-a528-4bd3-9de7-4990be098aee None None] MFA Rules not processed for user `9884780c88aa48ffa92a696740761387`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:11.547563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-82b1abb5-a528-4bd3-9de7-4990be098aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:11.705901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 843/1680] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:09:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:11.724612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0014b-ab6e-4193-affc-97ad404cb820 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:11.749337 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a656c-0fb8-4204-a87d-3085e6b26c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:11.750043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a656c-0fb8-4204-a87d-3085e6b26c47 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:11.750334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a656c-0fb8-4204-a87d-3085e6b26c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:11.750759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a656c-0fb8-4204-a87d-3085e6b26c47 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:11.751344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a656c-0fb8-4204-a87d-3085e6b26c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:11.753370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a656c-0fb8-4204-a87d-3085e6b26c47 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:11.758426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1abb5-a528-4bd3-9de7-4990be098aee None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:11.760364 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-82b1abb5-a528-4bd3-9de7-4990be098aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:11.777836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:11.787528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1abb5-a528-4bd3-9de7-4990be098aee None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:11.798129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a8903-bf21-4506-aada-e5df842d33d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:11.799417 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8903-bf21-4506-aada-e5df842d33d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:11.800196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8903-bf21-4506-aada-e5df842d33d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:11.801045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8903-bf21-4506-aada-e5df842d33d2 admin admin] PATH_INFO: `/v3/users/dda66613edbf432592545eeef59aeab0` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:11.804710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a8903-bf21-4506-aada-e5df842d33d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda66613edbf432592545eeef59aeab0)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:11.807162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-b06a8903-bf21-4506-aada-e5df842d33d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:09:11.807162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 23 17:09:11.807162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: May 23 17:09:11.809562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a8903-bf21-4506-aada-e5df842d33d2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:11.823962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 838/1681] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:11 2022] POST /identity/v3/users => generated 296 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:09:11.823962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a656c-0fb8-4204-a87d-3085e6b26c47 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:11.825301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ea3a656c-0fb8-4204-a87d-3085e6b26c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:11.954824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b06a8903-bf21-4506-aada-e5df842d33d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda66613edbf432592545eeef59aeab0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:11.970304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a656c-0fb8-4204-a87d-3085e6b26c47 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:11.983225 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a620-ffea-4dca-ab80-73a836ebc733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:11.983926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a620-ffea-4dca-ab80-73a836ebc733 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:11.984219 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a620-ffea-4dca-ab80-73a836ebc733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:11.984502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a620-ffea-4dca-ab80-73a836ebc733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:12.006380 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41a620-ffea-4dca-ab80-73a836ebc733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:12.006506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b06a8903-bf21-4506-aada-e5df842d33d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda66613edbf432592545eeef59aeab0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:12.007855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41a620-ffea-4dca-ab80-73a836ebc733 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:12.010157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b06a8903-bf21-4506-aada-e5df842d33d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda66613edbf432592545eeef59aeab0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:12.030007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 839/1682] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:12.030963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a620-ffea-4dca-ab80-73a836ebc733 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:12.031154 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b06a8903-bf21-4506-aada-e5df842d33d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda66613edbf432592545eeef59aeab0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:12.032680 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b06a8903-bf21-4506-aada-e5df842d33d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda66613edbf432592545eeef59aeab0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:12.059680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a620-ffea-4dca-ab80-73a836ebc733 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:12.065457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099b60b-6f57-482b-8612-20ee5d2600c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:12.066147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099b60b-6f57-482b-8612-20ee5d2600c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:12.066464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099b60b-6f57-482b-8612-20ee5d2600c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:12.066751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099b60b-6f57-482b-8612-20ee5d2600c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:12.067490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099b60b-6f57-482b-8612-20ee5d2600c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:12.069101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099b60b-6f57-482b-8612-20ee5d2600c1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:12.071755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 844/1683] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:11 2022] DELETE /identity/v3/users/dda66613edbf432592545eeef59aeab0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:12.079449 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a475b-a612-4201-8886-cf5e941f3d88 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:12.079794 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a475b-a612-4201-8886-cf5e941f3d88 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:12.080726 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a475b-a612-4201-8886-cf5e941f3d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:12.095068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 840/1684] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:12.096820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099b60b-6f57-482b-8612-20ee5d2600c1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:12.107746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c099b60b-6f57-482b-8612-20ee5d2600c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:12.120380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d45a475b-a612-4201-8886-cf5e941f3d88 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:12.123894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d45a475b-a612-4201-8886-cf5e941f3d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:12.128561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099b60b-6f57-482b-8612-20ee5d2600c1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:12.248135 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91e9c6-428c-4c7d-b227-853158155f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:12.249053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91e9c6-428c-4c7d-b227-853158155f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:12.249339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91e9c6-428c-4c7d-b227-853158155f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:12.249634 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91e9c6-428c-4c7d-b227-853158155f83 admin admin] PATH_INFO: `/v3/projects/5d7f30eb1c7f422692df8657669c2984/users/3b3024894507499b9069b4d88cd48165/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:12.250687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:12.284507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 845/1685] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:12.285675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91e9c6-428c-4c7d-b227-853158155f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7f30eb1c7f422692df8657669c2984, user_id=3b3024894507499b9069b4d88cd48165, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:12.288419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91e9c6-428c-4c7d-b227-853158155f83 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:12.314756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 841/1686] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:12 2022] PUT /identity/v3/projects/5d7f30eb1c7f422692df8657669c2984/users/3b3024894507499b9069b4d88cd48165/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:12.318932 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a475b-a612-4201-8886-cf5e941f3d88 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:12.331903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a475b-a612-4201-8886-cf5e941f3d88 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:12.382379 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91e9c6-428c-4c7d-b227-853158155f83 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:12.385807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ce91e9c6-428c-4c7d-b227-853158155f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:12.447852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef383d-9c10-4c21-ade2-c4df57177cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:12.451461 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef383d-9c10-4c21-ade2-c4df57177cad admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:12.452705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef383d-9c10-4c21-ade2-c4df57177cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:12.453206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef383d-9c10-4c21-ade2-c4df57177cad admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:12.456392 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef383d-9c10-4c21-ade2-c4df57177cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:12.463315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef383d-9c10-4c21-ade2-c4df57177cad admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:12.507650 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 846/1687] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:12.509307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef383d-9c10-4c21-ade2-c4df57177cad admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:12.523728 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91e9c6-428c-4c7d-b227-853158155f83 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:12.524530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef383d-9c10-4c21-ade2-c4df57177cad admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:12.531279 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1c525-8fe9-4e22-9bf8-e0b98a397498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:12.532625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1c525-8fe9-4e22-9bf8-e0b98a397498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:12.533674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1c525-8fe9-4e22-9bf8-e0b98a397498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:12.534192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8bbb4-7a97-4fa8-87ae-a488ead01da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:12.534877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1c525-8fe9-4e22-9bf8-e0b98a397498 admin admin] PATH_INFO: `/v3/projects/5d7f30eb1c7f422692df8657669c2984/users/3b3024894507499b9069b4d88cd48165/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:12.536346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8bbb4-7a97-4fa8-87ae-a488ead01da0 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:12.537379 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8bbb4-7a97-4fa8-87ae-a488ead01da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:12.537769 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1c525-8fe9-4e22-9bf8-e0b98a397498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7f30eb1c7f422692df8657669c2984, user_id=3b3024894507499b9069b4d88cd48165, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:12.537945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8bbb4-7a97-4fa8-87ae-a488ead01da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:12.541912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1c525-8fe9-4e22-9bf8-e0b98a397498 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:12.572958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 847/1688] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:12 2022] PUT /identity/v3/projects/5d7f30eb1c7f422692df8657669c2984/users/3b3024894507499b9069b4d88cd48165/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:12.575520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105c4c-ee3f-4f8d-97fb-d00591ae3355 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:12.576053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105c4c-ee3f-4f8d-97fb-d00591ae3355 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:12.576626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3105c4c-ee3f-4f8d-97fb-d00591ae3355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:12.583748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8bbb4-7a97-4fa8-87ae-a488ead01da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:12.585329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8bbb4-7a97-4fa8-87ae-a488ead01da0 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:12.615572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 842/1689] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:12.617918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8bbb4-7a97-4fa8-87ae-a488ead01da0 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:12.619051 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0df8bbb4-7a97-4fa8-87ae-a488ead01da0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:12.638273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b3105c4c-ee3f-4f8d-97fb-d00591ae3355 None None] MFA Rules not processed for user `3b3024894507499b9069b4d88cd48165`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:12.640466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b3105c4c-ee3f-4f8d-97fb-d00591ae3355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:12.656040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8bbb4-7a97-4fa8-87ae-a488ead01da0 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:12.668982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:12.761127 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024446e-2c8e-4bee-b86d-319f44f917ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:12.762647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024446e-2c8e-4bee-b86d-319f44f917ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:12.763000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024446e-2c8e-4bee-b86d-319f44f917ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:12.763349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024446e-2c8e-4bee-b86d-319f44f917ac admin admin] PATH_INFO: `/v3/projects/46e2ed0e855d4cc684c3b218bd7d3fd4` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:12.764657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024446e-2c8e-4bee-b86d-319f44f917ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e2ed0e855d4cc684c3b218bd7d3fd4)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:12.766663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024446e-2c8e-4bee-b86d-319f44f917ac admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:12.824781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7024446e-2c8e-4bee-b86d-319f44f917ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e2ed0e855d4cc684c3b218bd7d3fd4', 'request_id': 'req-7024446e-2c8e-4bee-b86d-319f44f917ac'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:12.839315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 848/1690] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:12.854565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3105c4c-ee3f-4f8d-97fb-d00591ae3355 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:12.855003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7024446e-2c8e-4bee-b86d-319f44f917ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e2ed0e855d4cc684c3b218bd7d3fd4', 'request_id': 'req-7024446e-2c8e-4bee-b86d-319f44f917ac'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:12.858698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b3105c4c-ee3f-4f8d-97fb-d00591ae3355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:12.864042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7024446e-2c8e-4bee-b86d-319f44f917ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e2ed0e855d4cc684c3b218bd7d3fd4', 'request_id': 'req-7024446e-2c8e-4bee-b86d-319f44f917ac'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:12.876474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7024446e-2c8e-4bee-b86d-319f44f917ac admin admin] The token cache is being invalidate because project 46e2ed0e855d4cc684c3b218bd7d3fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:12.878065 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7024446e-2c8e-4bee-b86d-319f44f917ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:12.879782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7024446e-2c8e-4bee-b86d-319f44f917ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:12.881776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 843/1691] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:12 2022] DELETE /identity/v3/projects/46e2ed0e855d4cc684c3b218bd7d3fd4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:12.887021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acf425-3016-4078-99db-15d21eb680bb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:12.887487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acf425-3016-4078-99db-15d21eb680bb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:12.887855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acf425-3016-4078-99db-15d21eb680bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:12.943039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d0acf425-3016-4078-99db-15d21eb680bb None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:12.947316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d0acf425-3016-4078-99db-15d21eb680bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:13.002109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3105c4c-ee3f-4f8d-97fb-d00591ae3355 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:13.039197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:13.106289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 844/1692] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:13.110252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b81b-8591-4a67-a21b-613343ba0239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:13.112703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b81b-8591-4a67-a21b-613343ba0239 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:13.113885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b81b-8591-4a67-a21b-613343ba0239 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:13.114324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9cb33-b740-4e66-96ba-ce114b3616a5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:13.114784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9cb33-b740-4e66-96ba-ce114b3616a5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:13.115075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9cb33-b740-4e66-96ba-ce114b3616a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:13.115718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b81b-8591-4a67-a21b-613343ba0239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:13.119471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2c42b81b-8591-4a67-a21b-613343ba0239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:13.151159 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1fd9cb33-b740-4e66-96ba-ce114b3616a5 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:13.152406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1fd9cb33-b740-4e66-96ba-ce114b3616a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:13.172396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 845/1693] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:13.177792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9cb33-b740-4e66-96ba-ce114b3616a5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:13.197317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9cb33-b740-4e66-96ba-ce114b3616a5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:13.212094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9438324-224b-4987-8752-60cf9c155c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:13.212787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9438324-224b-4987-8752-60cf9c155c28 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:13.213071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9438324-224b-4987-8752-60cf9c155c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:13.213351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9438324-224b-4987-8752-60cf9c155c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:13.214199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9438324-224b-4987-8752-60cf9c155c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:13.214681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9438324-224b-4987-8752-60cf9c155c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:13.216274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9438324-224b-4987-8752-60cf9c155c28 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:13.244056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 846/1694] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:09:13.248672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9438324-224b-4987-8752-60cf9c155c28 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:13.272341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9438324-224b-4987-8752-60cf9c155c28 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:13.280096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857ef54-f499-41f4-84fd-8db49c3b458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:13.281411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857ef54-f499-41f4-84fd-8db49c3b458f admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:13.281719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857ef54-f499-41f4-84fd-8db49c3b458f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:13.282148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857ef54-f499-41f4-84fd-8db49c3b458f admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:13.284866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857ef54-f499-41f4-84fd-8db49c3b458f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:13.289726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857ef54-f499-41f4-84fd-8db49c3b458f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:13.293662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42b81b-8591-4a67-a21b-613343ba0239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:13.295832 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42b81b-8591-4a67-a21b-613343ba0239 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:13.317902 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:13.327015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 849/1695] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:13.341032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 847/1696] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:13 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:13.343706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b81b-8591-4a67-a21b-613343ba0239 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:13.363152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b81b-8591-4a67-a21b-613343ba0239 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:13.480890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abc6a5-b2d8-4915-9b2b-b1a72d91a271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:13.484047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abc6a5-b2d8-4915-9b2b-b1a72d91a271 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:13.484428 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abc6a5-b2d8-4915-9b2b-b1a72d91a271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:13.484726 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abc6a5-b2d8-4915-9b2b-b1a72d91a271 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:13.486885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abc6a5-b2d8-4915-9b2b-b1a72d91a271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:13.491839 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abc6a5-b2d8-4915-9b2b-b1a72d91a271 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:13.537673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 850/1697] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:13 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:13.542345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857ef54-f499-41f4-84fd-8db49c3b458f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:13.553418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abc6a5-b2d8-4915-9b2b-b1a72d91a271 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:13.570525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857ef54-f499-41f4-84fd-8db49c3b458f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:13.572068 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e0abc6a5-b2d8-4915-9b2b-b1a72d91a271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:13.614949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efac59f-bb0f-464f-a61a-903caf69114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:13.616444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efac59f-bb0f-464f-a61a-903caf69114a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:13.621290 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efac59f-bb0f-464f-a61a-903caf69114a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:13.623515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efac59f-bb0f-464f-a61a-903caf69114a admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:13.626538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efac59f-bb0f-464f-a61a-903caf69114a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:13.631396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efac59f-bb0f-464f-a61a-903caf69114a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:13.683785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 848/1698] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:13.687371 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efac59f-bb0f-464f-a61a-903caf69114a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:13.721654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efac59f-bb0f-464f-a61a-903caf69114a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:13.746793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162ddd9-599f-43a6-b7da-8f0d4da259d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:13.749130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162ddd9-599f-43a6-b7da-8f0d4da259d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:13.749423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162ddd9-599f-43a6-b7da-8f0d4da259d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:13.749705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162ddd9-599f-43a6-b7da-8f0d4da259d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:13.750477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162ddd9-599f-43a6-b7da-8f0d4da259d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:13.752190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162ddd9-599f-43a6-b7da-8f0d4da259d3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:13.798316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 849/1699] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:13.799806 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162ddd9-599f-43a6-b7da-8f0d4da259d3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:13.854922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abc6a5-b2d8-4915-9b2b-b1a72d91a271 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:13.864311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162ddd9-599f-43a6-b7da-8f0d4da259d3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:13.876603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9496d-2af8-4e43-a07e-d7a3acb26a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:13.877926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9496d-2af8-4e43-a07e-d7a3acb26a73 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:13.878240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9496d-2af8-4e43-a07e-d7a3acb26a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:13.881427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1c48f-18c1-43f1-a0e3-42b1ad4b6431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:13.882371 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1c48f-18c1-43f1-a0e3-42b1ad4b6431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:13.882676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1c48f-18c1-43f1-a0e3-42b1ad4b6431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:13.882960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1c48f-18c1-43f1-a0e3-42b1ad4b6431 admin admin] PATH_INFO: `/v3/projects/e15fe49fa1b247388842fb6772f0ebe1/users/3cbb551d0e5844b49bdd17170f9fed91/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:13.886150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9496d-2af8-4e43-a07e-d7a3acb26a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:13.890756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a6e9496d-2af8-4e43-a07e-d7a3acb26a73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:13.925323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1c48f-18c1-43f1-a0e3-42b1ad4b6431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15fe49fa1b247388842fb6772f0ebe1, user_id=3cbb551d0e5844b49bdd17170f9fed91, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:13.928495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1c48f-18c1-43f1-a0e3-42b1ad4b6431 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:13.936502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:13.957937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 850/1700] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:13 2022] PUT /identity/v3/projects/e15fe49fa1b247388842fb6772f0ebe1/users/3cbb551d0e5844b49bdd17170f9fed91/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:13.968688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b349f-86f9-4ea6-af3e-d2bb4367b875 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:13.969179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b349f-86f9-4ea6-af3e-d2bb4367b875 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:13.969655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b349f-86f9-4ea6-af3e-d2bb4367b875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.010933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-962b349f-86f9-4ea6-af3e-d2bb4367b875 None None] MFA Rules not processed for user `3cbb551d0e5844b49bdd17170f9fed91`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:14.014841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-962b349f-86f9-4ea6-af3e-d2bb4367b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:14.070282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9496d-2af8-4e43-a07e-d7a3acb26a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:14.077159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9496d-2af8-4e43-a07e-d7a3acb26a73 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:14.100038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 851/1701] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:14.102606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9496d-2af8-4e43-a07e-d7a3acb26a73 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:14.108983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a6e9496d-2af8-4e43-a07e-d7a3acb26a73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:14.141337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9496d-2af8-4e43-a07e-d7a3acb26a73 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:14.211405 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 851/1702] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:14.215523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b349f-86f9-4ea6-af3e-d2bb4367b875 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:14.370032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:14.375215 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:14.375576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:14.378395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] PATH_INFO: `/v3/projects/bdc2478d21e74f56b1975b69895d93d3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.379892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc2478d21e74f56b1975b69895d93d3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:14.382752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:14.412940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b349f-86f9-4ea6-af3e-d2bb4367b875 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:14.436589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c8ed1-d461-4d5d-b036-7f933998c852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:14.437251 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c8ed1-d461-4d5d-b036-7f933998c852 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:14.437542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c8ed1-d461-4d5d-b036-7f933998c852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:14.437819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c8ed1-d461-4d5d-b036-7f933998c852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.438547 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c8ed1-d461-4d5d-b036-7f933998c852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:14.451024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c8ed1-d461-4d5d-b036-7f933998c852 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:14.515266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 852/1703] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:14 2022] POST /identity/v3/projects => generated 379 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:09:14.516263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c8ed1-d461-4d5d-b036-7f933998c852 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:14.519472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc2478d21e74f56b1975b69895d93d3', 'request_id': 'req-3a9e095c-f4b6-454f-8b57-128efecddd59'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:14.532894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc2478d21e74f56b1975b69895d93d3', 'request_id': 'req-3a9e095c-f4b6-454f-8b57-128efecddd59'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:14.550446 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc2478d21e74f56b1975b69895d93d3', 'request_id': 'req-3a9e095c-f4b6-454f-8b57-128efecddd59'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:14.573506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] The token cache is being invalidate because project bdc2478d21e74f56b1975b69895d93d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:14.573848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:14.574551 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:14.576804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 852/1704] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:14 2022] DELETE /identity/v3/projects/bdc2478d21e74f56b1975b69895d93d3 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:14.580485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:14.582768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:14.600452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:14.689633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:14.691624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c8ed1-d461-4d5d-b036-7f933998c852 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:14.709513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd8a76-be85-4a0c-9c75-60dbc03cffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:14.710389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd8a76-be85-4a0c-9c75-60dbc03cffa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:14.710687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd8a76-be85-4a0c-9c75-60dbc03cffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:14.710972 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd8a76-be85-4a0c-9c75-60dbc03cffa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.711801 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd8a76-be85-4a0c-9c75-60dbc03cffa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:14.717515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd8a76-be85-4a0c-9c75-60dbc03cffa2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:14.722057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e095c-f4b6-454f-8b57-128efecddd59 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:14.729539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310bed4-0007-4bde-a677-659ebeadad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:14.730664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310bed4-0007-4bde-a677-659ebeadad1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:14.730955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310bed4-0007-4bde-a677-659ebeadad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:14.731238 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310bed4-0007-4bde-a677-659ebeadad1e admin admin] PATH_INFO: `/v3/users/e865eb548a4d447e9fa2461cddcd42f5` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.733415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310bed4-0007-4bde-a677-659ebeadad1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e865eb548a4d447e9fa2461cddcd42f5)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:14.735887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310bed4-0007-4bde-a677-659ebeadad1e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:14.765936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 853/1705] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:14 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:14.770168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd8a76-be85-4a0c-9c75-60dbc03cffa2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:14.775516 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-03bd8a76-be85-4a0c-9c75-60dbc03cffa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:14.803012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd8a76-be85-4a0c-9c75-60dbc03cffa2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:14.817976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8e891-241b-49a4-8f49-b84140833ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:14.818710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8e891-241b-49a4-8f49-b84140833ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:14.819225 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8e891-241b-49a4-8f49-b84140833ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:14.819516 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8e891-241b-49a4-8f49-b84140833ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.820592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8e891-241b-49a4-8f49-b84140833ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:14.822859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5310bed4-0007-4bde-a677-659ebeadad1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e865eb548a4d447e9fa2461cddcd42f5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:14.823302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8e891-241b-49a4-8f49-b84140833ecc admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:14.843970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5310bed4-0007-4bde-a677-659ebeadad1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e865eb548a4d447e9fa2461cddcd42f5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:14.847329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5310bed4-0007-4bde-a677-659ebeadad1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e865eb548a4d447e9fa2461cddcd42f5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:14.863932 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 854/1706] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:14.867840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8e891-241b-49a4-8f49-b84140833ecc admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:14.869630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5310bed4-0007-4bde-a677-659ebeadad1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e865eb548a4d447e9fa2461cddcd42f5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:14.871198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5310bed4-0007-4bde-a677-659ebeadad1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e865eb548a4d447e9fa2461cddcd42f5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:14.882791 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8e891-241b-49a4-8f49-b84140833ecc admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:14.897795 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807aaf7b-0dde-40e5-a29f-53a40fdf60ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:14.898826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aaf7b-0dde-40e5-a29f-53a40fdf60ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:14.899119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aaf7b-0dde-40e5-a29f-53a40fdf60ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:14.899398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aaf7b-0dde-40e5-a29f-53a40fdf60ca admin admin] PATH_INFO: `/v3/projects/36ecf2e52dbb4d92a56e680acfc2f45e/users/56d989a839f0414caf35ecfe6f3aff77/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.904267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 853/1707] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:14 2022] DELETE /identity/v3/users/e865eb548a4d447e9fa2461cddcd42f5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:14.955919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb81aee-c68b-48a1-b797-c29dbbdfa83b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:14.956353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb81aee-c68b-48a1-b797-c29dbbdfa83b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:14.956691 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb81aee-c68b-48a1-b797-c29dbbdfa83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.958301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807aaf7b-0dde-40e5-a29f-53a40fdf60ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ecf2e52dbb4d92a56e680acfc2f45e, user_id=56d989a839f0414caf35ecfe6f3aff77, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:14.961027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807aaf7b-0dde-40e5-a29f-53a40fdf60ca admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:14.993251 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 855/1708] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:14 2022] PUT /identity/v3/projects/36ecf2e52dbb4d92a56e680acfc2f45e/users/56d989a839f0414caf35ecfe6f3aff77/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:14.997461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807aaf7b-0dde-40e5-a29f-53a40fdf60ca admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:14.999752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-807aaf7b-0dde-40e5-a29f-53a40fdf60ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:15.005082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-1eb81aee-c68b-48a1-b797-c29dbbdfa83b None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:15.006321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1eb81aee-c68b-48a1-b797-c29dbbdfa83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:15.147866 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 854/1709] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:09:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:15.157269 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807aaf7b-0dde-40e5-a29f-53a40fdf60ca admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:15.170098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e56fd-d0b8-433c-9d0a-b94e60893d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:15.170903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e56fd-d0b8-433c-9d0a-b94e60893d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:15.171236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e56fd-d0b8-433c-9d0a-b94e60893d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:15.171524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e56fd-d0b8-433c-9d0a-b94e60893d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:15.180877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e56fd-d0b8-433c-9d0a-b94e60893d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:15.183466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e56fd-d0b8-433c-9d0a-b94e60893d52 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:15.213342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 856/1710] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:15.224088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb81aee-c68b-48a1-b797-c29dbbdfa83b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:15.254641 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb81aee-c68b-48a1-b797-c29dbbdfa83b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:15.265058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811f8db-227a-4c64-ac89-721210be639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:15.268611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811f8db-227a-4c64-ac89-721210be639a admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:15.269052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811f8db-227a-4c64-ac89-721210be639a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:15.270732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811f8db-227a-4c64-ac89-721210be639a admin admin] PATH_INFO: `/v3/projects/36ecf2e52dbb4d92a56e680acfc2f45e/users/56d989a839f0414caf35ecfe6f3aff77/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:15.277236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811f8db-227a-4c64-ac89-721210be639a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ecf2e52dbb4d92a56e680acfc2f45e, user_id=56d989a839f0414caf35ecfe6f3aff77, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:15.284027 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811f8db-227a-4c64-ac89-721210be639a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:15.342522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 855/1711] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:15 2022] PUT /identity/v3/projects/36ecf2e52dbb4d92a56e680acfc2f45e/users/56d989a839f0414caf35ecfe6f3aff77/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:15.343192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef051-e8e3-431e-8f9a-7caed22fea58 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:15.343504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef051-e8e3-431e-8f9a-7caed22fea58 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:15.343794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef051-e8e3-431e-8f9a-7caed22fea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:15.404767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1e7ef051-e8e3-431e-8f9a-7caed22fea58 None None] MFA Rules not processed for user `56d989a839f0414caf35ecfe6f3aff77`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:15.416133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1e7ef051-e8e3-431e-8f9a-7caed22fea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:15.435689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811f8db-227a-4c64-ac89-721210be639a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:15.439322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f811f8db-227a-4c64-ac89-721210be639a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:15.581087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:15.617149 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811f8db-227a-4c64-ac89-721210be639a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:15.622210 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 857/1712] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:15.630546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ef051-e8e3-431e-8f9a-7caed22fea58 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:15.631981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1e7ef051-e8e3-431e-8f9a-7caed22fea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:15.637609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:15.642487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895e724-306e-4cee-8bca-0f523a3ddf1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:15.643263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895e724-306e-4cee-8bca-0f523a3ddf1a service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:15.647087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895e724-306e-4cee-8bca-0f523a3ddf1a service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:15.647446 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895e724-306e-4cee-8bca-0f523a3ddf1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:15.763651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ef051-e8e3-431e-8f9a-7caed22fea58 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:15.774787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb912b4-19c5-4ed3-b647-2c7b55c0d79b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:15.775479 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb912b4-19c5-4ed3-b647-2c7b55c0d79b service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:15.775773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb912b4-19c5-4ed3-b647-2c7b55c0d79b service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:15.776061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb912b4-19c5-4ed3-b647-2c7b55c0d79b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:15.784245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-edb912b4-19c5-4ed3-b647-2c7b55c0d79b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:15.818760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895e724-306e-4cee-8bca-0f523a3ddf1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:15.820412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895e724-306e-4cee-8bca-0f523a3ddf1a service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:15.840958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 856/1713] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:09:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 17:09:15.968545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb912b4-19c5-4ed3-b647-2c7b55c0d79b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:15.974126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb912b4-19c5-4ed3-b647-2c7b55c0d79b service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:16.005187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 858/1714] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:18.171012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895e724-306e-4cee-8bca-0f523a3ddf1a service swift] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:18.172670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6895e724-306e-4cee-8bca-0f523a3ddf1a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:18.228932 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb912b4-19c5-4ed3-b647-2c7b55c0d79b service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:18.249961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb912b4-19c5-4ed3-b647-2c7b55c0d79b service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:18.269400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87dfb5-4c38-46e7-9392-5828c250128c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:18.270194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87dfb5-4c38-46e7-9392-5828c250128c service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:18.270514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87dfb5-4c38-46e7-9392-5828c250128c service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:18.279346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87dfb5-4c38-46e7-9392-5828c250128c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:18.339855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87dfb5-4c38-46e7-9392-5828c250128c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:18.344514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87dfb5-4c38-46e7-9392-5828c250128c service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:18.414620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 859/1715] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:18.440811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895e724-306e-4cee-8bca-0f523a3ddf1a service swift] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:18.467013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fa84a-07b1-4d0f-b296-f57374a83bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:18.467913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fa84a-07b1-4d0f-b296-f57374a83bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:18.468201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fa84a-07b1-4d0f-b296-f57374a83bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:18.468482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fa84a-07b1-4d0f-b296-f57374a83bf3 admin admin] PATH_INFO: `/v3/projects/312922aad11041fe8ffd0e759a0dd181` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:18.476384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fa84a-07b1-4d0f-b296-f57374a83bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=312922aad11041fe8ffd0e759a0dd181)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:18.478464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fa84a-07b1-4d0f-b296-f57374a83bf3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:18.720945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-406fa84a-07b1-4d0f-b296-f57374a83bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312922aad11041fe8ffd0e759a0dd181', 'request_id': 'req-406fa84a-07b1-4d0f-b296-f57374a83bf3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:18.758326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-406fa84a-07b1-4d0f-b296-f57374a83bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312922aad11041fe8ffd0e759a0dd181', 'request_id': 'req-406fa84a-07b1-4d0f-b296-f57374a83bf3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:18.774229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-406fa84a-07b1-4d0f-b296-f57374a83bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312922aad11041fe8ffd0e759a0dd181', 'request_id': 'req-406fa84a-07b1-4d0f-b296-f57374a83bf3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:18.805669 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-406fa84a-07b1-4d0f-b296-f57374a83bf3 admin admin] The token cache is being invalidate because project 312922aad11041fe8ffd0e759a0dd181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:18.806005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-406fa84a-07b1-4d0f-b296-f57374a83bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:18.808593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-406fa84a-07b1-4d0f-b296-f57374a83bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:18.817367 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 857/1716] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:18 2022] DELETE /identity/v3/projects/312922aad11041fe8ffd0e759a0dd181 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:18.818776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54743088-6521-44f7-ad93-1608c6b62a8d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:18.819140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54743088-6521-44f7-ad93-1608c6b62a8d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:18.819428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54743088-6521-44f7-ad93-1608c6b62a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:18.875416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-54743088-6521-44f7-ad93-1608c6b62a8d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:18.885267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-54743088-6521-44f7-ad93-1608c6b62a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:19.010248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a671c-90d9-4b7c-bdcb-0bdf9c56399e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:19.010855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a671c-90d9-4b7c-bdcb-0bdf9c56399e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:19.011366 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a671c-90d9-4b7c-bdcb-0bdf9c56399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:19.107226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5f4a671c-90d9-4b7c-bdcb-0bdf9c56399e None None] MFA Rules not processed for user `8903701eab424530ab822b7e9a1a9181`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:19.110706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5f4a671c-90d9-4b7c-bdcb-0bdf9c56399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:19.182644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:19.205282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 860/1717] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:19.215301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3fd59-14a8-41a0-a35c-574c7cdf1754 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:19.215640 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3fd59-14a8-41a0-a35c-574c7cdf1754 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:19.215974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3fd59-14a8-41a0-a35c-574c7cdf1754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:19.304267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-99a3fd59-14a8-41a0-a35c-574c7cdf1754 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:19.305609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-99a3fd59-14a8-41a0-a35c-574c7cdf1754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:19.340137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 861/1718] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:19.341082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3fd59-14a8-41a0-a35c-574c7cdf1754 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:19.372841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3fd59-14a8-41a0-a35c-574c7cdf1754 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:19.398744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97863b1-5964-49bb-85d0-8bed248482b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:19.399456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97863b1-5964-49bb-85d0-8bed248482b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:19.399688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97863b1-5964-49bb-85d0-8bed248482b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:19.399987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97863b1-5964-49bb-85d0-8bed248482b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:19.400674 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97863b1-5964-49bb-85d0-8bed248482b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:19.401042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97863b1-5964-49bb-85d0-8bed248482b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:19.402859 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97863b1-5964-49bb-85d0-8bed248482b3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:19.439705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 858/1719] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:19.442966 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73dee-3981-4e3b-9773-e2ebd6cd8b10 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:19.443393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73dee-3981-4e3b-9773-e2ebd6cd8b10 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:19.443544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73dee-3981-4e3b-9773-e2ebd6cd8b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:19.470541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 862/1720] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:09:19.471618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97863b1-5964-49bb-85d0-8bed248482b3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:19.512035 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a7e73dee-3981-4e3b-9773-e2ebd6cd8b10 None None] MFA Rules not processed for user `8903701eab424530ab822b7e9a1a9181`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:19.513367 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a7e73dee-3981-4e3b-9773-e2ebd6cd8b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:19.518495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97863b1-5964-49bb-85d0-8bed248482b3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:19.535048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4722a1-ab62-45e3-95e5-5114fe0539d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:19.535817 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4722a1-ab62-45e3-95e5-5114fe0539d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:19.536068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4722a1-ab62-45e3-95e5-5114fe0539d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:19.536354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4722a1-ab62-45e3-95e5-5114fe0539d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:19.537123 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4722a1-ab62-45e3-95e5-5114fe0539d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:19.539279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4722a1-ab62-45e3-95e5-5114fe0539d3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:19.557955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 859/1721] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:19.559972 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e73dee-3981-4e3b-9773-e2ebd6cd8b10 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:19.562970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a7e73dee-3981-4e3b-9773-e2ebd6cd8b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:19.652794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 863/1722] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:19 2022] POST /identity/v3/projects => generated 389 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:19.654124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4722a1-ab62-45e3-95e5-5114fe0539d3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:19.668517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:19.775742 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e73dee-3981-4e3b-9773-e2ebd6cd8b10 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:19.816704 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4722a1-ab62-45e3-95e5-5114fe0539d3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:19.823221 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628feec-bb01-4c56-9e6e-61f117d17c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:19.824283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628feec-bb01-4c56-9e6e-61f117d17c79 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:19.824899 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628feec-bb01-4c56-9e6e-61f117d17c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:19.825419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628feec-bb01-4c56-9e6e-61f117d17c79 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:19.826992 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628feec-bb01-4c56-9e6e-61f117d17c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:19.832763 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628feec-bb01-4c56-9e6e-61f117d17c79 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:19.879856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 864/1723] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:19 2022] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:19.883279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628feec-bb01-4c56-9e6e-61f117d17c79 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:19.922038 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628feec-bb01-4c56-9e6e-61f117d17c79 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:19.934327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af234152-c9f6-46a2-ad67-40dd51af9766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:19.936055 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bc809-400d-4ece-aa19-5bf4a74c69d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:19.936861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bc809-400d-4ece-aa19-5bf4a74c69d7 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:19.937043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bc809-400d-4ece-aa19-5bf4a74c69d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:19.937294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af234152-c9f6-46a2-ad67-40dd51af9766 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:19.937408 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bc809-400d-4ece-aa19-5bf4a74c69d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:19.939328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af234152-c9f6-46a2-ad67-40dd51af9766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:19.939939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af234152-c9f6-46a2-ad67-40dd51af9766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:19.940881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af234152-c9f6-46a2-ad67-40dd51af9766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:19.945435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af234152-c9f6-46a2-ad67-40dd51af9766 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:19.980673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 865/1724] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:19.988346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af234152-c9f6-46a2-ad67-40dd51af9766 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:20.040097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af234152-c9f6-46a2-ad67-40dd51af9766 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:20.058610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fd2d5-d210-4d3e-b11e-7da3d7751a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:20.059307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fd2d5-d210-4d3e-b11e-7da3d7751a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:20.059593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fd2d5-d210-4d3e-b11e-7da3d7751a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:20.062035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fd2d5-d210-4d3e-b11e-7da3d7751a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:20.066318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fd2d5-d210-4d3e-b11e-7da3d7751a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:20.069564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fd2d5-d210-4d3e-b11e-7da3d7751a2c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:20.100623 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:20.106473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 866/1725] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:20.128764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fd2d5-d210-4d3e-b11e-7da3d7751a2c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:20.153933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bc809-400d-4ece-aa19-5bf4a74c69d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:20.155863 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bc809-400d-4ece-aa19-5bf4a74c69d7 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:20.165875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fd2d5-d210-4d3e-b11e-7da3d7751a2c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:20.172930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 860/1726] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:20.196955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b44e28-026e-4149-b25b-8833a4bc77c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:20.198253 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b44e28-026e-4149-b25b-8833a4bc77c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:20.199491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b44e28-026e-4149-b25b-8833a4bc77c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:20.201356 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b44e28-026e-4149-b25b-8833a4bc77c7 admin admin] PATH_INFO: `/v3/projects/43185b67e0474865a7f0ea74f2ade3a7/users/f557413743be436ebfad5e737fb9ad7d/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:20.279013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b44e28-026e-4149-b25b-8833a4bc77c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43185b67e0474865a7f0ea74f2ade3a7, user_id=f557413743be436ebfad5e737fb9ad7d, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:20.291871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b44e28-026e-4149-b25b-8833a4bc77c7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:20.362387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 867/1727] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:20 2022] PUT /identity/v3/projects/43185b67e0474865a7f0ea74f2ade3a7/users/f557413743be436ebfad5e737fb9ad7d/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:20.365365 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e586-338a-4c78-b471-61360a5577ec None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:20.365800 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e586-338a-4c78-b471-61360a5577ec None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:20.367165 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e586-338a-4c78-b471-61360a5577ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:20.491959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2846e586-338a-4c78-b471-61360a5577ec None None] MFA Rules not processed for user `f557413743be436ebfad5e737fb9ad7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:20.493322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2846e586-338a-4c78-b471-61360a5577ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:20.797996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 861/1728] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:20.803391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b44e28-026e-4149-b25b-8833a4bc77c7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:21.132884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b44e28-026e-4149-b25b-8833a4bc77c7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:21.157060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82854cd7-3097-4df7-9b4a-979654a8aa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:21.160313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82854cd7-3097-4df7-9b4a-979654a8aa5d admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:21.160494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82854cd7-3097-4df7-9b4a-979654a8aa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:21.160761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82854cd7-3097-4df7-9b4a-979654a8aa5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:21.165899 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82854cd7-3097-4df7-9b4a-979654a8aa5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:21.174861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82854cd7-3097-4df7-9b4a-979654a8aa5d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:21.264265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 868/1729] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:20 2022] POST /identity/v3/projects => generated 387 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:21.265082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846e586-338a-4c78-b471-61360a5577ec None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:21.300082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846e586-338a-4c78-b471-61360a5577ec None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:21.637105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3108090-2d7c-4761-9ce0-3f36ad8d90d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:21.640487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3108090-2d7c-4761-9ce0-3f36ad8d90d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:21.641803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3108090-2d7c-4761-9ce0-3f36ad8d90d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:21.646512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3108090-2d7c-4761-9ce0-3f36ad8d90d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:21.648099 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3108090-2d7c-4761-9ce0-3f36ad8d90d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:21.658744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3108090-2d7c-4761-9ce0-3f36ad8d90d9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:21.769593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 862/1730] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:21 2022] POST /identity/v3/users => generated 300 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:21.776287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82854cd7-3097-4df7-9b4a-979654a8aa5d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:21.806047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82854cd7-3097-4df7-9b4a-979654a8aa5d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:21.828543 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881a03a-68bd-43c4-93c6-d1cdee541161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:21.829961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881a03a-68bd-43c4-93c6-d1cdee541161 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:21.830249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881a03a-68bd-43c4-93c6-d1cdee541161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:21.830565 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881a03a-68bd-43c4-93c6-d1cdee541161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:21.831609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881a03a-68bd-43c4-93c6-d1cdee541161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:21.833510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881a03a-68bd-43c4-93c6-d1cdee541161 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:21.910141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3108090-2d7c-4761-9ce0-3f36ad8d90d9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:21.911128 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 869/1731] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:21.943989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3108090-2d7c-4761-9ce0-3f36ad8d90d9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:21.972999 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe2dd4-0f6f-4db8-85ed-5954cb6242b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:21.977180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe2dd4-0f6f-4db8-85ed-5954cb6242b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:21.979143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe2dd4-0f6f-4db8-85ed-5954cb6242b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:21.980371 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe2dd4-0f6f-4db8-85ed-5954cb6242b9 admin admin] PATH_INFO: `/v3/projects/91b056d0c1e34239bde9273940174b41/users/bd022073840842ba85fdbe47909b996b/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:22.065777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe2dd4-0f6f-4db8-85ed-5954cb6242b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b056d0c1e34239bde9273940174b41, user_id=bd022073840842ba85fdbe47909b996b, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:22.069046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe2dd4-0f6f-4db8-85ed-5954cb6242b9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:22.115451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 863/1732] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:21 2022] PUT /identity/v3/projects/91b056d0c1e34239bde9273940174b41/users/bd022073840842ba85fdbe47909b996b/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:22.116758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881a03a-68bd-43c4-93c6-d1cdee541161 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:22.136164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881a03a-68bd-43c4-93c6-d1cdee541161 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:22.256790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:22.282024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f4b4-f874-4fb2-9c40-f049b0e0bd92 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:22.282347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f4b4-f874-4fb2-9c40-f049b0e0bd92 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:22.282786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f4b4-f874-4fb2-9c40-f049b0e0bd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:22.385282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-80b5f4b4-f874-4fb2-9c40-f049b0e0bd92 None None] MFA Rules not processed for user `e40620f994a84438be8274acfe3eb547`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:22.386687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-80b5f4b4-f874-4fb2-9c40-f049b0e0bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:22.438910 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a1a3a-b78f-42f1-babb-5b4d913dd183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:22.441521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a1a3a-b78f-42f1-babb-5b4d913dd183 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:22.443133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a1a3a-b78f-42f1-babb-5b4d913dd183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:22.443829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a1a3a-b78f-42f1-babb-5b4d913dd183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:22.447468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a1a3a-b78f-42f1-babb-5b4d913dd183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:22.450804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a1a3a-b78f-42f1-babb-5b4d913dd183 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:22.510558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 870/1733] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:22.511810 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a1a3a-b78f-42f1-babb-5b4d913dd183 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:22.527730 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:22.543868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a1a3a-b78f-42f1-babb-5b4d913dd183 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:22.562574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a8a3-d3cb-4225-a594-2cc76460d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:22.563499 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a8a3-d3cb-4225-a594-2cc76460d077 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:22.563791 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a8a3-d3cb-4225-a594-2cc76460d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:22.575098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a8a3-d3cb-4225-a594-2cc76460d077 admin admin] PATH_INFO: `/v3/projects/91b056d0c1e34239bde9273940174b41/users/bd022073840842ba85fdbe47909b996b/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:22.577720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4a8a3-d3cb-4225-a594-2cc76460d077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b056d0c1e34239bde9273940174b41, user_id=bd022073840842ba85fdbe47909b996b, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:22.592620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4a8a3-d3cb-4225-a594-2cc76460d077 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:22.646159 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 871/1734] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:22 2022] PUT /identity/v3/projects/91b056d0c1e34239bde9273940174b41/users/bd022073840842ba85fdbe47909b996b/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:22.657900 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f950a-0a28-4e1f-abec-571337e099d3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:22.659556 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f950a-0a28-4e1f-abec-571337e099d3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:22.660423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f950a-0a28-4e1f-abec-571337e099d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:22.704434 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 864/1735] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:22.736925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5f4b4-f874-4fb2-9c40-f049b0e0bd92 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:22.739023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-80b5f4b4-f874-4fb2-9c40-f049b0e0bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:22.824483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-aa8f950a-0a28-4e1f-abec-571337e099d3 None None] MFA Rules not processed for user `bd022073840842ba85fdbe47909b996b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:22.825822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-aa8f950a-0a28-4e1f-abec-571337e099d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:23.029407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5f4b4-f874-4fb2-9c40-f049b0e0bd92 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:23.094554 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 872/1736] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:23.096136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f950a-0a28-4e1f-abec-571337e099d3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:23.103667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-aa8f950a-0a28-4e1f-abec-571337e099d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:23.339558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ec8f5-f1a3-47a8-baac-0c1ea86b412f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:23.350834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ec8f5-f1a3-47a8-baac-0c1ea86b412f service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:23.357127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ec8f5-f1a3-47a8-baac-0c1ea86b412f service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:23.358594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ec8f5-f1a3-47a8-baac-0c1ea86b412f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:23.394080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f950a-0a28-4e1f-abec-571337e099d3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:23.453235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56a2b9-ac36-4d82-9ffe-a371201308ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:23.463349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56a2b9-ac36-4d82-9ffe-a371201308ff service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:23.464930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56a2b9-ac36-4d82-9ffe-a371201308ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:23.467299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56a2b9-ac36-4d82-9ffe-a371201308ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:23.563224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56a2b9-ac36-4d82-9ffe-a371201308ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:23.586132 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56a2b9-ac36-4d82-9ffe-a371201308ff service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:23.659443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 873/1737] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:24.130461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbf3f3-2d69-442d-8726-c796b2636964 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:24.131120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbf3f3-2d69-442d-8726-c796b2636964 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:24.131120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbf3f3-2d69-442d-8726-c796b2636964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:24.223792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ec8f5-f1a3-47a8-baac-0c1ea86b412f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:24.226273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ec8f5-f1a3-47a8-baac-0c1ea86b412f service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:24.247394 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 865/1738] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 1511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:24.248563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ec8f5-f1a3-47a8-baac-0c1ea86b412f service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:24.249333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-bddbf3f3-2d69-442d-8726-c796b2636964 None None] MFA Rules not processed for user `73bdfedb6d9e4ddab18a8143ba7142fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:24.250745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bddbf3f3-2d69-442d-8726-c796b2636964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:24.258942 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:24.451256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:24.525647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ec8f5-f1a3-47a8-baac-0c1ea86b412f service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:24.563065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:24.564166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:24.564559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:24.565085 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] PATH_INFO: `/v3/users/f557413743be436ebfad5e737fb9ad7d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:24.568955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f557413743be436ebfad5e737fb9ad7d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:24.585004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:24.588476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 874/1739] 10.222.0.39 () {58 vars in 1015 bytes} [Mon May 23 17:09:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:24.606903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd4ff4-b719-4a69-9888-7ca03a8bd76c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:24.608133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd4ff4-b719-4a69-9888-7ca03a8bd76c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:24.608818 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd4ff4-b719-4a69-9888-7ca03a8bd76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:24.726102 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-bfdd4ff4-b719-4a69-9888-7ca03a8bd76c None None] MFA Rules not processed for user `4ae911b452a04efe98022f47ae9dcbca`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:24.727370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bfdd4ff4-b719-4a69-9888-7ca03a8bd76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:24.732227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f557413743be436ebfad5e737fb9ad7d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:24.796437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f557413743be436ebfad5e737fb9ad7d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:24.800194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f557413743be436ebfad5e737fb9ad7d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:24.837570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f557413743be436ebfad5e737fb9ad7d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:24.840959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f557413743be436ebfad5e737fb9ad7d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:24.884372 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 866/1740] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:24 2022] DELETE /identity/v3/users/f557413743be436ebfad5e737fb9ad7d => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:24.885746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:24.887886 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:24.951084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 875/1741] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:24.951084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c993b-f826-4fc5-b5f2-9a585b916846 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:24.951084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c993b-f826-4fc5-b5f2-9a585b916846 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:24.951084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c993b-f826-4fc5-b5f2-9a585b916846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:25.036073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7a7c993b-f826-4fc5-b5f2-9a585b916846 None None] MFA Rules not processed for user `ed81799983c143eaa48a6a184c0eaf21`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:25.040081 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7a7c993b-f826-4fc5-b5f2-9a585b916846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:25.219967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27102f2a-acd6-45ba-9c63-93816d9a8e7a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:25.244990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:25.245910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:25.246195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:25.246522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] PATH_INFO: `/v3/users/3cbb551d0e5844b49bdd17170f9fed91` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:25.251120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbb551d0e5844b49bdd17170f9fed91)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:25.253467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:25.313222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 876/1742] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:25.323500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0709914-69c4-4e7c-bfea-686495527b2d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:25.334527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0709914-69c4-4e7c-bfea-686495527b2d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:25.334527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0709914-69c4-4e7c-bfea-686495527b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:25.446640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:25.479197 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c0709914-69c4-4e7c-bfea-686495527b2d None None] MFA Rules not processed for user `8903701eab424530ab822b7e9a1a9181`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:25.487919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c0709914-69c4-4e7c-bfea-686495527b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:25.579349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbb551d0e5844b49bdd17170f9fed91'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:25.685172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbb551d0e5844b49bdd17170f9fed91'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:25.696938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbb551d0e5844b49bdd17170f9fed91'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:25.725033 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbb551d0e5844b49bdd17170f9fed91'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:25.725923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbb551d0e5844b49bdd17170f9fed91'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:25.827280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 867/1743] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:24 2022] DELETE /identity/v3/users/3cbb551d0e5844b49bdd17170f9fed91 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:25.832799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:25.836149 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:25.844635 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 877/1744] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:25.844635 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb1083-eaba-40b0-bf6d-4f267f83077e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:25.846747 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb1083-eaba-40b0-bf6d-4f267f83077e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:25.847241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb1083-eaba-40b0-bf6d-4f267f83077e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:25.896942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:25.934640 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4ddb1083-eaba-40b0-bf6d-4f267f83077e None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:25.952179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4ddb1083-eaba-40b0-bf6d-4f267f83077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:26.110714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5031ab-d96a-4503-8a57-5b2a89a8af6b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:26.126262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ba699-f233-4ffe-ab7d-c7c07ddd338b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:26.127895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ba699-f233-4ffe-ab7d-c7c07ddd338b service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:26.128185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ba699-f233-4ffe-ab7d-c7c07ddd338b service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:26.128466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ba699-f233-4ffe-ab7d-c7c07ddd338b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:26.138240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-218ba699-f233-4ffe-ab7d-c7c07ddd338b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:26.170706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ba699-f233-4ffe-ab7d-c7c07ddd338b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:26.172083 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ba699-f233-4ffe-ab7d-c7c07ddd338b service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:26.197350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 868/1745] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:26.200736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ba699-f233-4ffe-ab7d-c7c07ddd338b service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:26.203502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-218ba699-f233-4ffe-ab7d-c7c07ddd338b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:26.269587 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 878/1746] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:26.273750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb1083-eaba-40b0-bf6d-4f267f83077e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:26.275830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4ddb1083-eaba-40b0-bf6d-4f267f83077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:26.458859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ba699-f233-4ffe-ab7d-c7c07ddd338b service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:26.486493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a1cb2-8690-41cc-8276-e48e59ccf698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:26.486493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a1cb2-8690-41cc-8276-e48e59ccf698 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:26.486493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a1cb2-8690-41cc-8276-e48e59ccf698 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:26.486493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a1cb2-8690-41cc-8276-e48e59ccf698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:26.488933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-211a1cb2-8690-41cc-8276-e48e59ccf698 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:26.644021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb1083-eaba-40b0-bf6d-4f267f83077e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:26.652553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:26.678467 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f2aac-aca7-477a-b3c1-1fae63c0e8b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:26.679664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f2aac-aca7-477a-b3c1-1fae63c0e8b7 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:26.688440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f2aac-aca7-477a-b3c1-1fae63c0e8b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:26.689718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f2aac-aca7-477a-b3c1-1fae63c0e8b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:26.695196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-538f2aac-aca7-477a-b3c1-1fae63c0e8b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:26.708775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a1cb2-8690-41cc-8276-e48e59ccf698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:26.712791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a1cb2-8690-41cc-8276-e48e59ccf698 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:26.759917 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 869/1747] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:26.763547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c2a61-92d3-4fdc-b08d-c4cae9b0bcff None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:26.763886 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c2a61-92d3-4fdc-b08d-c4cae9b0bcff None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:26.766056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c2a61-92d3-4fdc-b08d-c4cae9b0bcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:26.796001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6f7c2a61-92d3-4fdc-b08d-c4cae9b0bcff None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:26.797354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6f7c2a61-92d3-4fdc-b08d-c4cae9b0bcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:26.811320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 870/1748] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:26.811320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c2a61-92d3-4fdc-b08d-c4cae9b0bcff None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:26.812269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6f7c2a61-92d3-4fdc-b08d-c4cae9b0bcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:26.827796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c2a61-92d3-4fdc-b08d-c4cae9b0bcff None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:26.842666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:26.843757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:26.844475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:26.846077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] PATH_INFO: `/v3/users/3d3379580b184252bd9c8aedc24a1ffe` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:26.854377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3379580b184252bd9c8aedc24a1ffe)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:26.860804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:26.881680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f2aac-aca7-477a-b3c1-1fae63c0e8b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:26.886567 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f2aac-aca7-477a-b3c1-1fae63c0e8b7 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:26.930554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3379580b184252bd9c8aedc24a1ffe'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:26.949314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3379580b184252bd9c8aedc24a1ffe'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:26.950165 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3379580b184252bd9c8aedc24a1ffe'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:26.952854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 879/1749] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:26.954050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f2aac-aca7-477a-b3c1-1fae63c0e8b7 service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:26.972241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3379580b184252bd9c8aedc24a1ffe'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:26.972965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3379580b184252bd9c8aedc24a1ffe'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:27.004036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 871/1750] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:26 2022] DELETE /identity/v3/users/3d3379580b184252bd9c8aedc24a1ffe => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:27.006029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:27.008234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:27.009589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f2aac-aca7-477a-b3c1-1fae63c0e8b7 service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:27.129830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e40c1-89f9-4fa4-9274-8b7ee5d5eb70 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:27.144713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d23e19-8f83-47b2-9d3b-9ec07d76aaaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:27.146066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d23e19-8f83-47b2-9d3b-9ec07d76aaaf service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:27.146409 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d23e19-8f83-47b2-9d3b-9ec07d76aaaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:27.147007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d23e19-8f83-47b2-9d3b-9ec07d76aaaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:27.149730 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-46d23e19-8f83-47b2-9d3b-9ec07d76aaaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:27.157004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:27.185536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c513f9d-5ac4-44dc-a458-c3d2ba91f648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:27.187688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c513f9d-5ac4-44dc-a458-c3d2ba91f648 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:27.188628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c513f9d-5ac4-44dc-a458-c3d2ba91f648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:27.189850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c513f9d-5ac4-44dc-a458-c3d2ba91f648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:27.195421 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6c513f9d-5ac4-44dc-a458-c3d2ba91f648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:27.359415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d23e19-8f83-47b2-9d3b-9ec07d76aaaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:27.365503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d23e19-8f83-47b2-9d3b-9ec07d76aaaf service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:27.377912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:27.402457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 872/1751] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:27.405202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c513f9d-5ac4-44dc-a458-c3d2ba91f648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:27.406786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c513f9d-5ac4-44dc-a458-c3d2ba91f648 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:27.407412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e0c6c-a88f-4c41-88a8-f6423c95f126 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:27.409911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e0c6c-a88f-4c41-88a8-f6423c95f126 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:27.410309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e0c6c-a88f-4c41-88a8-f6423c95f126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:27.431819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 880/1752] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:27.472840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7d3e0c6c-a88f-4c41-88a8-f6423c95f126 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:27.477484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7d3e0c6c-a88f-4c41-88a8-f6423c95f126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:27.511888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 873/1753] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:27.560182 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c513f9d-5ac4-44dc-a458-c3d2ba91f648 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:27.561655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6c513f9d-5ac4-44dc-a458-c3d2ba91f648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:27.580813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c513f9d-5ac4-44dc-a458-c3d2ba91f648 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:27.589541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247420b-ff2f-4cd3-95f0-43a148739257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:27.592283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247420b-ff2f-4cd3-95f0-43a148739257 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:27.593030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247420b-ff2f-4cd3-95f0-43a148739257 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:27.593030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247420b-ff2f-4cd3-95f0-43a148739257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:27.619745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247420b-ff2f-4cd3-95f0-43a148739257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:27.621096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247420b-ff2f-4cd3-95f0-43a148739257 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:27.643837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 881/1754] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:28.945658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5fa7d-778f-4364-add6-c8b436a1ead8 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:28.946236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5fa7d-778f-4364-add6-c8b436a1ead8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:28.951653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5fa7d-778f-4364-add6-c8b436a1ead8 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:28.956059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 874/1755] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 23 17:09:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:29.048968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844bea-d1d3-46da-97ec-964b0679a69c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:29.049539 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844bea-d1d3-46da-97ec-964b0679a69c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:29.050000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844bea-d1d3-46da-97ec-964b0679a69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:29.118074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-bc844bea-d1d3-46da-97ec-964b0679a69c None None] MFA Rules not processed for user `9884780c88aa48ffa92a696740761387`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:29.119370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bc844bea-d1d3-46da-97ec-964b0679a69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:29.342699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 882/1756] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 23 17:09:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:29.426417 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5fa7d-778f-4364-add6-c8b436a1ead8 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:29.429051 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-58e5fa7d-778f-4364-add6-c8b436a1ead8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:29.496789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5fa7d-778f-4364-add6-c8b436a1ead8 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:29.538410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac14d24-f182-4452-874a-21ae2e5751ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:29.538410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac14d24-f182-4452-874a-21ae2e5751ec service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:29.538410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac14d24-f182-4452-874a-21ae2e5751ec service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:29.538677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac14d24-f182-4452-874a-21ae2e5751ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:29.573865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac14d24-f182-4452-874a-21ae2e5751ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:29.579865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac14d24-f182-4452-874a-21ae2e5751ec service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:29.621376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc844bea-d1d3-46da-97ec-964b0679a69c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:29.623548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bc844bea-d1d3-46da-97ec-964b0679a69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:29.634272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 875/1757] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:29.653662 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc844bea-d1d3-46da-97ec-964b0679a69c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:29.668414 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:29.669345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:29.669345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:29.673670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] PATH_INFO: `/v3/projects/7025c30b2aab4992b5965404ed2ab42e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:29.692742 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7025c30b2aab4992b5965404ed2ab42e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:29.698729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:29.707401 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac14d24-f182-4452-874a-21ae2e5751ec service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:29.709538 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5ac14d24-f182-4452-874a-21ae2e5751ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:29.757633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac14d24-f182-4452-874a-21ae2e5751ec service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:29.786178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:29.787147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:29.787420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:29.787702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] PATH_INFO: `/v3/projects/43185b67e0474865a7f0ea74f2ade3a7` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:29.790452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43185b67e0474865a7f0ea74f2ade3a7)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:29.803958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:29.959910 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7025c30b2aab4992b5965404ed2ab42e', 'request_id': 'req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:29.977768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7025c30b2aab4992b5965404ed2ab42e', 'request_id': 'req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:29.990798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7025c30b2aab4992b5965404ed2ab42e', 'request_id': 'req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:29.996818 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:30.005085 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43185b67e0474865a7f0ea74f2ade3a7', 'request_id': 'req-8bda7822-eff9-4267-9340-2fc0ac9d9159'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.014855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] The token cache is being invalidate because project 7025c30b2aab4992b5965404ed2ab42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:30.015320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.016080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43185b67e0474865a7f0ea74f2ade3a7', 'request_id': 'req-8bda7822-eff9-4267-9340-2fc0ac9d9159'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.016276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.021306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 883/1758] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:29 2022] DELETE /identity/v3/projects/7025c30b2aab4992b5965404ed2ab42e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:30.023188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:30.024403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43185b67e0474865a7f0ea74f2ade3a7', 'request_id': 'req-8bda7822-eff9-4267-9340-2fc0ac9d9159'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.024626 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:30.045864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] The token cache is being invalidate because project 43185b67e0474865a7f0ea74f2ade3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:30.046395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.051192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.060785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 876/1759] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:29 2022] DELETE /identity/v3/projects/43185b67e0474865a7f0ea74f2ade3a7 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:30.061191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:30.067281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:30.248329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef4e05-afe3-4c16-8f58-6bb7135077b6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:30.331924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda7822-eff9-4267-9340-2fc0ac9d9159 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:30.351179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:30.352628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:30.353022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:30.353311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] PATH_INFO: `/v3/users/bd022073840842ba85fdbe47909b996b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:30.358931 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd022073840842ba85fdbe47909b996b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:30.363732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:30.461256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:30.466432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:30.466715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:30.471027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] PATH_INFO: `/v3/users/3b3024894507499b9069b4d88cd48165` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:30.477357 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3024894507499b9069b4d88cd48165)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:30.493738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:30.503527 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd022073840842ba85fdbe47909b996b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.542206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd022073840842ba85fdbe47909b996b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.544985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd022073840842ba85fdbe47909b996b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.563512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:30.568167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd022073840842ba85fdbe47909b996b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.569996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd022073840842ba85fdbe47909b996b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.606935 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 877/1760] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:30 2022] DELETE /identity/v3/users/bd022073840842ba85fdbe47909b996b => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:30.740605 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3024894507499b9069b4d88cd48165'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.742787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3024894507499b9069b4d88cd48165'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.777296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3024894507499b9069b4d88cd48165'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.828282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3024894507499b9069b4d88cd48165'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.828282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3024894507499b9069b4d88cd48165'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:30.901720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 884/1761] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:30 2022] DELETE /identity/v3/users/3b3024894507499b9069b4d88cd48165 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:30.946920 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:30.949343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:31.278183 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5615921-36bf-4e2a-9b97-a90487d97782 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:31.591186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:31.592312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:31.592600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:31.592889 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] PATH_INFO: `/v3/projects/e15fe49fa1b247388842fb6772f0ebe1` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:31.597947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15fe49fa1b247388842fb6772f0ebe1)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:31.603988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:31.839223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15fe49fa1b247388842fb6772f0ebe1', 'request_id': 'req-3c771045-00e5-4156-bf97-dee943c768d6'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:31.865788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15fe49fa1b247388842fb6772f0ebe1', 'request_id': 'req-3c771045-00e5-4156-bf97-dee943c768d6'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:31.887816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15fe49fa1b247388842fb6772f0ebe1', 'request_id': 'req-3c771045-00e5-4156-bf97-dee943c768d6'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:31.933216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] The token cache is being invalidate because project e15fe49fa1b247388842fb6772f0ebe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:31.933629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:31.935842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:31.941328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 878/1762] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:30 2022] DELETE /identity/v3/projects/e15fe49fa1b247388842fb6772f0ebe1 => generated 0 bytes in 995 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:31.946502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:31.947592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:31.988901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3fce5-5a25-4175-abbc-f32c4e15ffca admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:32.094585 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:32.233485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df5aaf-9524-4721-9d73-5381518bd1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:32.234593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df5aaf-9524-4721-9d73-5381518bd1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:32.238474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df5aaf-9524-4721-9d73-5381518bd1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:32.238897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df5aaf-9524-4721-9d73-5381518bd1e3 admin admin] PATH_INFO: `/v3/users/56d989a839f0414caf35ecfe6f3aff77` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:32.242543 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df5aaf-9524-4721-9d73-5381518bd1e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d989a839f0414caf35ecfe6f3aff77)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:32.250891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df5aaf-9524-4721-9d73-5381518bd1e3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:32.406417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-50df5aaf-9524-4721-9d73-5381518bd1e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d989a839f0414caf35ecfe6f3aff77'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:32.408671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-50df5aaf-9524-4721-9d73-5381518bd1e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d989a839f0414caf35ecfe6f3aff77'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:32.437242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-50df5aaf-9524-4721-9d73-5381518bd1e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d989a839f0414caf35ecfe6f3aff77'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:32.470047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-50df5aaf-9524-4721-9d73-5381518bd1e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d989a839f0414caf35ecfe6f3aff77'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:32.471305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-50df5aaf-9524-4721-9d73-5381518bd1e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d989a839f0414caf35ecfe6f3aff77'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:32.582479 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 885/1763] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:31 2022] DELETE /identity/v3/users/56d989a839f0414caf35ecfe6f3aff77 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:32.958749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:32.960898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:32.989630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c771045-00e5-4156-bf97-dee943c768d6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:33.024104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:33.126876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:33.127861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:33.128144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:33.128419 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] PATH_INFO: `/v3/projects/5d7f30eb1c7f422692df8657669c2984` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:33.132133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7f30eb1c7f422692df8657669c2984)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:33.134188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:33.300496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7f30eb1c7f422692df8657669c2984', 'request_id': 'req-b275af96-78a6-4ff3-9819-b6f00606c200'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:33.324819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7f30eb1c7f422692df8657669c2984', 'request_id': 'req-b275af96-78a6-4ff3-9819-b6f00606c200'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:33.353466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7f30eb1c7f422692df8657669c2984', 'request_id': 'req-b275af96-78a6-4ff3-9819-b6f00606c200'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:33.378879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] The token cache is being invalidate because project 5d7f30eb1c7f422692df8657669c2984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:33.379621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:33.381019 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:33.394786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 879/1764] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:32 2022] DELETE /identity/v3/projects/5d7f30eb1c7f422692df8657669c2984 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:33.401853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7901a-0141-4078-adba-5c07df04c2c2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:33.402323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7901a-0141-4078-adba-5c07df04c2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:33.402446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7901a-0141-4078-adba-5c07df04c2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:33.439646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-73b7901a-0141-4078-adba-5c07df04c2c2 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:33.441025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-73b7901a-0141-4078-adba-5c07df04c2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:33.519235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:33.521797 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:33.610025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 886/1765] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:33.618184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29c505-133a-48d7-864f-79eed3d3001a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:33.618505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29c505-133a-48d7-864f-79eed3d3001a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:33.618790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29c505-133a-48d7-864f-79eed3d3001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:33.659450 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ba29c505-133a-48d7-864f-79eed3d3001a None None] MFA Rules not processed for user `e40620f994a84438be8274acfe3eb547`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:33.666574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ba29c505-133a-48d7-864f-79eed3d3001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:33.723075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275af96-78a6-4ff3-9819-b6f00606c200 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:33.738123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec19f75-f9fb-4ff8-a764-e2b796419ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:33.738923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec19f75-f9fb-4ff8-a764-e2b796419ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:33.739206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec19f75-f9fb-4ff8-a764-e2b796419ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:33.740135 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec19f75-f9fb-4ff8-a764-e2b796419ed8 admin admin] PATH_INFO: `/v3/projects/91b056d0c1e34239bde9273940174b41` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:33.740785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec19f75-f9fb-4ff8-a764-e2b796419ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b056d0c1e34239bde9273940174b41)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:33.742742 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec19f75-f9fb-4ff8-a764-e2b796419ed8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:33.759358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:33.815942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 887/1766] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:33.818126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17669caa-fa6c-4971-9a95-b91d270c933a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:33.819922 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17669caa-fa6c-4971-9a95-b91d270c933a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:33.821442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17669caa-fa6c-4971-9a95-b91d270c933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:33.852858 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-aec19f75-f9fb-4ff8-a764-e2b796419ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b056d0c1e34239bde9273940174b41', 'request_id': 'req-aec19f75-f9fb-4ff8-a764-e2b796419ed8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:33.854421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:33.855245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-17669caa-fa6c-4971-9a95-b91d270c933a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:33.858516 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-17669caa-fa6c-4971-9a95-b91d270c933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:33.868114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-aec19f75-f9fb-4ff8-a764-e2b796419ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b056d0c1e34239bde9273940174b41', 'request_id': 'req-aec19f75-f9fb-4ff8-a764-e2b796419ed8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:33.877216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-aec19f75-f9fb-4ff8-a764-e2b796419ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b056d0c1e34239bde9273940174b41', 'request_id': 'req-aec19f75-f9fb-4ff8-a764-e2b796419ed8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:33.900615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-aec19f75-f9fb-4ff8-a764-e2b796419ed8 admin admin] The token cache is being invalidate because project 91b056d0c1e34239bde9273940174b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:33.900906 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-aec19f75-f9fb-4ff8-a764-e2b796419ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:33.902876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-aec19f75-f9fb-4ff8-a764-e2b796419ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:33.907663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 880/1767] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:33 2022] DELETE /identity/v3/projects/91b056d0c1e34239bde9273940174b41 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:33.912645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf7cc-6bf5-4ac1-a78c-03b562cdc689 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:33.912778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf7cc-6bf5-4ac1-a78c-03b562cdc689 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:33.912963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf7cc-6bf5-4ac1-a78c-03b562cdc689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:33.973098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-21baf7cc-6bf5-4ac1-a78c-03b562cdc689 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:33.974333 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-21baf7cc-6bf5-4ac1-a78c-03b562cdc689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:33.990765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 888/1768] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:33.995292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17669caa-fa6c-4971-9a95-b91d270c933a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:34.002924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 881/1769] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:34.010830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1263fd-2b11-4178-81f0-83d3c6433886 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.011122 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1263fd-2b11-4178-81f0-83d3c6433886 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.011404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1263fd-2b11-4178-81f0-83d3c6433886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.017550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17669caa-fa6c-4971-9a95-b91d270c933a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:34.027896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895298-df50-45e7-aebe-82223774793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:34.028586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895298-df50-45e7-aebe-82223774793c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.028872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895298-df50-45e7-aebe-82223774793c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.029150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895298-df50-45e7-aebe-82223774793c admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.029885 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2895298-df50-45e7-aebe-82223774793c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:34.030193 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2895298-df50-45e7-aebe-82223774793c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:34.036266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2895298-df50-45e7-aebe-82223774793c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:34.047052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7b1263fd-2b11-4178-81f0-83d3c6433886 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:34.048918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7b1263fd-2b11-4178-81f0-83d3c6433886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:34.064930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 889/1770] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:09:34.065695 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895298-df50-45e7-aebe-82223774793c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:34.071293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 882/1771] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:34.075652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1263fd-2b11-4178-81f0-83d3c6433886 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:34.092632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895298-df50-45e7-aebe-82223774793c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:34.096226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1263fd-2b11-4178-81f0-83d3c6433886 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:34.102339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c32d3-50cc-40ba-9556-dc1ef897251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:34.106531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c32d3-50cc-40ba-9556-dc1ef897251f admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.107803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c32d3-50cc-40ba-9556-dc1ef897251f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.108096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c32d3-50cc-40ba-9556-dc1ef897251f admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.110077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c74a9-d9ad-4f44-8e51-7a46515d675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:34.111426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c74a9-d9ad-4f44-8e51-7a46515d675d admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.111716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c74a9-d9ad-4f44-8e51-7a46515d675d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.111994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c74a9-d9ad-4f44-8e51-7a46515d675d admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.112707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c74a9-d9ad-4f44-8e51-7a46515d675d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:34.113020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c74a9-d9ad-4f44-8e51-7a46515d675d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:34.114431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c32d3-50cc-40ba-9556-dc1ef897251f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:34.116301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c32d3-50cc-40ba-9556-dc1ef897251f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:34.120959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c74a9-d9ad-4f44-8e51-7a46515d675d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:34.161430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 883/1772] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:09:34.165178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c74a9-d9ad-4f44-8e51-7a46515d675d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:34.182661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c74a9-d9ad-4f44-8e51-7a46515d675d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:34.188118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0d353-036a-491b-ba5d-daf8ef2d83f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:34.190938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0d353-036a-491b-ba5d-daf8ef2d83f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.191553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0d353-036a-491b-ba5d-daf8ef2d83f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.191673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 890/1773] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:34 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:34.196146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0d353-036a-491b-ba5d-daf8ef2d83f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.197003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c32d3-50cc-40ba-9556-dc1ef897251f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:34.197622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0d353-036a-491b-ba5d-daf8ef2d83f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:34.202243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0d353-036a-491b-ba5d-daf8ef2d83f9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:34.260871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 884/1774] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:34 2022] POST /identity/v3/projects => generated 407 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:09:34.262257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0d353-036a-491b-ba5d-daf8ef2d83f9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:34.421957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c32d3-50cc-40ba-9556-dc1ef897251f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:34.429476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f044c42-55ce-459a-b562-763c402d12e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:34.430193 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f044c42-55ce-459a-b562-763c402d12e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.430647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f044c42-55ce-459a-b562-763c402d12e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.431382 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f044c42-55ce-459a-b562-763c402d12e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.432959 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f044c42-55ce-459a-b562-763c402d12e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:34.441885 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f044c42-55ce-459a-b562-763c402d12e7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:34.443611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0d353-036a-491b-ba5d-daf8ef2d83f9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:34.464503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d003d-ad2b-4277-9e31-ef0b516d2550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:34.465217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d003d-ad2b-4277-9e31-ef0b516d2550 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.465503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d003d-ad2b-4277-9e31-ef0b516d2550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.465782 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d003d-ad2b-4277-9e31-ef0b516d2550 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.466514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d003d-ad2b-4277-9e31-ef0b516d2550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:34.468501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d003d-ad2b-4277-9e31-ef0b516d2550 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:34.507352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 891/1775] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:34 2022] POST /identity/v3/users => generated 292 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:34.508350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f044c42-55ce-459a-b562-763c402d12e7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:34.523456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 885/1776] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:34 2022] POST /identity/v3/users => generated 304 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:34.526038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d003d-ad2b-4277-9e31-ef0b516d2550 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:34.531104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f044c42-55ce-459a-b562-763c402d12e7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:34.542188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d003d-ad2b-4277-9e31-ef0b516d2550 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:34.546503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3823e93-88f3-4014-b53d-f4beebe17a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:34.550439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3823e93-88f3-4014-b53d-f4beebe17a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.551650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3823e93-88f3-4014-b53d-f4beebe17a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.552296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3823e93-88f3-4014-b53d-f4beebe17a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.553322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3823e93-88f3-4014-b53d-f4beebe17a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:34.556219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec0fe0-e8d3-443c-9a1e-3cf3e919761c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:34.556384 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3823e93-88f3-4014-b53d-f4beebe17a89 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:34.556980 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec0fe0-e8d3-443c-9a1e-3cf3e919761c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.557266 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec0fe0-e8d3-443c-9a1e-3cf3e919761c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.557578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec0fe0-e8d3-443c-9a1e-3cf3e919761c admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.558396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec0fe0-e8d3-443c-9a1e-3cf3e919761c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:34.560183 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec0fe0-e8d3-443c-9a1e-3cf3e919761c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:34.580446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 892/1777] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:34.583808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 886/1778] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:34.587912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec0fe0-e8d3-443c-9a1e-3cf3e919761c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:34.591329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3823e93-88f3-4014-b53d-f4beebe17a89 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:34.604726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3823e93-88f3-4014-b53d-f4beebe17a89 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:34.608911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec0fe0-e8d3-443c-9a1e-3cf3e919761c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:34.613858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b83688-eb48-4d50-93cc-0c3612265286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:34.614983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b83688-eb48-4d50-93cc-0c3612265286 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.615864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b83688-eb48-4d50-93cc-0c3612265286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.616570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b83688-eb48-4d50-93cc-0c3612265286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.617940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b83688-eb48-4d50-93cc-0c3612265286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:34.620891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b83688-eb48-4d50-93cc-0c3612265286 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:34.624693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4ee92-8cf9-4ae6-a1b6-49b08763ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:34.625388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4ee92-8cf9-4ae6-a1b6-49b08763ae17 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.625678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4ee92-8cf9-4ae6-a1b6-49b08763ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.625950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4ee92-8cf9-4ae6-a1b6-49b08763ae17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.627354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4ee92-8cf9-4ae6-a1b6-49b08763ae17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:34.629025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4ee92-8cf9-4ae6-a1b6-49b08763ae17 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:34.639788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 893/1779] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:34.644462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b83688-eb48-4d50-93cc-0c3612265286 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:34.660385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 887/1780] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:34.669319 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4ee92-8cf9-4ae6-a1b6-49b08763ae17 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:34.681032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b83688-eb48-4d50-93cc-0c3612265286 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:34.696490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa65d6-908b-416e-ba85-7d56f3142df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:34.699391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa65d6-908b-416e-ba85-7d56f3142df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.700688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa65d6-908b-416e-ba85-7d56f3142df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.705541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa65d6-908b-416e-ba85-7d56f3142df8 admin admin] PATH_INFO: `/v3/projects/8deae58c4bcb4359808086704c9976c9/users/40f932ab52fc418ead4ea9e1705b509a/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.711060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4ee92-8cf9-4ae6-a1b6-49b08763ae17 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:34.728511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bea43-ac82-4d0b-b286-f381800100ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:34.729705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bea43-ac82-4d0b-b286-f381800100ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.729823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bea43-ac82-4d0b-b286-f381800100ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.730057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bea43-ac82-4d0b-b286-f381800100ea admin admin] PATH_INFO: `/v3/projects/afe1bef7457e40e192c1f5e2c9e35754/users/313fdf3bb46241c2851c5b95678024f6/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.750851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa65d6-908b-416e-ba85-7d56f3142df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8deae58c4bcb4359808086704c9976c9, user_id=40f932ab52fc418ead4ea9e1705b509a, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:34.760582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa65d6-908b-416e-ba85-7d56f3142df8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:34.770349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bea43-ac82-4d0b-b286-f381800100ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe1bef7457e40e192c1f5e2c9e35754, user_id=313fdf3bb46241c2851c5b95678024f6, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:34.771201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:34.775769 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bea43-ac82-4d0b-b286-f381800100ea admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:34.799930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 894/1781] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:34 2022] PUT /identity/v3/projects/8deae58c4bcb4359808086704c9976c9/users/40f932ab52fc418ead4ea9e1705b509a/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:34.814415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 888/1782] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:34 2022] PUT /identity/v3/projects/afe1bef7457e40e192c1f5e2c9e35754/users/313fdf3bb46241c2851c5b95678024f6/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:34.825067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947b4f0-d62e-4c8b-8a87-09839ead81c3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.825433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947b4f0-d62e-4c8b-8a87-09839ead81c3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.825823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947b4f0-d62e-4c8b-8a87-09839ead81c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.838611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ef669-9efc-4e73-98e5-4ae07febdf1d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:34.838924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ef669-9efc-4e73-98e5-4ae07febdf1d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:34.843207 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ef669-9efc-4e73-98e5-4ae07febdf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:34.895098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-353ef669-9efc-4e73-98e5-4ae07febdf1d None None] MFA Rules not processed for user `40f932ab52fc418ead4ea9e1705b509a`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:34.896159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e947b4f0-d62e-4c8b-8a87-09839ead81c3 None None] MFA Rules not processed for user `313fdf3bb46241c2851c5b95678024f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:34.897459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e947b4f0-d62e-4c8b-8a87-09839ead81c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:34.897664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-353ef669-9efc-4e73-98e5-4ae07febdf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:34.920880 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:34.987415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 889/1783] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:34.989873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947b4f0-d62e-4c8b-8a87-09839ead81c3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:35.024010 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 895/1784] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:35.029116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ef669-9efc-4e73-98e5-4ae07febdf1d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:35.192206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ef669-9efc-4e73-98e5-4ae07febdf1d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:35.207512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe554c-fb10-4013-adac-2d5495c5e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:35.211668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe554c-fb10-4013-adac-2d5495c5e862 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:35.211668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe554c-fb10-4013-adac-2d5495c5e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:35.211668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe554c-fb10-4013-adac-2d5495c5e862 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:35.213370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe554c-fb10-4013-adac-2d5495c5e862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:35.215910 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe554c-fb10-4013-adac-2d5495c5e862 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:35.222185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947b4f0-d62e-4c8b-8a87-09839ead81c3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:35.232788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde671d-0bda-46ae-b39a-758ce04d3066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:35.235228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde671d-0bda-46ae-b39a-758ce04d3066 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:35.236412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde671d-0bda-46ae-b39a-758ce04d3066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:35.236824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde671d-0bda-46ae-b39a-758ce04d3066 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:35.239090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde671d-0bda-46ae-b39a-758ce04d3066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:35.255688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde671d-0bda-46ae-b39a-758ce04d3066 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:35.293426 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 896/1785] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:35 2022] POST /identity/v3/projects => generated 383 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:35.294502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe554c-fb10-4013-adac-2d5495c5e862 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:35.299205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-70fe554c-fb10-4013-adac-2d5495c5e862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:35.311139 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 890/1786] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:34 2022] POST /identity/v3/projects => generated 409 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:35.314731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde671d-0bda-46ae-b39a-758ce04d3066 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:35.485255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde671d-0bda-46ae-b39a-758ce04d3066 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:35.491602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1bed8-edc4-41fb-8146-2dd66f69c54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:35.492509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1bed8-edc4-41fb-8146-2dd66f69c54a admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:35.492931 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1bed8-edc4-41fb-8146-2dd66f69c54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:35.493636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1bed8-edc4-41fb-8146-2dd66f69c54a admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:35.495780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1bed8-edc4-41fb-8146-2dd66f69c54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:35.498679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1bed8-edc4-41fb-8146-2dd66f69c54a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:35.511839 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe554c-fb10-4013-adac-2d5495c5e862 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:35.521409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:35.522593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:35.523038 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:35.523468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] PATH_INFO: `/v3/projects/36ecf2e52dbb4d92a56e680acfc2f45e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:35.527144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ecf2e52dbb4d92a56e680acfc2f45e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:35.529089 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:35.552295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:35.590399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 891/1787] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:35 2022] POST /identity/v3/users => generated 298 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:35.592084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1bed8-edc4-41fb-8146-2dd66f69c54a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:35.631419 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1bed8-edc4-41fb-8146-2dd66f69c54a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:35.633523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ecf2e52dbb4d92a56e680acfc2f45e', 'request_id': 'req-7416d204-ea8c-4799-a4db-73f72157fca5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:35.656567 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ecf2e52dbb4d92a56e680acfc2f45e', 'request_id': 'req-7416d204-ea8c-4799-a4db-73f72157fca5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:35.664976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ecf2e52dbb4d92a56e680acfc2f45e', 'request_id': 'req-7416d204-ea8c-4799-a4db-73f72157fca5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:35.696582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] The token cache is being invalidate because project 36ecf2e52dbb4d92a56e680acfc2f45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:35.697075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:35.697925 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:35.700947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 897/1788] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:35 2022] DELETE /identity/v3/projects/36ecf2e52dbb4d92a56e680acfc2f45e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:35.701073 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:35.702007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:35.705600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:35.785714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971cbb0-5e24-474f-a8e7-b11a55ef5d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:35.787002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971cbb0-5e24-474f-a8e7-b11a55ef5d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:35.788129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971cbb0-5e24-474f-a8e7-b11a55ef5d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:35.788862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971cbb0-5e24-474f-a8e7-b11a55ef5d12 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:35.789898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971cbb0-5e24-474f-a8e7-b11a55ef5d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:35.794638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971cbb0-5e24-474f-a8e7-b11a55ef5d12 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:35.839144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 892/1789] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:35 2022] POST /identity/v3/users => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:35.840446 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ea615-ab34-4499-b86a-4dad5feb714e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:35.841913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ea615-ab34-4499-b86a-4dad5feb714e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:35.842323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ea615-ab34-4499-b86a-4dad5feb714e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:35.876427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416d204-ea8c-4799-a4db-73f72157fca5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:35.884889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddd1ed-9ee5-45da-9f7e-897c8bae3d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:35.885881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddd1ed-9ee5-45da-9f7e-897c8bae3d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:35.885881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddd1ed-9ee5-45da-9f7e-897c8bae3d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:35.886129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddd1ed-9ee5-45da-9f7e-897c8bae3d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:35.886873 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddd1ed-9ee5-45da-9f7e-897c8bae3d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:35.888700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddd1ed-9ee5-45da-9f7e-897c8bae3d11 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:35.891273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-cf9ea615-ab34-4499-b86a-4dad5feb714e None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:35.892667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cf9ea615-ab34-4499-b86a-4dad5feb714e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:35.914822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 898/1790] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:35.915853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddd1ed-9ee5-45da-9f7e-897c8bae3d11 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:35.919936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-10ddd1ed-9ee5-45da-9f7e-897c8bae3d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:35.924666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 893/1791] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:35.925743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ea615-ab34-4499-b86a-4dad5feb714e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:35.954942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddd1ed-9ee5-45da-9f7e-897c8bae3d11 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:35.957229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ea615-ab34-4499-b86a-4dad5feb714e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:35.967178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8284e-3ec6-484e-8e2b-4dfb3057f429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:35.968126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8284e-3ec6-484e-8e2b-4dfb3057f429 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:35.968577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8284e-3ec6-484e-8e2b-4dfb3057f429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:35.969012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8284e-3ec6-484e-8e2b-4dfb3057f429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:35.970574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8284e-3ec6-484e-8e2b-4dfb3057f429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:35.971476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d66439-ac87-4201-9823-20e94a6453f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:35.972516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66439-ac87-4201-9823-20e94a6453f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:35.975085 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8284e-3ec6-484e-8e2b-4dfb3057f429 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:35.986724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66439-ac87-4201-9823-20e94a6453f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:35.987295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66439-ac87-4201-9823-20e94a6453f5 admin admin] PATH_INFO: `/v3/projects/7d4525e466274ba5bd0a2a3b53a3f0b9/users/bafab436abe14947a9f2d1f642c44e30/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.002736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 899/1792] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:36.004562 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e5a8c-f618-48d3-a38e-1cf44a44a4d8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.005240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e5a8c-f618-48d3-a38e-1cf44a44a4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.012785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e5a8c-f618-48d3-a38e-1cf44a44a4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.024793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d66439-ac87-4201-9823-20e94a6453f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4525e466274ba5bd0a2a3b53a3f0b9, user_id=bafab436abe14947a9f2d1f642c44e30, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:36.037402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d66439-ac87-4201-9823-20e94a6453f5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:36.055606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-683e5a8c-f618-48d3-a38e-1cf44a44a4d8 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:36.056849 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-683e5a8c-f618-48d3-a38e-1cf44a44a4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:36.074111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 894/1793] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:35 2022] PUT /identity/v3/projects/7d4525e466274ba5bd0a2a3b53a3f0b9/users/bafab436abe14947a9f2d1f642c44e30/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:36.075272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d66439-ac87-4201-9823-20e94a6453f5 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:36.185372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 900/1794] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:36.186263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e5a8c-f618-48d3-a38e-1cf44a44a4d8 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:36.205480 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e5a8c-f618-48d3-a38e-1cf44a44a4d8 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:36.218903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe10426-264e-4f69-b95d-568347d90383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:36.219591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe10426-264e-4f69-b95d-568347d90383 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.220710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe10426-264e-4f69-b95d-568347d90383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.220888 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe10426-264e-4f69-b95d-568347d90383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.221865 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe10426-264e-4f69-b95d-568347d90383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:36.225964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe10426-264e-4f69-b95d-568347d90383 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:36.247616 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 901/1795] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:36.248929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe10426-264e-4f69-b95d-568347d90383 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:36.258475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d66439-ac87-4201-9823-20e94a6453f5 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:36.267296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5e635-3ace-4411-838e-525691332f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:36.269923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe10426-264e-4f69-b95d-568347d90383 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:36.271296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5e635-3ace-4411-838e-525691332f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.271842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5e635-3ace-4411-838e-525691332f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.272530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5e635-3ace-4411-838e-525691332f1c admin admin] PATH_INFO: `/v3/projects/568c6a5f367442ba9bd21920286f1a78/users/34661b5cf11c4d7c88a4f58e29ea8e04/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.287749 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952ed62-a78e-4630-8d86-ff3c8f484edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:36.288601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952ed62-a78e-4630-8d86-ff3c8f484edd admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.289002 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952ed62-a78e-4630-8d86-ff3c8f484edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.289389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952ed62-a78e-4630-8d86-ff3c8f484edd admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.290248 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952ed62-a78e-4630-8d86-ff3c8f484edd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:36.290724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952ed62-a78e-4630-8d86-ff3c8f484edd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:36.293129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952ed62-a78e-4630-8d86-ff3c8f484edd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:36.308961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:36.314257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 902/1796] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:09:36.315501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952ed62-a78e-4630-8d86-ff3c8f484edd admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:36.323306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5e635-3ace-4411-838e-525691332f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=568c6a5f367442ba9bd21920286f1a78, user_id=34661b5cf11c4d7c88a4f58e29ea8e04, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:36.331087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952ed62-a78e-4630-8d86-ff3c8f484edd admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:36.334529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5e635-3ace-4411-838e-525691332f1c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:36.343011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a976ad-d67d-497c-94d2-7a6cf2fd4330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:36.345850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a976ad-d67d-497c-94d2-7a6cf2fd4330 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.346270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a976ad-d67d-497c-94d2-7a6cf2fd4330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.346881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a976ad-d67d-497c-94d2-7a6cf2fd4330 admin admin] PATH_INFO: `/v3/projects/7d4525e466274ba5bd0a2a3b53a3f0b9/users/bafab436abe14947a9f2d1f642c44e30/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.353300 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a976ad-d67d-497c-94d2-7a6cf2fd4330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4525e466274ba5bd0a2a3b53a3f0b9, user_id=bafab436abe14947a9f2d1f642c44e30, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:36.358095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a976ad-d67d-497c-94d2-7a6cf2fd4330 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:36.397826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 903/1797] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:36 2022] PUT /identity/v3/projects/7d4525e466274ba5bd0a2a3b53a3f0b9/users/bafab436abe14947a9f2d1f642c44e30/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:36.397826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a976ad-d67d-497c-94d2-7a6cf2fd4330 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:36.398171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 895/1798] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:36 2022] PUT /identity/v3/projects/568c6a5f367442ba9bd21920286f1a78/users/34661b5cf11c4d7c88a4f58e29ea8e04/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:36.404063 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5e635-3ace-4411-838e-525691332f1c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:36.522724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a976ad-d67d-497c-94d2-7a6cf2fd4330 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:36.535485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950708e8-ab15-4a53-9413-eba7b2a4e812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:36.536350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950708e8-ab15-4a53-9413-eba7b2a4e812 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.536750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950708e8-ab15-4a53-9413-eba7b2a4e812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.537165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950708e8-ab15-4a53-9413-eba7b2a4e812 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.537989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950708e8-ab15-4a53-9413-eba7b2a4e812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:36.540064 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950708e8-ab15-4a53-9413-eba7b2a4e812 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:36.579142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5e635-3ace-4411-838e-525691332f1c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:36.588301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41c7ee-3dfe-4d06-9c8c-ba40dfc7361b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:36.589567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41c7ee-3dfe-4d06-9c8c-ba40dfc7361b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.590137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41c7ee-3dfe-4d06-9c8c-ba40dfc7361b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.590601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41c7ee-3dfe-4d06-9c8c-ba40dfc7361b admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.591496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41c7ee-3dfe-4d06-9c8c-ba40dfc7361b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:36.593340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41c7ee-3dfe-4d06-9c8c-ba40dfc7361b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:36.620299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 904/1799] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:36 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:36.623183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dc077-33f5-43a3-ba3d-1e971a136939 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.623485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dc077-33f5-43a3-ba3d-1e971a136939 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.623772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dc077-33f5-43a3-ba3d-1e971a136939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.634387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 896/1800] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:36.635506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41c7ee-3dfe-4d06-9c8c-ba40dfc7361b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:36.656465 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41c7ee-3dfe-4d06-9c8c-ba40dfc7361b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:36.675411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a18dc077-33f5-43a3-ba3d-1e971a136939 None None] MFA Rules not processed for user `bafab436abe14947a9f2d1f642c44e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:36.678797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a18dc077-33f5-43a3-ba3d-1e971a136939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:36.688013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:36.835493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3eca9d-5da0-4e82-b5e6-dae8d2a1e22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:36.846762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3eca9d-5da0-4e82-b5e6-dae8d2a1e22c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.846762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3eca9d-5da0-4e82-b5e6-dae8d2a1e22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.846762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3eca9d-5da0-4e82-b5e6-dae8d2a1e22c admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.846762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3eca9d-5da0-4e82-b5e6-dae8d2a1e22c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:36.846762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3eca9d-5da0-4e82-b5e6-dae8d2a1e22c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:36.928828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 905/1801] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:36.930245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dc077-33f5-43a3-ba3d-1e971a136939 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:36.939093 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 897/1802] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:36 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:36.939093 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b875c5-7024-4d97-ba3e-f306137fbb9e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.939093 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b875c5-7024-4d97-ba3e-f306137fbb9e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.939093 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b875c5-7024-4d97-ba3e-f306137fbb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.959781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dc077-33f5-43a3-ba3d-1e971a136939 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:36.970579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282fcf5-8932-4df4-9cb0-49587e22903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:36.974687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282fcf5-8932-4df4-9cb0-49587e22903b admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.975016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282fcf5-8932-4df4-9cb0-49587e22903b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.975307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282fcf5-8932-4df4-9cb0-49587e22903b admin admin] PATH_INFO: `/v3/projects/568c6a5f367442ba9bd21920286f1a78/users/34661b5cf11c4d7c88a4f58e29ea8e04/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.979930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282fcf5-8932-4df4-9cb0-49587e22903b admin admin] RBAC: Authorizing `identity:create_grant(project_id=568c6a5f367442ba9bd21920286f1a78, user_id=34661b5cf11c4d7c88a4f58e29ea8e04, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:36.981538 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-03b875c5-7024-4d97-ba3e-f306137fbb9e None None] MFA Rules not processed for user `4ae911b452a04efe98022f47ae9dcbca`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:36.984617 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-03b875c5-7024-4d97-ba3e-f306137fbb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:36.987114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282fcf5-8932-4df4-9cb0-49587e22903b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:37.008752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 906/1803] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:36 2022] PUT /identity/v3/projects/568c6a5f367442ba9bd21920286f1a78/users/34661b5cf11c4d7c88a4f58e29ea8e04/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:37.010105 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282fcf5-8932-4df4-9cb0-49587e22903b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:37.118886 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:37.149816 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282fcf5-8932-4df4-9cb0-49587e22903b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:37.154856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727f9fb-2b30-435a-9fe1-11bd5a528a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:37.165023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f9fb-2b30-435a-9fe1-11bd5a528a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:37.165501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f9fb-2b30-435a-9fe1-11bd5a528a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:37.165887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f9fb-2b30-435a-9fe1-11bd5a528a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:37.166897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727f9fb-2b30-435a-9fe1-11bd5a528a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:37.168598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727f9fb-2b30-435a-9fe1-11bd5a528a36 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:37.185481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 907/1804] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:37.185481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727f9fb-2b30-435a-9fe1-11bd5a528a36 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:37.186674 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6727f9fb-2b30-435a-9fe1-11bd5a528a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:37.203484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 898/1805] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:37.214959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b748340-1877-47fd-a8b2-17766de3827c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:37.216106 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b748340-1877-47fd-a8b2-17766de3827c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:37.216659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b748340-1877-47fd-a8b2-17766de3827c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:37.271514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727f9fb-2b30-435a-9fe1-11bd5a528a36 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:37.275657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b86e70-7c6e-456f-8e2a-b6ef0bc85aa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:37.276662 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b86e70-7c6e-456f-8e2a-b6ef0bc85aa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:37.276776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b86e70-7c6e-456f-8e2a-b6ef0bc85aa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:37.277007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b86e70-7c6e-456f-8e2a-b6ef0bc85aa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:37.281354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e7b86e70-7c6e-456f-8e2a-b6ef0bc85aa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:37.339829 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0b748340-1877-47fd-a8b2-17766de3827c None None] MFA Rules not processed for user `34661b5cf11c4d7c88a4f58e29ea8e04`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:37.343487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0b748340-1877-47fd-a8b2-17766de3827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:37.410172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b86e70-7c6e-456f-8e2a-b6ef0bc85aa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:37.411952 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b86e70-7c6e-456f-8e2a-b6ef0bc85aa1 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:37.434433 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 908/1806] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:37.435473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b86e70-7c6e-456f-8e2a-b6ef0bc85aa1 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:37.476212 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b86e70-7c6e-456f-8e2a-b6ef0bc85aa1 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:37.483569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa11190-f0f5-4bed-84b5-92ccd00eced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:37.484799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa11190-f0f5-4bed-84b5-92ccd00eced5 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:37.486062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa11190-f0f5-4bed-84b5-92ccd00eced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:37.486611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa11190-f0f5-4bed-84b5-92ccd00eced5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:37.487599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa11190-f0f5-4bed-84b5-92ccd00eced5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:37.489465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa11190-f0f5-4bed-84b5-92ccd00eced5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:37.502995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 909/1807] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:37.506948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa11190-f0f5-4bed-84b5-92ccd00eced5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:37.543396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa11190-f0f5-4bed-84b5-92ccd00eced5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:37.550785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded8389-311b-4022-9ccf-a65cbdbeb79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:37.557549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded8389-311b-4022-9ccf-a65cbdbeb79f admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:37.558593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded8389-311b-4022-9ccf-a65cbdbeb79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:37.558904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded8389-311b-4022-9ccf-a65cbdbeb79f admin admin] PATH_INFO: `/v3/projects/0c10e2c86ae240658765606155f3e1ac/users/e95174c31cb14088bb45ac8fbb48e3a9/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:37.594637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded8389-311b-4022-9ccf-a65cbdbeb79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c10e2c86ae240658765606155f3e1ac, user_id=e95174c31cb14088bb45ac8fbb48e3a9, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:37.601870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded8389-311b-4022-9ccf-a65cbdbeb79f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:37.626473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 910/1808] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:37 2022] PUT /identity/v3/projects/0c10e2c86ae240658765606155f3e1ac/users/e95174c31cb14088bb45ac8fbb48e3a9/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:37.638864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f1d8d-5a54-4503-bf71-c890be98d311 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:37.639168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f1d8d-5a54-4503-bf71-c890be98d311 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:37.639500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f1d8d-5a54-4503-bf71-c890be98d311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:37.694397 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c68f1d8d-5a54-4503-bf71-c890be98d311 None None] MFA Rules not processed for user `e95174c31cb14088bb45ac8fbb48e3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:37.695485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c68f1d8d-5a54-4503-bf71-c890be98d311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:37.736184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 899/1809] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:37 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:37.749147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b748340-1877-47fd-a8b2-17766de3827c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:37.775651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b748340-1877-47fd-a8b2-17766de3827c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:37.817688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:37.881400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 911/1810] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:37.886874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f1d8d-5a54-4503-bf71-c890be98d311 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:37.890469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:37.961507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcb2e4-dd04-47e9-880f-9c0db78b4124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:37.971295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcb2e4-dd04-47e9-880f-9c0db78b4124 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:37.971816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcb2e4-dd04-47e9-880f-9c0db78b4124 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:37.972277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcb2e4-dd04-47e9-880f-9c0db78b4124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:38.103278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f1d8d-5a54-4503-bf71-c890be98d311 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:38.121287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe65fb2-9ba2-447d-b96e-ff044260f3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:38.124276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe65fb2-9ba2-447d-b96e-ff044260f3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:38.124693 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe65fb2-9ba2-447d-b96e-ff044260f3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:38.125375 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe65fb2-9ba2-447d-b96e-ff044260f3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:38.127190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe65fb2-9ba2-447d-b96e-ff044260f3d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:38.132343 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe65fb2-9ba2-447d-b96e-ff044260f3d5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:38.184622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dcb2e4-dd04-47e9-880f-9c0db78b4124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:38.186719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dcb2e4-dd04-47e9-880f-9c0db78b4124 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:38.213625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 900/1811] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:38.218351 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fca64-0e14-4fb5-96f4-21dcd72911a2 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:38.218351 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fca64-0e14-4fb5-96f4-21dcd72911a2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:38.218351 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fca64-0e14-4fb5-96f4-21dcd72911a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:38.218713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 912/1812] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:37 2022] POST /identity/v3/projects => generated 385 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:38.219935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c00b9-810e-4a9a-9e69-7e1a21367060 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:38.220488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c00b9-810e-4a9a-9e69-7e1a21367060 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:38.221392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c00b9-810e-4a9a-9e69-7e1a21367060 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:38.224733 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 913/1813] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 23 17:09:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:38.226971 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c00b9-810e-4a9a-9e69-7e1a21367060 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:38.265321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ac4fca64-0e14-4fb5-96f4-21dcd72911a2 None None] MFA Rules not processed for user `ed81799983c143eaa48a6a184c0eaf21`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:38.270145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ac4fca64-0e14-4fb5-96f4-21dcd72911a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:38.403648 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c00b9-810e-4a9a-9e69-7e1a21367060 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:38.417985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcce522-94a7-43fd-ba52-9143d05bd0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:38.417985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcce522-94a7-43fd-ba52-9143d05bd0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:38.417985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcce522-94a7-43fd-ba52-9143d05bd0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:38.417985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcce522-94a7-43fd-ba52-9143d05bd0a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:38.418404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcce522-94a7-43fd-ba52-9143d05bd0a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:38.418493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 901/1814] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:38.419663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43536-c079-4f2f-a0ca-49cc1e1e3ea1 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:38.420021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43536-c079-4f2f-a0ca-49cc1e1e3ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:38.420376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43536-c079-4f2f-a0ca-49cc1e1e3ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:38.422750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcce522-94a7-43fd-ba52-9143d05bd0a5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:38.458646 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-bfb43536-c079-4f2f-a0ca-49cc1e1e3ea1 None None] MFA Rules not processed for user `9884780c88aa48ffa92a696740761387`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:38.468308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bfb43536-c079-4f2f-a0ca-49cc1e1e3ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:38.472071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 914/1815] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:38 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:38.473456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcce522-94a7-43fd-ba52-9143d05bd0a5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:38.498143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcce522-94a7-43fd-ba52-9143d05bd0a5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:38.511267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f730-dd1b-4236-ab0e-cfec4d597198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:38.512833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f730-dd1b-4236-ab0e-cfec4d597198 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:38.513905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f730-dd1b-4236-ab0e-cfec4d597198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:38.515407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f730-dd1b-4236-ab0e-cfec4d597198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:38.516273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2f730-dd1b-4236-ab0e-cfec4d597198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:38.521177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2f730-dd1b-4236-ab0e-cfec4d597198 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:38.551181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 915/1816] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:38.552401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f730-dd1b-4236-ab0e-cfec4d597198 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:38.574346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f730-dd1b-4236-ab0e-cfec4d597198 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:38.587374 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9dc40-415e-4f0e-a691-3ff5a2c93b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:38.588588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9dc40-415e-4f0e-a691-3ff5a2c93b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:38.590163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9dc40-415e-4f0e-a691-3ff5a2c93b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:38.590557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9dc40-415e-4f0e-a691-3ff5a2c93b23 admin admin] PATH_INFO: `/v3/projects/8be914b36e2c47519749801835a8eb3c/users/2f77e931f0604d53ab411f0fc97bda4c/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:38.637448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9dc40-415e-4f0e-a691-3ff5a2c93b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be914b36e2c47519749801835a8eb3c, user_id=2f77e931f0604d53ab411f0fc97bda4c, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:38.640299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9dc40-415e-4f0e-a691-3ff5a2c93b23 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:38.653231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 902/1817] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 23 17:09:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:38.673772 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb43536-c079-4f2f-a0ca-49cc1e1e3ea1 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:38.675382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bfb43536-c079-4f2f-a0ca-49cc1e1e3ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:38.692706 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 916/1818] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:38 2022] PUT /identity/v3/projects/8be914b36e2c47519749801835a8eb3c/users/2f77e931f0604d53ab411f0fc97bda4c/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:38.698285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9dc40-415e-4f0e-a691-3ff5a2c93b23 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:38.734452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:38.779927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:38.820599 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb43536-c079-4f2f-a0ca-49cc1e1e3ea1 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:38.847039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9dc40-415e-4f0e-a691-3ff5a2c93b23 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:38.866047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a3b5a-165f-4b80-8cd7-3f919d5237d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:38.866925 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a3b5a-165f-4b80-8cd7-3f919d5237d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:38.867220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a3b5a-165f-4b80-8cd7-3f919d5237d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:38.867502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a3b5a-165f-4b80-8cd7-3f919d5237d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:38.868270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a3b5a-165f-4b80-8cd7-3f919d5237d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:38.869948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a3b5a-165f-4b80-8cd7-3f919d5237d7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:38.893833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 917/1819] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:38.895166 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a3b5a-165f-4b80-8cd7-3f919d5237d7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:38.914276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a3b5a-165f-4b80-8cd7-3f919d5237d7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:38.925782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20c9fe-29bf-4389-b526-077924046490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:38.926718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20c9fe-29bf-4389-b526-077924046490 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:38.927008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20c9fe-29bf-4389-b526-077924046490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:38.927289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20c9fe-29bf-4389-b526-077924046490 admin admin] PATH_INFO: `/v3/projects/8be914b36e2c47519749801835a8eb3c/users/2f77e931f0604d53ab411f0fc97bda4c/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:38.930316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20c9fe-29bf-4389-b526-077924046490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be914b36e2c47519749801835a8eb3c, user_id=2f77e931f0604d53ab411f0fc97bda4c, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:38.933010 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20c9fe-29bf-4389-b526-077924046490 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:38.936007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca0f90-212d-44df-bb9a-d378f3dacaa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:38.936674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca0f90-212d-44df-bb9a-d378f3dacaa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:38.936961 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca0f90-212d-44df-bb9a-d378f3dacaa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:38.937240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca0f90-212d-44df-bb9a-d378f3dacaa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:38.939508 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ebca0f90-212d-44df-bb9a-d378f3dacaa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:38.960415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 918/1820] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:38 2022] PUT /identity/v3/projects/8be914b36e2c47519749801835a8eb3c/users/2f77e931f0604d53ab411f0fc97bda4c/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:38.972417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e017ebe-6298-4e8c-82eb-67daf0b595a0 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:38.972621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e017ebe-6298-4e8c-82eb-67daf0b595a0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:38.972912 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e017ebe-6298-4e8c-82eb-67daf0b595a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:39.024818 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2e017ebe-6298-4e8c-82eb-67daf0b595a0 None None] MFA Rules not processed for user `2f77e931f0604d53ab411f0fc97bda4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:39.027415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2e017ebe-6298-4e8c-82eb-67daf0b595a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:39.073777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca0f90-212d-44df-bb9a-d378f3dacaa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:39.078207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca0f90-212d-44df-bb9a-d378f3dacaa4 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:39.103322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 903/1821] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:39.153606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 919/1822] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:39.166409 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca0f90-212d-44df-bb9a-d378f3dacaa4 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:39.182193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca0f90-212d-44df-bb9a-d378f3dacaa4 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:39.324837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7138524-1b98-4ede-96e6-28077ac4fec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:39.326481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7138524-1b98-4ede-96e6-28077ac4fec9 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:39.327924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7138524-1b98-4ede-96e6-28077ac4fec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:39.328712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7138524-1b98-4ede-96e6-28077ac4fec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:39.363198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7138524-1b98-4ede-96e6-28077ac4fec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:39.366434 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7138524-1b98-4ede-96e6-28077ac4fec9 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:39.400193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 904/1823] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:39.599206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e017ebe-6298-4e8c-82eb-67daf0b595a0 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:39.799239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e017ebe-6298-4e8c-82eb-67daf0b595a0 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:39.827347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c917474-da00-4e5f-bb6a-e19f00e4873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:39.831233 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c917474-da00-4e5f-bb6a-e19f00e4873d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:39.835391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c917474-da00-4e5f-bb6a-e19f00e4873d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:39.835707 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c917474-da00-4e5f-bb6a-e19f00e4873d admin admin] PATH_INFO: `/v3/users/e95174c31cb14088bb45ac8fbb48e3a9` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:39.847287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c917474-da00-4e5f-bb6a-e19f00e4873d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95174c31cb14088bb45ac8fbb48e3a9)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:39.851039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c917474-da00-4e5f-bb6a-e19f00e4873d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:39.880722 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37b9dc-d71b-4068-ba27-396f24a38372 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:39.881031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37b9dc-d71b-4068-ba27-396f24a38372 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:39.881300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37b9dc-d71b-4068-ba27-396f24a38372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:39.938486 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2f37b9dc-d71b-4068-ba27-396f24a38372 None None] MFA Rules not processed for user `73bdfedb6d9e4ddab18a8143ba7142fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:39.942562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2f37b9dc-d71b-4068-ba27-396f24a38372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:40.012278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:40.024882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:40.041368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2c917474-da00-4e5f-bb6a-e19f00e4873d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95174c31cb14088bb45ac8fbb48e3a9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:40.042945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2c917474-da00-4e5f-bb6a-e19f00e4873d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95174c31cb14088bb45ac8fbb48e3a9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:40.065035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2c917474-da00-4e5f-bb6a-e19f00e4873d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95174c31cb14088bb45ac8fbb48e3a9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:40.074116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 905/1824] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:09:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:40.094656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2c917474-da00-4e5f-bb6a-e19f00e4873d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95174c31cb14088bb45ac8fbb48e3a9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:40.097407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2c917474-da00-4e5f-bb6a-e19f00e4873d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95174c31cb14088bb45ac8fbb48e3a9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:40.143814 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37b9dc-d71b-4068-ba27-396f24a38372 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:40.145610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2f37b9dc-d71b-4068-ba27-396f24a38372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:40.162538 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37b9dc-d71b-4068-ba27-396f24a38372 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:40.163845 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 920/1825] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:39 2022] DELETE /identity/v3/users/e95174c31cb14088bb45ac8fbb48e3a9 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:40.167247 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c614-c32e-41e8-8daa-8702c55319e7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:40.167432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c614-c32e-41e8-8daa-8702c55319e7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:40.169381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c614-c32e-41e8-8daa-8702c55319e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:40.268111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a956c614-c32e-41e8-8daa-8702c55319e7 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:40.269385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a956c614-c32e-41e8-8daa-8702c55319e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:40.304056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcd120-40ca-4b6a-a025-bc7f2298293b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:40.306164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcd120-40ca-4b6a-a025-bc7f2298293b service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:40.308859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcd120-40ca-4b6a-a025-bc7f2298293b service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:40.309265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcd120-40ca-4b6a-a025-bc7f2298293b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:40.313450 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-91dcd120-40ca-4b6a-a025-bc7f2298293b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:40.343849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcd120-40ca-4b6a-a025-bc7f2298293b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:40.348051 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcd120-40ca-4b6a-a025-bc7f2298293b service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:40.384195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 906/1826] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:40.447822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 921/1827] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:40.486798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcd120-40ca-4b6a-a025-bc7f2298293b service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:40.488461 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-91dcd120-40ca-4b6a-a025-bc7f2298293b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:40.503687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcd120-40ca-4b6a-a025-bc7f2298293b service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:40.509844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26b51d-b1e3-407a-99fd-54363fb177a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:40.510590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26b51d-b1e3-407a-99fd-54363fb177a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:40.510878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26b51d-b1e3-407a-99fd-54363fb177a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:40.511226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26b51d-b1e3-407a-99fd-54363fb177a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:40.523399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26b51d-b1e3-407a-99fd-54363fb177a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:40.524936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26b51d-b1e3-407a-99fd-54363fb177a0 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:40.539591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 907/1828] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:40.916424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558cd99-9f8c-4609-8ea6-c915e8759161 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:40.916981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558cd99-9f8c-4609-8ea6-c915e8759161 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:40.916981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558cd99-9f8c-4609-8ea6-c915e8759161 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:40.918979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 922/1829] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 23 17:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:40.939017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d5e5d-92a3-470d-b3e7-faa817efe24b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:40.939270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d5e5d-92a3-470d-b3e7-faa817efe24b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:40.939552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d5e5d-92a3-470d-b3e7-faa817efe24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:40.982785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ab5d5e5d-92a3-470d-b3e7-faa817efe24b None None] MFA Rules not processed for user `9884780c88aa48ffa92a696740761387`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:40.984071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ab5d5e5d-92a3-470d-b3e7-faa817efe24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:41.156390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 908/1830] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 23 17:09:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:41.467018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558cd99-9f8c-4609-8ea6-c915e8759161 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:41.468887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2558cd99-9f8c-4609-8ea6-c915e8759161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:41.490836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558cd99-9f8c-4609-8ea6-c915e8759161 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:41.504759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:41.507174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:41.507558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:41.507934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] PATH_INFO: `/v3/projects/0c10e2c86ae240658765606155f3e1ac` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:41.509693 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c10e2c86ae240658765606155f3e1ac)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:41.525638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:41.576720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d5e5d-92a3-470d-b3e7-faa817efe24b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:41.578727 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ab5d5e5d-92a3-470d-b3e7-faa817efe24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:41.608576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d5e5d-92a3-470d-b3e7-faa817efe24b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:41.644879 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c10e2c86ae240658765606155f3e1ac', 'request_id': 'req-7c368178-015e-4a31-a4f2-ca25e2a68f1e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:41.660262 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c10e2c86ae240658765606155f3e1ac', 'request_id': 'req-7c368178-015e-4a31-a4f2-ca25e2a68f1e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:41.667466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c10e2c86ae240658765606155f3e1ac', 'request_id': 'req-7c368178-015e-4a31-a4f2-ca25e2a68f1e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:41.686080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] The token cache is being invalidate because project 0c10e2c86ae240658765606155f3e1ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:41.686080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:41.687104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:41.690139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 923/1831] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:41 2022] DELETE /identity/v3/projects/0c10e2c86ae240658765606155f3e1ac => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:41.694695 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:41.698199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:41.783243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:41.803483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:41.805208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310449b-e7f3-475f-a98d-03706d3432dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:41.806068 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310449b-e7f3-475f-a98d-03706d3432dc service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:41.806408 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310449b-e7f3-475f-a98d-03706d3432dc service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:41.806708 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310449b-e7f3-475f-a98d-03706d3432dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:41.813953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8310449b-e7f3-475f-a98d-03706d3432dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:41.841499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310449b-e7f3-475f-a98d-03706d3432dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:41.845146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310449b-e7f3-475f-a98d-03706d3432dc service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:41.846416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c368178-015e-4a31-a4f2-ca25e2a68f1e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:41.860896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:41.861745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:41.862042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:41.863023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] PATH_INFO: `/v3/users/2f77e931f0604d53ab411f0fc97bda4c` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:41.864516 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f77e931f0604d53ab411f0fc97bda4c)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:41.867275 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:41.870548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 909/1832] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:41.971761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f77e931f0604d53ab411f0fc97bda4c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:41.971761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f77e931f0604d53ab411f0fc97bda4c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:41.988080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f77e931f0604d53ab411f0fc97bda4c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:42.004326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f77e931f0604d53ab411f0fc97bda4c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:42.005222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f77e931f0604d53ab411f0fc97bda4c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:42.039340 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 924/1833] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:41 2022] DELETE /identity/v3/users/2f77e931f0604d53ab411f0fc97bda4c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:42.623638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310449b-e7f3-475f-a98d-03706d3432dc service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:42.625913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8310449b-e7f3-475f-a98d-03706d3432dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:42.650632 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310449b-e7f3-475f-a98d-03706d3432dc service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:42.848860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5d0a0-ebfe-4b67-a54f-991a331641cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:42.850223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5d0a0-ebfe-4b67-a54f-991a331641cb service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:42.850223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5d0a0-ebfe-4b67-a54f-991a331641cb service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:42.851402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5d0a0-ebfe-4b67-a54f-991a331641cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:42.854040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-78e5d0a0-ebfe-4b67-a54f-991a331641cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:42.895582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5d0a0-ebfe-4b67-a54f-991a331641cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:42.897291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5d0a0-ebfe-4b67-a54f-991a331641cb service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:42.914069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 910/1834] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:43.390406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:43.393140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:43.394850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5d0a0-ebfe-4b67-a54f-991a331641cb service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:43.396492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-78e5d0a0-ebfe-4b67-a54f-991a331641cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:43.479609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e22c5a-a4e9-4eeb-bae0-aca786361f03 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:43.483712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ac855-34bb-4a12-989b-656891136afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:43.484741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ac855-34bb-4a12-989b-656891136afa service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:43.485686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ac855-34bb-4a12-989b-656891136afa service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:43.486280 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ac855-34bb-4a12-989b-656891136afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:43.490551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-838ac855-34bb-4a12-989b-656891136afa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:43.505334 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5d0a0-ebfe-4b67-a54f-991a331641cb service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:43.519567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81602974-c24a-457f-91ca-6f052f1d4a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:43.520510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81602974-c24a-457f-91ca-6f052f1d4a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:43.520796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81602974-c24a-457f-91ca-6f052f1d4a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:43.521156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81602974-c24a-457f-91ca-6f052f1d4a10 admin admin] PATH_INFO: `/v3/projects/8be914b36e2c47519749801835a8eb3c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:43.526612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81602974-c24a-457f-91ca-6f052f1d4a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be914b36e2c47519749801835a8eb3c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:43.529938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81602974-c24a-457f-91ca-6f052f1d4a10 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:43.595840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ac855-34bb-4a12-989b-656891136afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:43.597613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ac855-34bb-4a12-989b-656891136afa service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:43.603168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81602974-c24a-457f-91ca-6f052f1d4a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be914b36e2c47519749801835a8eb3c', 'request_id': 'req-81602974-c24a-457f-91ca-6f052f1d4a10'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:43.609282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 925/1835] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:43.612645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81602974-c24a-457f-91ca-6f052f1d4a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be914b36e2c47519749801835a8eb3c', 'request_id': 'req-81602974-c24a-457f-91ca-6f052f1d4a10'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:43.619562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81602974-c24a-457f-91ca-6f052f1d4a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be914b36e2c47519749801835a8eb3c', 'request_id': 'req-81602974-c24a-457f-91ca-6f052f1d4a10'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:43.645315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81602974-c24a-457f-91ca-6f052f1d4a10 admin admin] The token cache is being invalidate because project 8be914b36e2c47519749801835a8eb3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:43.646820 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81602974-c24a-457f-91ca-6f052f1d4a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:43.647515 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81602974-c24a-457f-91ca-6f052f1d4a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:43.650163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 911/1836] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:43 2022] DELETE /identity/v3/projects/8be914b36e2c47519749801835a8eb3c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:43.654806 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7ff4b-d8c7-44ed-88d8-d8bbd97b1d91 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:43.655095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7ff4b-d8c7-44ed-88d8-d8bbd97b1d91 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:43.655370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7ff4b-d8c7-44ed-88d8-d8bbd97b1d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:43.730285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-aec7ff4b-d8c7-44ed-88d8-d8bbd97b1d91 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:43.736955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-aec7ff4b-d8c7-44ed-88d8-d8bbd97b1d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:43.750170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:43.897179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 926/1837] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:43.904463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a4d21-01c1-4548-b096-ee970b6aa902 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:43.904755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a4d21-01c1-4548-b096-ee970b6aa902 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:43.905233 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a4d21-01c1-4548-b096-ee970b6aa902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:43.925241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:43.933628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e33a4d21-01c1-4548-b096-ee970b6aa902 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:43.937356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e33a4d21-01c1-4548-b096-ee970b6aa902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:43.959949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 912/1838] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:43.964503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7ff4b-d8c7-44ed-88d8-d8bbd97b1d91 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:43.977639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7ff4b-d8c7-44ed-88d8-d8bbd97b1d91 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:43.983820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f6c5f-b793-4104-b66d-9fe570a42740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:43.984624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f6c5f-b793-4104-b66d-9fe570a42740 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:43.984977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f6c5f-b793-4104-b66d-9fe570a42740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:43.985792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f6c5f-b793-4104-b66d-9fe570a42740 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:43.986938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f6c5f-b793-4104-b66d-9fe570a42740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:43.987172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f6c5f-b793-4104-b66d-9fe570a42740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:43.988966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f6c5f-b793-4104-b66d-9fe570a42740 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:44.008829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 927/1839] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:09:44.010431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a4d21-01c1-4548-b096-ee970b6aa902 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:44.022312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a4d21-01c1-4548-b096-ee970b6aa902 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:44.031412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7970e-6aec-4115-90e6-91b7b6c05963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:44.032967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7970e-6aec-4115-90e6-91b7b6c05963 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:44.033837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7970e-6aec-4115-90e6-91b7b6c05963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:44.034245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7970e-6aec-4115-90e6-91b7b6c05963 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:44.035576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7970e-6aec-4115-90e6-91b7b6c05963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:44.041608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7970e-6aec-4115-90e6-91b7b6c05963 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:44.110898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 913/1840] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:44 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:44.112506 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f6c5f-b793-4104-b66d-9fe570a42740 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:44.131577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f6c5f-b793-4104-b66d-9fe570a42740 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:44.326040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe4e03-77df-4031-8f99-112f7adbb51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:44.328291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe4e03-77df-4031-8f99-112f7adbb51d admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:44.329984 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe4e03-77df-4031-8f99-112f7adbb51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:44.330737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe4e03-77df-4031-8f99-112f7adbb51d admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:44.333490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe4e03-77df-4031-8f99-112f7adbb51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:44.339965 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe4e03-77df-4031-8f99-112f7adbb51d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:44.408898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 928/1841] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:44 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:44.410854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7970e-6aec-4115-90e6-91b7b6c05963 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:44.426719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7970e-6aec-4115-90e6-91b7b6c05963 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:44.433395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604aa45-6e5a-4721-b491-1cceeefa1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:44.434448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604aa45-6e5a-4721-b491-1cceeefa1d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:44.434595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604aa45-6e5a-4721-b491-1cceeefa1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:44.434975 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604aa45-6e5a-4721-b491-1cceeefa1d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:44.435979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604aa45-6e5a-4721-b491-1cceeefa1d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:44.437784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604aa45-6e5a-4721-b491-1cceeefa1d67 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:44.455384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 914/1842] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:44.459279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe4e03-77df-4031-8f99-112f7adbb51d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:44.474609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe4e03-77df-4031-8f99-112f7adbb51d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:44.480510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241887b-3af7-4985-9d56-6b650af38c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:44.481518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241887b-3af7-4985-9d56-6b650af38c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:44.482604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241887b-3af7-4985-9d56-6b650af38c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:44.483100 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241887b-3af7-4985-9d56-6b650af38c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:44.484053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241887b-3af7-4985-9d56-6b650af38c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:44.504748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241887b-3af7-4985-9d56-6b650af38c44 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:44.528556 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 929/1843] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:44.533688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604aa45-6e5a-4721-b491-1cceeefa1d67 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:44.552796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604aa45-6e5a-4721-b491-1cceeefa1d67 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:44.574005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d477b-5837-441f-8887-d910f556218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:44.577931 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d477b-5837-441f-8887-d910f556218c admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:44.578689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d477b-5837-441f-8887-d910f556218c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:44.580420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d477b-5837-441f-8887-d910f556218c admin admin] PATH_INFO: `/v3/projects/b2562ac3b4654ea79892af5d95a763cc/users/40650ec9d04f4863989279f2261f63da/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:44.623971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d477b-5837-441f-8887-d910f556218c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2562ac3b4654ea79892af5d95a763cc, user_id=40650ec9d04f4863989279f2261f63da, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:44.634044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d477b-5837-441f-8887-d910f556218c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:44.678477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 915/1844] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:44 2022] PUT /identity/v3/projects/b2562ac3b4654ea79892af5d95a763cc/users/40650ec9d04f4863989279f2261f63da/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:44.682376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed66f6-6a0f-4e35-ba10-cdf7ffa44451 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:44.682888 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed66f6-6a0f-4e35-ba10-cdf7ffa44451 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:44.683239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed66f6-6a0f-4e35-ba10-cdf7ffa44451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:44.745004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-36ed66f6-6a0f-4e35-ba10-cdf7ffa44451 None None] MFA Rules not processed for user `40650ec9d04f4863989279f2261f63da`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:44.748641 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-36ed66f6-6a0f-4e35-ba10-cdf7ffa44451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:44.902484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 930/1845] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:44.907714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d477b-5837-441f-8887-d910f556218c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:45.044533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d477b-5837-441f-8887-d910f556218c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:45.050765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d6e18-506b-4da1-93b5-e0b12e306eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:45.051479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d6e18-506b-4da1-93b5-e0b12e306eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:45.051818 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d6e18-506b-4da1-93b5-e0b12e306eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:45.052103 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d6e18-506b-4da1-93b5-e0b12e306eb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:45.053115 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d6e18-506b-4da1-93b5-e0b12e306eb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:45.055126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d6e18-506b-4da1-93b5-e0b12e306eb8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:45.101354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 916/1846] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:44 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:09:45.102996 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed66f6-6a0f-4e35-ba10-cdf7ffa44451 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:45.111590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:45.123457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed66f6-6a0f-4e35-ba10-cdf7ffa44451 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:45.227964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed61c1-ec92-4eb6-a4df-b290b1a0891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:45.228833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed61c1-ec92-4eb6-a4df-b290b1a0891d admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:45.229184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed61c1-ec92-4eb6-a4df-b290b1a0891d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:45.229534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed61c1-ec92-4eb6-a4df-b290b1a0891d admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:45.230326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed61c1-ec92-4eb6-a4df-b290b1a0891d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:45.233840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed61c1-ec92-4eb6-a4df-b290b1a0891d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:45.267881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 931/1847] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:45 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:09:45.272070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d6e18-506b-4da1-93b5-e0b12e306eb8 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:45.286684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d6e18-506b-4da1-93b5-e0b12e306eb8 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:45.294776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4796ab8-06e6-455c-abb7-4d93cb278503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:45.295781 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796ab8-06e6-455c-abb7-4d93cb278503 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:45.296246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796ab8-06e6-455c-abb7-4d93cb278503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:45.296816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796ab8-06e6-455c-abb7-4d93cb278503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:45.298672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4796ab8-06e6-455c-abb7-4d93cb278503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:45.303079 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4796ab8-06e6-455c-abb7-4d93cb278503 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:45.325247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 917/1848] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:45.326600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed61c1-ec92-4eb6-a4df-b290b1a0891d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:45.338270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed61c1-ec92-4eb6-a4df-b290b1a0891d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:45.346959 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855e52c-efbe-4e95-9f20-014917e4f697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:45.348186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855e52c-efbe-4e95-9f20-014917e4f697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:45.348855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855e52c-efbe-4e95-9f20-014917e4f697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:45.349322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855e52c-efbe-4e95-9f20-014917e4f697 admin admin] PATH_INFO: `/v3/projects/b3b0952a7d3142be9165ddf1051de0a1/users/9245c073ae4849b29b4cd15a848ba79d/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:45.376767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855e52c-efbe-4e95-9f20-014917e4f697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b0952a7d3142be9165ddf1051de0a1, user_id=9245c073ae4849b29b4cd15a848ba79d, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:45.380323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855e52c-efbe-4e95-9f20-014917e4f697 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:45.413733 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 932/1849] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:45 2022] PUT /identity/v3/projects/b3b0952a7d3142be9165ddf1051de0a1/users/9245c073ae4849b29b4cd15a848ba79d/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:45.415738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4796ab8-06e6-455c-abb7-4d93cb278503 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:45.433348 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4796ab8-06e6-455c-abb7-4d93cb278503 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:45.577576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7482e7f-e7b7-4dfc-9140-705dce06a382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:45.579143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7482e7f-e7b7-4dfc-9140-705dce06a382 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:45.579669 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7482e7f-e7b7-4dfc-9140-705dce06a382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:45.580531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7482e7f-e7b7-4dfc-9140-705dce06a382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:45.581891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7482e7f-e7b7-4dfc-9140-705dce06a382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:45.583896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7482e7f-e7b7-4dfc-9140-705dce06a382 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:45.613688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855e52c-efbe-4e95-9f20-014917e4f697 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:45.621215 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 918/1850] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:45.631501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855e52c-efbe-4e95-9f20-014917e4f697 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:45.641901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e4ef-1484-44eb-906e-902265542173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:45.642955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e4ef-1484-44eb-906e-902265542173 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:45.643238 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e4ef-1484-44eb-906e-902265542173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:45.643709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e4ef-1484-44eb-906e-902265542173 admin admin] PATH_INFO: `/v3/projects/b3b0952a7d3142be9165ddf1051de0a1/users/9245c073ae4849b29b4cd15a848ba79d/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:45.650664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954e4ef-1484-44eb-906e-902265542173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b0952a7d3142be9165ddf1051de0a1, user_id=9245c073ae4849b29b4cd15a848ba79d, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:45.653696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954e4ef-1484-44eb-906e-902265542173 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:45.701933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 933/1851] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:45 2022] PUT /identity/v3/projects/b3b0952a7d3142be9165ddf1051de0a1/users/9245c073ae4849b29b4cd15a848ba79d/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:45.712141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed5896-303c-4fd5-abe2-5410a90c6da2 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:45.713004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed5896-303c-4fd5-abe2-5410a90c6da2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:45.713440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed5896-303c-4fd5-abe2-5410a90c6da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:45.772426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:45.776671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-46ed5896-303c-4fd5-abe2-5410a90c6da2 None None] MFA Rules not processed for user `9245c073ae4849b29b4cd15a848ba79d`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:45.779097 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-46ed5896-303c-4fd5-abe2-5410a90c6da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:45.794927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e4ef-1484-44eb-906e-902265542173 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:45.797013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6954e4ef-1484-44eb-906e-902265542173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:45.900873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 919/1852] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:45.915861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed5896-303c-4fd5-abe2-5410a90c6da2 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:45.917475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-46ed5896-303c-4fd5-abe2-5410a90c6da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:45.966412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e4ef-1484-44eb-906e-902265542173 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:45.982437 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:45.985252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:45.985749 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:45.986698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] PATH_INFO: `/v3/users/313fdf3bb46241c2851c5b95678024f6` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:45.988141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] RBAC: Authorizing `identity:delete_user(user_id=313fdf3bb46241c2851c5b95678024f6)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:45.991239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:45.999302 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed5896-303c-4fd5-abe2-5410a90c6da2 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:46.008498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bafde-3a66-43a2-ba2f-fa062dda584c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:46.009369 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bafde-3a66-43a2-ba2f-fa062dda584c service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:46.009663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bafde-3a66-43a2-ba2f-fa062dda584c service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:46.009944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bafde-3a66-43a2-ba2f-fa062dda584c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:46.030411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bafde-3a66-43a2-ba2f-fa062dda584c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:46.033491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bafde-3a66-43a2-ba2f-fa062dda584c service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:46.051246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 920/1853] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:46.073468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313fdf3bb46241c2851c5b95678024f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:46.082816 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313fdf3bb46241c2851c5b95678024f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:46.092732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313fdf3bb46241c2851c5b95678024f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:46.097744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:46.104788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313fdf3bb46241c2851c5b95678024f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:46.112815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313fdf3bb46241c2851c5b95678024f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:46.137546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 934/1854] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:45 2022] DELETE /identity/v3/users/313fdf3bb46241c2851c5b95678024f6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:46.146055 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ffd4-37fc-4923-9111-b5e9bd0347f5 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:46.146404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ffd4-37fc-4923-9111-b5e9bd0347f5 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:46.147038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ffd4-37fc-4923-9111-b5e9bd0347f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:46.191593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3ed2ffd4-37fc-4923-9111-b5e9bd0347f5 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:46.201681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3ed2ffd4-37fc-4923-9111-b5e9bd0347f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:46.336281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 921/1855] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:46.411391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:46.414663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:46.554848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a97e6-498f-4a7d-8e6d-424619c5284b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:46.564982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70d588-1046-40a8-aa0e-a8b982de4ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:46.566016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70d588-1046-40a8-aa0e-a8b982de4ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:46.566408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70d588-1046-40a8-aa0e-a8b982de4ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:46.567492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70d588-1046-40a8-aa0e-a8b982de4ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:46.570237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ffd4-37fc-4923-9111-b5e9bd0347f5 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:46.571772 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3ed2ffd4-37fc-4923-9111-b5e9bd0347f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:46.583668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70d588-1046-40a8-aa0e-a8b982de4ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:46.585446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70d588-1046-40a8-aa0e-a8b982de4ac6 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:46.600018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 935/1856] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:46.637223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:46.660473 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ffd4-37fc-4923-9111-b5e9bd0347f5 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:46.665904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00f0a3-48a1-49a2-ab39-2124994b325c tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9245c073ae4849b29b4cd15a848ba79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3b0952a7d3142be9165ddf1051de0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:46.667217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00f0a3-48a1-49a2-ab39-2124994b325c tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:46.667590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00f0a3-48a1-49a2-ab39-2124994b325c tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:46.667871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00f0a3-48a1-49a2-ab39-2124994b325c tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:46.668667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00f0a3-48a1-49a2-ab39-2124994b325c tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:46.668977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00f0a3-48a1-49a2-ab39-2124994b325c tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:46.671203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00f0a3-48a1-49a2-ab39-2124994b325c tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:46.687587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 922/1857] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:09:46.689933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70d588-1046-40a8-aa0e-a8b982de4ac6 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:46.701557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70d588-1046-40a8-aa0e-a8b982de4ac6 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:46.707897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca64dd-d7f3-4ab4-b5e6-829a74ad7f9a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9245c073ae4849b29b4cd15a848ba79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3b0952a7d3142be9165ddf1051de0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:46.709258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca64dd-d7f3-4ab4-b5e6-829a74ad7f9a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:46.709478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca64dd-d7f3-4ab4-b5e6-829a74ad7f9a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:46.709872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca64dd-d7f3-4ab4-b5e6-829a74ad7f9a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:46.710928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca64dd-d7f3-4ab4-b5e6-829a74ad7f9a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:46.713872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca64dd-d7f3-4ab4-b5e6-829a74ad7f9a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:46.743590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 936/1858] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:46 2022] POST /identity/v3/projects => generated 352 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:46.745026 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00f0a3-48a1-49a2-ab39-2124994b325c tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:46.755824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00f0a3-48a1-49a2-ab39-2124994b325c tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:46.818572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744003e-7416-47d4-91ed-90876c6d2e7a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9245c073ae4849b29b4cd15a848ba79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3b0952a7d3142be9165ddf1051de0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:46.819386 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744003e-7416-47d4-91ed-90876c6d2e7a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:46.819994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744003e-7416-47d4-91ed-90876c6d2e7a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:46.820615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744003e-7416-47d4-91ed-90876c6d2e7a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:46.821709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744003e-7416-47d4-91ed-90876c6d2e7a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:46.822093 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744003e-7416-47d4-91ed-90876c6d2e7a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:46.824496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744003e-7416-47d4-91ed-90876c6d2e7a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:46.839581 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 923/1859] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:09:46.880685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca64dd-d7f3-4ab4-b5e6-829a74ad7f9a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:46.895144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca64dd-d7f3-4ab4-b5e6-829a74ad7f9a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:46.900158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9245c073ae4849b29b4cd15a848ba79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3b0952a7d3142be9165ddf1051de0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:46.901247 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:46.901580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:46.901855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] PATH_INFO: `/v3/projects/14ff8d63fc3444baa7aa8289e0b0ca90` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:46.903080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: Authorizing `identity:delete_project(project_id=14ff8d63fc3444baa7aa8289e0b0ca90)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:46.905007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:46.955555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ff8d63fc3444baa7aa8289e0b0ca90', 'request_id': 'req-2128b36d-76b2-47be-8a91-e36137354a89'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:46.963710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ff8d63fc3444baa7aa8289e0b0ca90', 'request_id': 'req-2128b36d-76b2-47be-8a91-e36137354a89'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:46.971439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ff8d63fc3444baa7aa8289e0b0ca90', 'request_id': 'req-2128b36d-76b2-47be-8a91-e36137354a89'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:46.982450 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] The token cache is being invalidate because project 14ff8d63fc3444baa7aa8289e0b0ca90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:46.982705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:46.983399 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:46.986031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 937/1860] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:46 2022] DELETE /identity/v3/projects/14ff8d63fc3444baa7aa8289e0b0ca90 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:47.282544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744003e-7416-47d4-91ed-90876c6d2e7a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:47.284705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d744003e-7416-47d4-91ed-90876c6d2e7a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:47.331233 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:47.332655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:47.386225 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744003e-7416-47d4-91ed-90876c6d2e7a tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:47.424773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:47.466674 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128b36d-76b2-47be-8a91-e36137354a89 tempest-VolumeQuotaClassesTest-245761657 tempest-VolumeQuotaClassesTest-245761657-project-admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:47.472040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:47.473074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:47.473440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:47.473870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] PATH_INFO: `/v3/projects/afe1bef7457e40e192c1f5e2c9e35754` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:47.476111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe1bef7457e40e192c1f5e2c9e35754)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:47.478524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:47.522103 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a3d29-01c2-4559-8c2e-535654105718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:47.523658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3d29-01c2-4559-8c2e-535654105718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:47.524114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3d29-01c2-4559-8c2e-535654105718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:47.524625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3d29-01c2-4559-8c2e-535654105718 admin admin] PATH_INFO: `/v3/users/40650ec9d04f4863989279f2261f63da` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:47.526850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a3d29-01c2-4559-8c2e-535654105718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40650ec9d04f4863989279f2261f63da)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:47.531157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a3d29-01c2-4559-8c2e-535654105718 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:47.543669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe1bef7457e40e192c1f5e2c9e35754', 'request_id': 'req-252aeba9-4717-4adf-82c3-5b4db5ddbaff'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.559984 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe1bef7457e40e192c1f5e2c9e35754', 'request_id': 'req-252aeba9-4717-4adf-82c3-5b4db5ddbaff'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.561753 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:47.572927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe1bef7457e40e192c1f5e2c9e35754', 'request_id': 'req-252aeba9-4717-4adf-82c3-5b4db5ddbaff'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.595465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] The token cache is being invalidate because project afe1bef7457e40e192c1f5e2c9e35754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:47.595777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.596596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.598635 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 938/1861] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:47 2022] DELETE /identity/v3/projects/afe1bef7457e40e192c1f5e2c9e35754 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:47.603042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:47.603970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-336a3d29-01c2-4559-8c2e-535654105718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40650ec9d04f4863989279f2261f63da'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.604750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:47.622805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-336a3d29-01c2-4559-8c2e-535654105718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40650ec9d04f4863989279f2261f63da'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.624183 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-336a3d29-01c2-4559-8c2e-535654105718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40650ec9d04f4863989279f2261f63da'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.638024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-336a3d29-01c2-4559-8c2e-535654105718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40650ec9d04f4863989279f2261f63da'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.639101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-336a3d29-01c2-4559-8c2e-535654105718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40650ec9d04f4863989279f2261f63da'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.662622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 924/1862] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:47 2022] DELETE /identity/v3/users/40650ec9d04f4863989279f2261f63da => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:47.665218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b855dd-7d16-4a67-825d-6f1de5ecc81d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:47.665664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b855dd-7d16-4a67-825d-6f1de5ecc81d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:47.666307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b855dd-7d16-4a67-825d-6f1de5ecc81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:47.712666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-38b855dd-7d16-4a67-825d-6f1de5ecc81d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:47.713878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-38b855dd-7d16-4a67-825d-6f1de5ecc81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:47.729178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252aeba9-4717-4adf-82c3-5b4db5ddbaff admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:47.812234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 925/1863] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:47.814099 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b855dd-7d16-4a67-825d-6f1de5ecc81d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:47.815887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-38b855dd-7d16-4a67-825d-6f1de5ecc81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:47.883936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:47.885007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:47.885349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:47.885907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] PATH_INFO: `/v3/users/34661b5cf11c4d7c88a4f58e29ea8e04` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:47.887359 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34661b5cf11c4d7c88a4f58e29ea8e04)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:47.889735 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:47.922386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:47.924147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b855dd-7d16-4a67-825d-6f1de5ecc81d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:47.928717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ccd4c-4bc9-4005-922c-349aec73ef77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:47.929696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ccd4c-4bc9-4005-922c-349aec73ef77 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:47.930397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ccd4c-4bc9-4005-922c-349aec73ef77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:47.930397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ccd4c-4bc9-4005-922c-349aec73ef77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:47.942880 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ccd4c-4bc9-4005-922c-349aec73ef77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:47.944950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ccd4c-4bc9-4005-922c-349aec73ef77 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:47.958732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 926/1864] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:47.965735 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34661b5cf11c4d7c88a4f58e29ea8e04'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.966466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34661b5cf11c4d7c88a4f58e29ea8e04'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.976807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34661b5cf11c4d7c88a4f58e29ea8e04'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.993212 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34661b5cf11c4d7c88a4f58e29ea8e04'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:47.994447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34661b5cf11c4d7c88a4f58e29ea8e04'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:48.035540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 939/1865] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:47 2022] DELETE /identity/v3/users/34661b5cf11c4d7c88a4f58e29ea8e04 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:48.465676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ccd4c-4bc9-4005-922c-349aec73ef77 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:48.467144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-971ccd4c-4bc9-4005-922c-349aec73ef77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:48.486521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ccd4c-4bc9-4005-922c-349aec73ef77 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:48.528818 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:48.553649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f31577-b033-465e-8c71-bf19b01d794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:48.554731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f31577-b033-465e-8c71-bf19b01d794b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:48.555123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f31577-b033-465e-8c71-bf19b01d794b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:48.555571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f31577-b033-465e-8c71-bf19b01d794b admin admin] PATH_INFO: `/v3/projects/568c6a5f367442ba9bd21920286f1a78` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:48.557097 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f31577-b033-465e-8c71-bf19b01d794b admin admin] RBAC: Authorizing `identity:delete_project(project_id=568c6a5f367442ba9bd21920286f1a78)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:48.559827 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f31577-b033-465e-8c71-bf19b01d794b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:48.622150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-17f31577-b033-465e-8c71-bf19b01d794b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568c6a5f367442ba9bd21920286f1a78', 'request_id': 'req-17f31577-b033-465e-8c71-bf19b01d794b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:48.643937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-17f31577-b033-465e-8c71-bf19b01d794b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568c6a5f367442ba9bd21920286f1a78', 'request_id': 'req-17f31577-b033-465e-8c71-bf19b01d794b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:48.653691 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-17f31577-b033-465e-8c71-bf19b01d794b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568c6a5f367442ba9bd21920286f1a78', 'request_id': 'req-17f31577-b033-465e-8c71-bf19b01d794b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:48.661308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:48.668529 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:48.691329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-17f31577-b033-465e-8c71-bf19b01d794b admin admin] The token cache is being invalidate because project 568c6a5f367442ba9bd21920286f1a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:48.691906 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-17f31577-b033-465e-8c71-bf19b01d794b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:48.693734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221cb05-4ed8-440f-aef0-4c5d913fae75 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:48.694601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-17f31577-b033-465e-8c71-bf19b01d794b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:48.696590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 927/1866] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:48 2022] DELETE /identity/v3/projects/568c6a5f367442ba9bd21920286f1a78 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:48.703305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e50512-b12b-4f96-b8c9-a3d7edc9b4b8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:48.703305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e50512-b12b-4f96-b8c9-a3d7edc9b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:48.703305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e50512-b12b-4f96-b8c9-a3d7edc9b4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:48.755101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b4e50512-b12b-4f96-b8c9-a3d7edc9b4b8 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:48.757088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b4e50512-b12b-4f96-b8c9-a3d7edc9b4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:48.834136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:48.835213 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:48.840282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:48.840748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] PATH_INFO: `/v3/projects/b2562ac3b4654ea79892af5d95a763cc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:48.842119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2562ac3b4654ea79892af5d95a763cc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:48.845593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:48.903401 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 928/1867] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:48.905697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec67c-ebbe-4107-809e-2a5ccddb99c1 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:48.909149 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec67c-ebbe-4107-809e-2a5ccddb99c1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:48.909692 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec67c-ebbe-4107-809e-2a5ccddb99c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:48.932614 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2562ac3b4654ea79892af5d95a763cc', 'request_id': 'req-e2e0a772-0a27-4876-bcf8-d8814e0b1915'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:48.946122 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-bc0ec67c-ebbe-4107-809e-2a5ccddb99c1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:48.949338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2562ac3b4654ea79892af5d95a763cc', 'request_id': 'req-e2e0a772-0a27-4876-bcf8-d8814e0b1915'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:48.954760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bc0ec67c-ebbe-4107-809e-2a5ccddb99c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:48.970391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2562ac3b4654ea79892af5d95a763cc', 'request_id': 'req-e2e0a772-0a27-4876-bcf8-d8814e0b1915'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.007548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] The token cache is being invalidate because project b2562ac3b4654ea79892af5d95a763cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:49.007932 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.009760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.011760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 940/1868] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:48 2022] DELETE /identity/v3/projects/b2562ac3b4654ea79892af5d95a763cc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:49.017685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:49.027602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:49.066406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:49.115413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 929/1869] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:49.116996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ec67c-ebbe-4107-809e-2a5ccddb99c1 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:49.123322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0a772-0a27-4876-bcf8-d8814e0b1915 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:49.129394 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ec67c-ebbe-4107-809e-2a5ccddb99c1 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:49.129573 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:49.130455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:49.130758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:49.131452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] PATH_INFO: `/v3/users/9245c073ae4849b29b4cd15a848ba79d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:49.132955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9245c073ae4849b29b4cd15a848ba79d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:49.135286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:49.136409 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d255fa-0efe-4411-8afc-ea944f7ecaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:49.137569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d255fa-0efe-4411-8afc-ea944f7ecaff admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:49.138158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d255fa-0efe-4411-8afc-ea944f7ecaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:49.139055 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d255fa-0efe-4411-8afc-ea944f7ecaff admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:49.140117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d255fa-0efe-4411-8afc-ea944f7ecaff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:49.140701 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d255fa-0efe-4411-8afc-ea944f7ecaff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:49.143367 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d255fa-0efe-4411-8afc-ea944f7ecaff admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:49.153653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:49.169042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 930/1870] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:09:49.170191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d255fa-0efe-4411-8afc-ea944f7ecaff admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:49.187337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d255fa-0efe-4411-8afc-ea944f7ecaff admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:49.195362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4281-5d99-438d-9f5b-b6eec32a886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:49.196699 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4281-5d99-438d-9f5b-b6eec32a886f admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:49.197212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4281-5d99-438d-9f5b-b6eec32a886f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:49.197854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4281-5d99-438d-9f5b-b6eec32a886f admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:49.198833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4281-5d99-438d-9f5b-b6eec32a886f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:49.201303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4281-5d99-438d-9f5b-b6eec32a886f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:49.217268 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9245c073ae4849b29b4cd15a848ba79d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.218003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9245c073ae4849b29b4cd15a848ba79d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.228606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9245c073ae4849b29b4cd15a848ba79d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.237514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 931/1871] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:49 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:49.241786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4281-5d99-438d-9f5b-b6eec32a886f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:49.241912 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9245c073ae4849b29b4cd15a848ba79d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.245773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9245c073ae4849b29b4cd15a848ba79d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.284147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 941/1872] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:49 2022] DELETE /identity/v3/users/9245c073ae4849b29b4cd15a848ba79d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:49.332324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4281-5d99-438d-9f5b-b6eec32a886f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:49.431056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9b1e9-3d2c-49dd-8d87-c7d9e31ac920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:49.431884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9b1e9-3d2c-49dd-8d87-c7d9e31ac920 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:49.432524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9b1e9-3d2c-49dd-8d87-c7d9e31ac920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:49.433104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9b1e9-3d2c-49dd-8d87-c7d9e31ac920 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:49.434925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9b1e9-3d2c-49dd-8d87-c7d9e31ac920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:49.437446 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9b1e9-3d2c-49dd-8d87-c7d9e31ac920 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:49.462427 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 932/1873] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:49 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:49.466520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:49.468252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:49.483938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024dbfd-d88c-44db-9458-daa0e3508c32 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:49.489673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a075f-35a9-4019-a083-1a2f85abb63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:49.490346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a075f-35a9-4019-a083-1a2f85abb63b admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:49.490654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a075f-35a9-4019-a083-1a2f85abb63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:49.490928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a075f-35a9-4019-a083-1a2f85abb63b admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:49.491659 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a075f-35a9-4019-a083-1a2f85abb63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:49.493448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a075f-35a9-4019-a083-1a2f85abb63b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:49.506392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 942/1874] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:09:49.510349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9b1e9-3d2c-49dd-8d87-c7d9e31ac920 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:49.523279 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9b1e9-3d2c-49dd-8d87-c7d9e31ac920 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:49.528195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afc120-209e-4f70-aa6a-92e8ca7377fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:49.528867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afc120-209e-4f70-aa6a-92e8ca7377fe admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:49.529146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afc120-209e-4f70-aa6a-92e8ca7377fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:49.529420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afc120-209e-4f70-aa6a-92e8ca7377fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:49.530145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afc120-209e-4f70-aa6a-92e8ca7377fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:49.532366 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afc120-209e-4f70-aa6a-92e8ca7377fe admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:49.546621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 933/1875] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:49.549689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a075f-35a9-4019-a083-1a2f85abb63b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:49.563878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a075f-35a9-4019-a083-1a2f85abb63b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:49.569084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ddb95-cebc-4997-be8e-7ae60078bc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:49.570398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ddb95-cebc-4997-be8e-7ae60078bc71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:49.570398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ddb95-cebc-4997-be8e-7ae60078bc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:49.570679 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ddb95-cebc-4997-be8e-7ae60078bc71 admin admin] PATH_INFO: `/v3/projects/974750b90ab84866a9767f76895d6ad0/users/ba36792325794bbe8851a0d7971934e4/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:49.585814 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afc120-209e-4f70-aa6a-92e8ca7377fe admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:49.587956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-57afc120-209e-4f70-aa6a-92e8ca7377fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:49.597980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ddb95-cebc-4997-be8e-7ae60078bc71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=974750b90ab84866a9767f76895d6ad0, user_id=ba36792325794bbe8851a0d7971934e4, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:49.601063 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ddb95-cebc-4997-be8e-7ae60078bc71 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:49.607841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afc120-209e-4f70-aa6a-92e8ca7377fe admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:49.615021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ce906-e257-460b-be01-fd91ae4e1144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:49.616429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ce906-e257-460b-be01-fd91ae4e1144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:49.616736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ce906-e257-460b-be01-fd91ae4e1144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:49.617530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 943/1876] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:49 2022] PUT /identity/v3/projects/974750b90ab84866a9767f76895d6ad0/users/ba36792325794bbe8851a0d7971934e4/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:49.617644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ce906-e257-460b-be01-fd91ae4e1144 admin admin] PATH_INFO: `/v3/users/40f932ab52fc418ead4ea9e1705b509a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:49.618809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ce906-e257-460b-be01-fd91ae4e1144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f932ab52fc418ead4ea9e1705b509a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:49.621779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ce906-e257-460b-be01-fd91ae4e1144 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:49.630174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2034f2-cc3b-4bb8-9598-59fa08afc4e3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:49.630504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2034f2-cc3b-4bb8-9598-59fa08afc4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:49.630789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2034f2-cc3b-4bb8-9598-59fa08afc4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:49.678781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ef2034f2-cc3b-4bb8-9598-59fa08afc4e3 None None] MFA Rules not processed for user `ba36792325794bbe8851a0d7971934e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:49.680845 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ef2034f2-cc3b-4bb8-9598-59fa08afc4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:49.693432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-989ce906-e257-460b-be01-fd91ae4e1144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f932ab52fc418ead4ea9e1705b509a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.708496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:49.718547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-989ce906-e257-460b-be01-fd91ae4e1144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f932ab52fc418ead4ea9e1705b509a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.720880 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-989ce906-e257-460b-be01-fd91ae4e1144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f932ab52fc418ead4ea9e1705b509a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.732259 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-989ce906-e257-460b-be01-fd91ae4e1144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f932ab52fc418ead4ea9e1705b509a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.733791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-989ce906-e257-460b-be01-fd91ae4e1144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f932ab52fc418ead4ea9e1705b509a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:49.753972 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 934/1877] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:49 2022] DELETE /identity/v3/users/40f932ab52fc418ead4ea9e1705b509a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:49.758427 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e796f-58e6-467d-bee4-46d558945220 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:49.758768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e796f-58e6-467d-bee4-46d558945220 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:49.759009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e796f-58e6-467d-bee4-46d558945220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:49.772377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:49.779941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 944/1878] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:49.796751 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-932e796f-58e6-467d-bee4-46d558945220 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:49.797171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2034f2-cc3b-4bb8-9598-59fa08afc4e3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:49.798923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-932e796f-58e6-467d-bee4-46d558945220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:49.799686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ef2034f2-cc3b-4bb8-9598-59fa08afc4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:49.897607 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2034f2-cc3b-4bb8-9598-59fa08afc4e3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:49.908715 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 935/1879] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:49.968105 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b7c6f-ad08-47e3-839d-f79c774b42e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:49.968697 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b7c6f-ad08-47e3-839d-f79c774b42e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:49.970988 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b7c6f-ad08-47e3-839d-f79c774b42e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:49.971318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b7c6f-ad08-47e3-839d-f79c774b42e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:49.973651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e796f-58e6-467d-bee4-46d558945220 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:49.975102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-932e796f-58e6-467d-bee4-46d558945220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:50.080684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e796f-58e6-467d-bee4-46d558945220 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:50.090778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86dcd1-8c01-447b-86fc-bad00abde7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:50.091779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86dcd1-8c01-447b-86fc-bad00abde7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:50.091910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86dcd1-8c01-447b-86fc-bad00abde7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:50.092224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86dcd1-8c01-447b-86fc-bad00abde7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:50.121598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86dcd1-8c01-447b-86fc-bad00abde7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:50.121598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86dcd1-8c01-447b-86fc-bad00abde7f9 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:50.131171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b7c6f-ad08-47e3-839d-f79c774b42e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:50.132630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b7c6f-ad08-47e3-839d-f79c774b42e0 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:50.134333 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 936/1880] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:50.160197 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 945/1881] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:50.558589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86dcd1-8c01-447b-86fc-bad00abde7f9 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:50.560352 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2f86dcd1-8c01-447b-86fc-bad00abde7f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:50.576020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86dcd1-8c01-447b-86fc-bad00abde7f9 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:50.611152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d337c3-7287-4a48-aec1-02b00337e302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:50.613610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d337c3-7287-4a48-aec1-02b00337e302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:50.613971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d337c3-7287-4a48-aec1-02b00337e302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:50.614713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d337c3-7287-4a48-aec1-02b00337e302 admin admin] PATH_INFO: `/v3/projects/b3b0952a7d3142be9165ddf1051de0a1` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:50.618606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d337c3-7287-4a48-aec1-02b00337e302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b0952a7d3142be9165ddf1051de0a1)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:50.623421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d337c3-7287-4a48-aec1-02b00337e302 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:50.754926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6d337c3-7287-4a48-aec1-02b00337e302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b0952a7d3142be9165ddf1051de0a1', 'request_id': 'req-e6d337c3-7287-4a48-aec1-02b00337e302'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:50.767398 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6d337c3-7287-4a48-aec1-02b00337e302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b0952a7d3142be9165ddf1051de0a1', 'request_id': 'req-e6d337c3-7287-4a48-aec1-02b00337e302'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:50.777171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6d337c3-7287-4a48-aec1-02b00337e302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b0952a7d3142be9165ddf1051de0a1', 'request_id': 'req-e6d337c3-7287-4a48-aec1-02b00337e302'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:50.795154 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:50.806065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6d337c3-7287-4a48-aec1-02b00337e302 admin admin] The token cache is being invalidate because project b3b0952a7d3142be9165ddf1051de0a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:50.806719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6d337c3-7287-4a48-aec1-02b00337e302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:50.809059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6d337c3-7287-4a48-aec1-02b00337e302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:50.818657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 937/1882] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:50 2022] DELETE /identity/v3/projects/b3b0952a7d3142be9165ddf1051de0a1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:50.821581 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a483-25c0-4ad5-918e-aa4b5939241a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:50.822081 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a483-25c0-4ad5-918e-aa4b5939241a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:50.822190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a483-25c0-4ad5-918e-aa4b5939241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:50.854417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e1c8a483-25c0-4ad5-918e-aa4b5939241a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:50.855629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e1c8a483-25c0-4ad5-918e-aa4b5939241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:50.945934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 946/1883] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:50.955119 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61485206-7ec5-44ed-a7f7-d964e5843041 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:50.955618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61485206-7ec5-44ed-a7f7-d964e5843041 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:50.955716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61485206-7ec5-44ed-a7f7-d964e5843041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:50.974952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-61485206-7ec5-44ed-a7f7-d964e5843041 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:50.976158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-61485206-7ec5-44ed-a7f7-d964e5843041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:50.984379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 938/1884] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:50.989056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a483-25c0-4ad5-918e-aa4b5939241a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:51.000163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a483-25c0-4ad5-918e-aa4b5939241a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:51.006223 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24221454-c935-4c92-a18c-cb8fbea37070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:51.006943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24221454-c935-4c92-a18c-cb8fbea37070 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:51.007229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24221454-c935-4c92-a18c-cb8fbea37070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:51.007739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24221454-c935-4c92-a18c-cb8fbea37070 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:51.008376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24221454-c935-4c92-a18c-cb8fbea37070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:51.008691 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24221454-c935-4c92-a18c-cb8fbea37070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:51.010301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24221454-c935-4c92-a18c-cb8fbea37070 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:51.041889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:51.057786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 947/1885] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:09:51.064251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61485206-7ec5-44ed-a7f7-d964e5843041 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:51.099628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61485206-7ec5-44ed-a7f7-d964e5843041 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:51.127171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb22bc4-feeb-4321-8078-a238934eab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:51.127866 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb22bc4-feeb-4321-8078-a238934eab0e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:51.128153 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb22bc4-feeb-4321-8078-a238934eab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:51.129574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb22bc4-feeb-4321-8078-a238934eab0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:51.130292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb22bc4-feeb-4321-8078-a238934eab0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:51.140431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb22bc4-feeb-4321-8078-a238934eab0e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:51.199607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 939/1886] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:51 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:51.206669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24221454-c935-4c92-a18c-cb8fbea37070 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:51.270249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24221454-c935-4c92-a18c-cb8fbea37070 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:51.383349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb22bc4-feeb-4321-8078-a238934eab0e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:51.386790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fbb22bc4-feeb-4321-8078-a238934eab0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:51.458884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d9ed4-6d28-4044-9790-3f9a1905eddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:51.460354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d9ed4-6d28-4044-9790-3f9a1905eddf admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:51.462690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d9ed4-6d28-4044-9790-3f9a1905eddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:51.462690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d9ed4-6d28-4044-9790-3f9a1905eddf admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:51.464860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d9ed4-6d28-4044-9790-3f9a1905eddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:51.469063 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d9ed4-6d28-4044-9790-3f9a1905eddf admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:51.526057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 948/1887] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:51 2022] POST /identity/v3/users => generated 296 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:51.534164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d9ed4-6d28-4044-9790-3f9a1905eddf admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:51.560165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d9ed4-6d28-4044-9790-3f9a1905eddf admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:51.575184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b46c0-b086-45d7-a4b7-c9ac24c5b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:51.575929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b46c0-b086-45d7-a4b7-c9ac24c5b5fd admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:51.576148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b46c0-b086-45d7-a4b7-c9ac24c5b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:51.576569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b46c0-b086-45d7-a4b7-c9ac24c5b5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:51.577367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b46c0-b086-45d7-a4b7-c9ac24c5b5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:51.579571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b46c0-b086-45d7-a4b7-c9ac24c5b5fd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:51.600179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 949/1888] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:51.605091 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b46c0-b086-45d7-a4b7-c9ac24c5b5fd admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:51.605342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb22bc4-feeb-4321-8078-a238934eab0e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:51.613605 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:51.615980 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:51.616604 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:51.617212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] PATH_INFO: `/v3/projects/8deae58c4bcb4359808086704c9976c9` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:51.619652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8deae58c4bcb4359808086704c9976c9)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:51.622888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:51.624513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b46c0-b086-45d7-a4b7-c9ac24c5b5fd admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:51.631230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dedd6c-142f-49a2-97fe-8681f071aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:51.632220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dedd6c-142f-49a2-97fe-8681f071aaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:51.632562 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dedd6c-142f-49a2-97fe-8681f071aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:51.632845 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dedd6c-142f-49a2-97fe-8681f071aaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:51.633686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dedd6c-142f-49a2-97fe-8681f071aaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:51.635517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dedd6c-142f-49a2-97fe-8681f071aaa8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:51.654766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 950/1889] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:51.660596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dedd6c-142f-49a2-97fe-8681f071aaa8 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:51.692543 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dedd6c-142f-49a2-97fe-8681f071aaa8 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:51.729472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8deae58c4bcb4359808086704c9976c9', 'request_id': 'req-6da38cef-d38a-49fb-8ce4-453e6c60c35d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:51.741538 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8deae58c4bcb4359808086704c9976c9', 'request_id': 'req-6da38cef-d38a-49fb-8ce4-453e6c60c35d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:51.785813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8deae58c4bcb4359808086704c9976c9', 'request_id': 'req-6da38cef-d38a-49fb-8ce4-453e6c60c35d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:51.828145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] The token cache is being invalidate because project 8deae58c4bcb4359808086704c9976c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:51.829346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:51.830400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:51.832852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 940/1890] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:51 2022] DELETE /identity/v3/projects/8deae58c4bcb4359808086704c9976c9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:51.836414 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:51.838404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:51.889043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee47456-63d6-480f-99cb-544e59fb3de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:51.889958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47456-63d6-480f-99cb-544e59fb3de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:51.890240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47456-63d6-480f-99cb-544e59fb3de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:51.892773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47456-63d6-480f-99cb-544e59fb3de7 admin admin] PATH_INFO: `/v3/projects/53d804b38cba4a5a9edb475974f12f2c/users/8070827bdf094184a4372ca1ffb0992b/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:51.926502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47456-63d6-480f-99cb-544e59fb3de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d804b38cba4a5a9edb475974f12f2c, user_id=8070827bdf094184a4372ca1ffb0992b, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:51.929420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47456-63d6-480f-99cb-544e59fb3de7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:51.949830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 951/1891] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:51 2022] PUT /identity/v3/projects/53d804b38cba4a5a9edb475974f12f2c/users/8070827bdf094184a4372ca1ffb0992b/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:51.962661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38cef-d38a-49fb-8ce4-453e6c60c35d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:51.965051 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f61faa-91e4-4eee-aa64-b41a2438d619 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:51.965575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f61faa-91e4-4eee-aa64-b41a2438d619 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:51.966180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f61faa-91e4-4eee-aa64-b41a2438d619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:51.969192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:52.019397 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e3f61faa-91e4-4eee-aa64-b41a2438d619 None None] MFA Rules not processed for user `8070827bdf094184a4372ca1ffb0992b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:52.020245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e3f61faa-91e4-4eee-aa64-b41a2438d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:52.116109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:52.119554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:52.119890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:52.120124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] PATH_INFO: `/v3/users/bafab436abe14947a9f2d1f642c44e30` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:52.123707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bafab436abe14947a9f2d1f642c44e30)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:52.127534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:52.133470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:52.178147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 952/1892] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:52.182901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f61faa-91e4-4eee-aa64-b41a2438d619 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:52.184388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e3f61faa-91e4-4eee-aa64-b41a2438d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:52.184985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bafab436abe14947a9f2d1f642c44e30'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:52.200522 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f61faa-91e4-4eee-aa64-b41a2438d619 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:52.201428 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bafab436abe14947a9f2d1f642c44e30'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:52.202188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bafab436abe14947a9f2d1f642c44e30'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:52.206335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73477472-46e0-4e1d-b8bf-00212bf8c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:52.207462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73477472-46e0-4e1d-b8bf-00212bf8c8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:52.207686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73477472-46e0-4e1d-b8bf-00212bf8c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:52.207968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73477472-46e0-4e1d-b8bf-00212bf8c8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:52.208853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73477472-46e0-4e1d-b8bf-00212bf8c8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:52.211611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73477472-46e0-4e1d-b8bf-00212bf8c8ca admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:52.212272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bafab436abe14947a9f2d1f642c44e30'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:52.213087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bafab436abe14947a9f2d1f642c44e30'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:52.227722 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 941/1893] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:51 2022] DELETE /identity/v3/users/bafab436abe14947a9f2d1f642c44e30 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:52.245609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 953/1894] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:52 2022] POST /identity/v3/projects => generated 391 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:09:52.249734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:52.252325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:52.335785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2836a-d25f-40f8-99d7-e0c88eeaa089 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:52.387873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:52.435927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdc187-a06e-4413-8fc6-939afe646422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:52.436625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdc187-a06e-4413-8fc6-939afe646422 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:52.436912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdc187-a06e-4413-8fc6-939afe646422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:52.437191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdc187-a06e-4413-8fc6-939afe646422 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:52.437965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdc187-a06e-4413-8fc6-939afe646422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:52.440029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdc187-a06e-4413-8fc6-939afe646422 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:52.462396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 942/1895] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:52 2022] POST /identity/v3/users => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:09:52.465232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73477472-46e0-4e1d-b8bf-00212bf8c8ca admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:52.476742 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73477472-46e0-4e1d-b8bf-00212bf8c8ca admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:52.481336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce37e2-3c09-4026-bbe2-8355e93268ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:52.481999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce37e2-3c09-4026-bbe2-8355e93268ea admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:52.482283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce37e2-3c09-4026-bbe2-8355e93268ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:52.482589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce37e2-3c09-4026-bbe2-8355e93268ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:52.483314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce37e2-3c09-4026-bbe2-8355e93268ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:52.484936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce37e2-3c09-4026-bbe2-8355e93268ea admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:52.496377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 954/1896] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:52.501300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdc187-a06e-4413-8fc6-939afe646422 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:52.511533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdc187-a06e-4413-8fc6-939afe646422 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:52.516379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050718-fe52-43fa-a277-e792c1a61a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:52.517274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050718-fe52-43fa-a277-e792c1a61a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:52.517564 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050718-fe52-43fa-a277-e792c1a61a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:52.517866 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050718-fe52-43fa-a277-e792c1a61a7e admin admin] PATH_INFO: `/v3/projects/23bd603b89ad4c6780eb937a1a23275b/users/0e8b50242db644dc98be6ad0e9b735a9/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:52.533817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1050718-fe52-43fa-a277-e792c1a61a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bd603b89ad4c6780eb937a1a23275b, user_id=0e8b50242db644dc98be6ad0e9b735a9, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:52.536609 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1050718-fe52-43fa-a277-e792c1a61a7e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:52.551498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 943/1897] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:52 2022] PUT /identity/v3/projects/23bd603b89ad4c6780eb937a1a23275b/users/0e8b50242db644dc98be6ad0e9b735a9/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:52.555616 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce37e2-3c09-4026-bbe2-8355e93268ea admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:52.565757 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce37e2-3c09-4026-bbe2-8355e93268ea admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:52.640389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050718-fe52-43fa-a277-e792c1a61a7e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:52.642928 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e1050718-fe52-43fa-a277-e792c1a61a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:52.667381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d52ad8-6c6e-4283-9800-a07b72780220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:52.668037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d52ad8-6c6e-4283-9800-a07b72780220 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:52.668326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d52ad8-6c6e-4283-9800-a07b72780220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:52.668603 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d52ad8-6c6e-4283-9800-a07b72780220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:52.669398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d52ad8-6c6e-4283-9800-a07b72780220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:52.671016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d52ad8-6c6e-4283-9800-a07b72780220 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:52.683046 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 955/1898] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:52.687444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d52ad8-6c6e-4283-9800-a07b72780220 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:52.700627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d52ad8-6c6e-4283-9800-a07b72780220 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:52.706550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4acf2-fba4-4bac-a672-61a678aab525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:52.707462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4acf2-fba4-4bac-a672-61a678aab525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:52.707748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4acf2-fba4-4bac-a672-61a678aab525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:52.708028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4acf2-fba4-4bac-a672-61a678aab525 admin admin] PATH_INFO: `/v3/projects/23bd603b89ad4c6780eb937a1a23275b/users/0e8b50242db644dc98be6ad0e9b735a9/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:52.710040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4acf2-fba4-4bac-a672-61a678aab525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bd603b89ad4c6780eb937a1a23275b, user_id=0e8b50242db644dc98be6ad0e9b735a9, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:52.712766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4acf2-fba4-4bac-a672-61a678aab525 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:52.724054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 956/1899] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:52 2022] PUT /identity/v3/projects/23bd603b89ad4c6780eb937a1a23275b/users/0e8b50242db644dc98be6ad0e9b735a9/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:52.734101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565370-c2ba-4853-8907-0de0ce4cb0df None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:52.734416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565370-c2ba-4853-8907-0de0ce4cb0df None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:52.734700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050718-fe52-43fa-a277-e792c1a61a7e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:52.735320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565370-c2ba-4853-8907-0de0ce4cb0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:52.765530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6c565370-c2ba-4853-8907-0de0ce4cb0df None None] MFA Rules not processed for user `0e8b50242db644dc98be6ad0e9b735a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:52.770412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6c565370-c2ba-4853-8907-0de0ce4cb0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:52.811788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:52.813575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:52.822484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:52.823368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f admin admin] PATH_INFO: `/v3/projects/7d4525e466274ba5bd0a2a3b53a3f0b9` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:52.825374 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4525e466274ba5bd0a2a3b53a3f0b9)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:52.827893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:52.853928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 957/1900] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:52.866562 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c565370-c2ba-4853-8907-0de0ce4cb0df None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:52.868170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6c565370-c2ba-4853-8907-0de0ce4cb0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:52.884585 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:52.884729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4525e466274ba5bd0a2a3b53a3f0b9', 'request_id': 'req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:52.885886 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:52.892237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4525e466274ba5bd0a2a3b53a3f0b9', 'request_id': 'req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:52.900524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4525e466274ba5bd0a2a3b53a3f0b9', 'request_id': 'req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:52.917898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f admin admin] The token cache is being invalidate because project 7d4525e466274ba5bd0a2a3b53a3f0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:52.918285 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:52.919229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b8727e18-6feb-4b0d-a1bb-a0fe997d741f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:52.920890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 944/1901] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:52 2022] DELETE /identity/v3/projects/7d4525e466274ba5bd0a2a3b53a3f0b9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:52.926475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc920c07-a712-416a-bb87-74011cb6e783 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:52.926742 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc920c07-a712-416a-bb87-74011cb6e783 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:52.927324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc920c07-a712-416a-bb87-74011cb6e783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:52.946121 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c565370-c2ba-4853-8907-0de0ce4cb0df None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:52.951158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-dc920c07-a712-416a-bb87-74011cb6e783 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:52.952354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dc920c07-a712-416a-bb87-74011cb6e783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:53.004743 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d5340-ce04-4ad1-b77e-6329aecefde0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:53.005430 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d5340-ce04-4ad1-b77e-6329aecefde0 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:53.005718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d5340-ce04-4ad1-b77e-6329aecefde0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:53.006000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d5340-ce04-4ad1-b77e-6329aecefde0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:53.007830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c19d5340-ce04-4ad1-b77e-6329aecefde0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:53.042974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 945/1902] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:53.051625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b219e-e1e4-454b-9254-7ced54613860 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:53.051943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b219e-e1e4-454b-9254-7ced54613860 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:53.052223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b219e-e1e4-454b-9254-7ced54613860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:53.072681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-593b219e-e1e4-454b-9254-7ced54613860 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:53.072681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-593b219e-e1e4-454b-9254-7ced54613860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:53.077577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d5340-ce04-4ad1-b77e-6329aecefde0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:53.079705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d5340-ce04-4ad1-b77e-6329aecefde0 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:53.082036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 946/1903] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:53.086164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b219e-e1e4-454b-9254-7ced54613860 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:53.090091 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 958/1904] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:53.098233 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b219e-e1e4-454b-9254-7ced54613860 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:53.104577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d771e2-14d4-4938-a5c3-87a9bdf019da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:53.105243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d771e2-14d4-4938-a5c3-87a9bdf019da admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:53.105697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d771e2-14d4-4938-a5c3-87a9bdf019da admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:53.105982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d771e2-14d4-4938-a5c3-87a9bdf019da admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:53.107092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d771e2-14d4-4938-a5c3-87a9bdf019da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:53.107678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d771e2-14d4-4938-a5c3-87a9bdf019da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:53.109439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d771e2-14d4-4938-a5c3-87a9bdf019da admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:53.123851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 947/1905] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:09:53.131775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d5340-ce04-4ad1-b77e-6329aecefde0 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:53.138557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d771e2-14d4-4938-a5c3-87a9bdf019da admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:53.140308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d6d771e2-14d4-4938-a5c3-87a9bdf019da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:53.143715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d5340-ce04-4ad1-b77e-6329aecefde0 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:53.148345 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aeb4b-6c13-4528-9c04-c7a1d3f855e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:53.150191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aeb4b-6c13-4528-9c04-c7a1d3f855e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:53.150191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aeb4b-6c13-4528-9c04-c7a1d3f855e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:53.150191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aeb4b-6c13-4528-9c04-c7a1d3f855e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:53.150502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aeb4b-6c13-4528-9c04-c7a1d3f855e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:53.152284 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aeb4b-6c13-4528-9c04-c7a1d3f855e0 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:53.155343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d771e2-14d4-4938-a5c3-87a9bdf019da admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:53.161713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7efed-2692-435b-9590-8397bdc618ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:53.161713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7efed-2692-435b-9590-8397bdc618ef service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:53.161713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7efed-2692-435b-9590-8397bdc618ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:53.161713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7efed-2692-435b-9590-8397bdc618ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:53.162951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cbd7efed-2692-435b-9590-8397bdc618ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:53.206164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 959/1906] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:53 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:53.207599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aeb4b-6c13-4528-9c04-c7a1d3f855e0 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:53.262480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7efed-2692-435b-9590-8397bdc618ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:53.264054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7efed-2692-435b-9590-8397bdc618ef service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:53.274525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 948/1907] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:53.295994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:53.300828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aeb4b-6c13-4528-9c04-c7a1d3f855e0 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:53.309717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f173b3-8318-4234-be55-17c56ed3bf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:53.310521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f173b3-8318-4234-be55-17c56ed3bf4f admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:53.310821 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f173b3-8318-4234-be55-17c56ed3bf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:53.311110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f173b3-8318-4234-be55-17c56ed3bf4f admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:53.312278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f173b3-8318-4234-be55-17c56ed3bf4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:53.315070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f173b3-8318-4234-be55-17c56ed3bf4f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:53.346465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 960/1908] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:53 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:53.351249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7efed-2692-435b-9590-8397bdc618ef service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:53.373560 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7efed-2692-435b-9590-8397bdc618ef service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:53.380563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dff0d9-54b4-4614-919d-3735bb4f3d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:53.381254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dff0d9-54b4-4614-919d-3735bb4f3d2f admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:53.381545 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dff0d9-54b4-4614-919d-3735bb4f3d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:53.381828 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dff0d9-54b4-4614-919d-3735bb4f3d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:53.382651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dff0d9-54b4-4614-919d-3735bb4f3d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:53.384315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dff0d9-54b4-4614-919d-3735bb4f3d2f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:53.399929 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 949/1909] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:53.401491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f173b3-8318-4234-be55-17c56ed3bf4f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:53.417692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f173b3-8318-4234-be55-17c56ed3bf4f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:53.427128 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0993174-dffe-45c0-8b93-9081a5b6ae8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:53.427828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0993174-dffe-45c0-8b93-9081a5b6ae8f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:53.428682 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0993174-dffe-45c0-8b93-9081a5b6ae8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:53.429096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0993174-dffe-45c0-8b93-9081a5b6ae8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:53.429867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0993174-dffe-45c0-8b93-9081a5b6ae8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:53.432348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0993174-dffe-45c0-8b93-9081a5b6ae8f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:53.449973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 961/1910] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:09:53.451889 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dff0d9-54b4-4614-919d-3735bb4f3d2f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:53.467844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dff0d9-54b4-4614-919d-3735bb4f3d2f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:53.478790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbb2a5-3666-4e0b-b2ea-959fd8f57483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:53.479841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb2a5-3666-4e0b-b2ea-959fd8f57483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:53.480331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb2a5-3666-4e0b-b2ea-959fd8f57483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:53.480722 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb2a5-3666-4e0b-b2ea-959fd8f57483 admin admin] PATH_INFO: `/v3/projects/1ad7b826dbf04d79868da0873d56995c/users/b194f1ebf7c34def8ece83569ae64f9f/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:53.505181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbb2a5-3666-4e0b-b2ea-959fd8f57483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad7b826dbf04d79868da0873d56995c, user_id=b194f1ebf7c34def8ece83569ae64f9f, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:53.509591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbb2a5-3666-4e0b-b2ea-959fd8f57483 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:53.528179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 950/1911] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:53 2022] PUT /identity/v3/projects/1ad7b826dbf04d79868da0873d56995c/users/b194f1ebf7c34def8ece83569ae64f9f/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:53.540672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7036abf-adc3-4510-bb68-2b72c380a838 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:53.541016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7036abf-adc3-4510-bb68-2b72c380a838 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:53.541305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7036abf-adc3-4510-bb68-2b72c380a838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:53.599707 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d7036abf-adc3-4510-bb68-2b72c380a838 None None] MFA Rules not processed for user `b194f1ebf7c34def8ece83569ae64f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:53.601370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d7036abf-adc3-4510-bb68-2b72c380a838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:53.787188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbb2a5-3666-4e0b-b2ea-959fd8f57483 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:53.787560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 962/1912] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:53.827033 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:53.879748 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbb2a5-3666-4e0b-b2ea-959fd8f57483 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:53.885854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b226f1-90ff-40ea-8531-88790c29faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:53.886776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b226f1-90ff-40ea-8531-88790c29faa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:53.887263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b226f1-90ff-40ea-8531-88790c29faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:53.887834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b226f1-90ff-40ea-8531-88790c29faa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:53.888855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b226f1-90ff-40ea-8531-88790c29faa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:53.891113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b226f1-90ff-40ea-8531-88790c29faa9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:53.931814 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 951/1913] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:53 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:53.936887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7036abf-adc3-4510-bb68-2b72c380a838 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:53.949308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7036abf-adc3-4510-bb68-2b72c380a838 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:54.036193 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194010fe-1e09-4060-83a6-49ba32d76951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:54.036897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194010fe-1e09-4060-83a6-49ba32d76951 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:54.038373 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194010fe-1e09-4060-83a6-49ba32d76951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:54.038756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194010fe-1e09-4060-83a6-49ba32d76951 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:54.039472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194010fe-1e09-4060-83a6-49ba32d76951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:54.046302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194010fe-1e09-4060-83a6-49ba32d76951 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:54.088114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 963/1914] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:53 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:54.092244 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b226f1-90ff-40ea-8531-88790c29faa9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:54.108156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b226f1-90ff-40ea-8531-88790c29faa9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:54.113210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac58ff-a748-46c7-a9ce-269a40ee3d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:54.113962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac58ff-a748-46c7-a9ce-269a40ee3d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:54.114178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac58ff-a748-46c7-a9ce-269a40ee3d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:54.114508 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac58ff-a748-46c7-a9ce-269a40ee3d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:54.115311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac58ff-a748-46c7-a9ce-269a40ee3d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:54.116937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac58ff-a748-46c7-a9ce-269a40ee3d31 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:54.136286 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 952/1915] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:54.138588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194010fe-1e09-4060-83a6-49ba32d76951 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:54.149716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194010fe-1e09-4060-83a6-49ba32d76951 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:54.158655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da735f-9cf4-4f54-9fce-5cf5549a9712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:54.158655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da735f-9cf4-4f54-9fce-5cf5549a9712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:54.158655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da735f-9cf4-4f54-9fce-5cf5549a9712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:54.158655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da735f-9cf4-4f54-9fce-5cf5549a9712 admin admin] PATH_INFO: `/v3/projects/6439089a9f6b43439236f86ec4467a13/users/fd7a0c201add4bb484b5fe890cd6a07c/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:54.180011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da735f-9cf4-4f54-9fce-5cf5549a9712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6439089a9f6b43439236f86ec4467a13, user_id=fd7a0c201add4bb484b5fe890cd6a07c, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:54.183480 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da735f-9cf4-4f54-9fce-5cf5549a9712 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:54.204850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 964/1916] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:54 2022] PUT /identity/v3/projects/6439089a9f6b43439236f86ec4467a13/users/fd7a0c201add4bb484b5fe890cd6a07c/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:54.209138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac58ff-a748-46c7-a9ce-269a40ee3d31 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:54.224199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac58ff-a748-46c7-a9ce-269a40ee3d31 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:54.325806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f201969-53c1-4e27-8620-6adf0878f3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:54.326586 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f201969-53c1-4e27-8620-6adf0878f3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:54.326873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f201969-53c1-4e27-8620-6adf0878f3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:54.327199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f201969-53c1-4e27-8620-6adf0878f3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:54.327991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f201969-53c1-4e27-8620-6adf0878f3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:54.330649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f201969-53c1-4e27-8620-6adf0878f3c8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:54.345748 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 953/1917] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:54.347424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da735f-9cf4-4f54-9fce-5cf5549a9712 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:54.368994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da735f-9cf4-4f54-9fce-5cf5549a9712 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:54.377297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113f137-e86b-4e5f-b9a2-0a4d1ab86939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:54.378713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113f137-e86b-4e5f-b9a2-0a4d1ab86939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:54.379049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113f137-e86b-4e5f-b9a2-0a4d1ab86939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:54.379387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113f137-e86b-4e5f-b9a2-0a4d1ab86939 admin admin] PATH_INFO: `/v3/projects/6439089a9f6b43439236f86ec4467a13/users/fd7a0c201add4bb484b5fe890cd6a07c/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:54.382759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113f137-e86b-4e5f-b9a2-0a4d1ab86939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6439089a9f6b43439236f86ec4467a13, user_id=fd7a0c201add4bb484b5fe890cd6a07c, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:54.389220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113f137-e86b-4e5f-b9a2-0a4d1ab86939 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:54.406134 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 965/1918] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:54 2022] PUT /identity/v3/projects/6439089a9f6b43439236f86ec4467a13/users/fd7a0c201add4bb484b5fe890cd6a07c/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:54.417474 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b110b-63b7-46a5-bbce-8f9c19082638 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:54.418158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b110b-63b7-46a5-bbce-8f9c19082638 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:54.418541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b110b-63b7-46a5-bbce-8f9c19082638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:54.449168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-bf4b110b-63b7-46a5-bbce-8f9c19082638 None None] MFA Rules not processed for user `fd7a0c201add4bb484b5fe890cd6a07c`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:54.450514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bf4b110b-63b7-46a5-bbce-8f9c19082638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:54.526916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 954/1919] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:54.539174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113f137-e86b-4e5f-b9a2-0a4d1ab86939 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:54.559445 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:54.602429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113f137-e86b-4e5f-b9a2-0a4d1ab86939 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:54.606173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f54fd-8575-4e84-b841-629183fe49a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:54.606964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f54fd-8575-4e84-b841-629183fe49a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:54.607313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f54fd-8575-4e84-b841-629183fe49a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:54.607658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f54fd-8575-4e84-b841-629183fe49a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:54.667446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f54fd-8575-4e84-b841-629183fe49a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:54.669129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f54fd-8575-4e84-b841-629183fe49a0 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:54.679217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 966/1920] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:56.647545 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b110b-63b7-46a5-bbce-8f9c19082638 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:56.649086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bf4b110b-63b7-46a5-bbce-8f9c19082638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:56.673786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:56.747002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b110b-63b7-46a5-bbce-8f9c19082638 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:56.751864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:56.752734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:56.753019 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:56.753296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] PATH_INFO: `/v3/users/ba36792325794bbe8851a0d7971934e4` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:56.754513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba36792325794bbe8851a0d7971934e4)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:56.756529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:56.811720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba36792325794bbe8851a0d7971934e4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:56.825009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba36792325794bbe8851a0d7971934e4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:56.825725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba36792325794bbe8851a0d7971934e4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:56.834453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba36792325794bbe8851a0d7971934e4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:56.835191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba36792325794bbe8851a0d7971934e4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:56.849040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 955/1921] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:56 2022] DELETE /identity/v3/users/ba36792325794bbe8851a0d7971934e4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:56.854057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3631bb2-e131-4d80-bdbf-f9fcba3832f6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:56.854057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3631bb2-e131-4d80-bdbf-f9fcba3832f6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:56.854758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3631bb2-e131-4d80-bdbf-f9fcba3832f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:56.878205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c3631bb2-e131-4d80-bdbf-f9fcba3832f6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:56.880042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c3631bb2-e131-4d80-bdbf-f9fcba3832f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:56.962005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 967/1922] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:56.973666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:56.975455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:57.052232 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a6d9c-4231-4656-a726-3d07faf6a380 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:57.056336 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a7a4f-22ca-4673-90f2-25a5147207cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:57.057196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a7a4f-22ca-4673-90f2-25a5147207cc service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:57.057489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a7a4f-22ca-4673-90f2-25a5147207cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:57.058262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a7a4f-22ca-4673-90f2-25a5147207cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:57.070590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a7a4f-22ca-4673-90f2-25a5147207cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:57.078082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a7a4f-22ca-4673-90f2-25a5147207cc service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:57.110126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 956/1923] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:57.135350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3631bb2-e131-4d80-bdbf-f9fcba3832f6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:57.137033 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c3631bb2-e131-4d80-bdbf-f9fcba3832f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:57.156220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3631bb2-e131-4d80-bdbf-f9fcba3832f6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:57.168264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2476-5882-4cda-85d9-4d599662d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:57.169557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2476-5882-4cda-85d9-4d599662d7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:57.171354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2476-5882-4cda-85d9-4d599662d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:57.172812 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2476-5882-4cda-85d9-4d599662d7b9 admin admin] PATH_INFO: `/v3/users/8070827bdf094184a4372ca1ffb0992b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:57.178074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2476-5882-4cda-85d9-4d599662d7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8070827bdf094184a4372ca1ffb0992b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:57.185197 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2476-5882-4cda-85d9-4d599662d7b9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:57.284392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b05b2476-5882-4cda-85d9-4d599662d7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8070827bdf094184a4372ca1ffb0992b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:57.285389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b05b2476-5882-4cda-85d9-4d599662d7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8070827bdf094184a4372ca1ffb0992b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:57.294505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a7a4f-22ca-4673-90f2-25a5147207cc service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:57.296227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-469a7a4f-22ca-4673-90f2-25a5147207cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:57.315874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b05b2476-5882-4cda-85d9-4d599662d7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8070827bdf094184a4372ca1ffb0992b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:57.316516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a7a4f-22ca-4673-90f2-25a5147207cc service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:57.322756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:57.325172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:57.326611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:57.327109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] PATH_INFO: `/v3/users/b194f1ebf7c34def8ece83569ae64f9f` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:57.329479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b194f1ebf7c34def8ece83569ae64f9f)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:57.333404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:57.347938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b05b2476-5882-4cda-85d9-4d599662d7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8070827bdf094184a4372ca1ffb0992b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:57.348705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b05b2476-5882-4cda-85d9-4d599662d7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8070827bdf094184a4372ca1ffb0992b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:57.354516 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:57.390008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 968/1924] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:57 2022] DELETE /identity/v3/users/8070827bdf094184a4372ca1ffb0992b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:57.395610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f520c7-1340-4f2b-bdf7-881a93e98dde None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:57.396036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f520c7-1340-4f2b-bdf7-881a93e98dde None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:57.396332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f520c7-1340-4f2b-bdf7-881a93e98dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:57.414019 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:57.426011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-47f520c7-1340-4f2b-bdf7-881a93e98dde None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:57.428439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-47f520c7-1340-4f2b-bdf7-881a93e98dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:57.466434 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b194f1ebf7c34def8ece83569ae64f9f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:57.495463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b194f1ebf7c34def8ece83569ae64f9f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:57.496144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b194f1ebf7c34def8ece83569ae64f9f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:57.512834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b194f1ebf7c34def8ece83569ae64f9f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:57.513675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b194f1ebf7c34def8ece83569ae64f9f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:57.524772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 969/1925] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:57.537590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 957/1926] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:57 2022] DELETE /identity/v3/users/b194f1ebf7c34def8ece83569ae64f9f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:57.539360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fa5bf-374b-4031-9a56-3b7fc9edee99 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:57.539817 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fa5bf-374b-4031-9a56-3b7fc9edee99 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:57.540116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fa5bf-374b-4031-9a56-3b7fc9edee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:57.559804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-bb5fa5bf-374b-4031-9a56-3b7fc9edee99 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:57.560996 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bb5fa5bf-374b-4031-9a56-3b7fc9edee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:57.565282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:57.566730 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:57.671218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba552a22-585a-4cd1-abb8-e41840ad0237 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:57.680152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5f295-9b32-42d6-9a7c-d6fbdd7bd0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:57.682598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f295-9b32-42d6-9a7c-d6fbdd7bd0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:57.683488 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f295-9b32-42d6-9a7c-d6fbdd7bd0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:57.684073 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f295-9b32-42d6-9a7c-d6fbdd7bd0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:57.697755 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 970/1927] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:09:57.699015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5f295-9b32-42d6-9a7c-d6fbdd7bd0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:57.701910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5f295-9b32-42d6-9a7c-d6fbdd7bd0e5 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:57.709130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fa5bf-374b-4031-9a56-3b7fc9edee99 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:57.711462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bb5fa5bf-374b-4031-9a56-3b7fc9edee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:57.716382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 958/1928] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:57.726908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fa5bf-374b-4031-9a56-3b7fc9edee99 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:57.731794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ff55b-fa77-4ea2-bd8c-0d6ce482e601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:57.732828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ff55b-fa77-4ea2-bd8c-0d6ce482e601 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:57.733337 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ff55b-fa77-4ea2-bd8c-0d6ce482e601 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:57.733654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ff55b-fa77-4ea2-bd8c-0d6ce482e601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:57.745875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ff55b-fa77-4ea2-bd8c-0d6ce482e601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:57.747267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ff55b-fa77-4ea2-bd8c-0d6ce482e601 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:57.758598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 971/1929] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:58.087773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5f295-9b32-42d6-9a7c-d6fbdd7bd0e5 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:58.089484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fef5f295-9b32-42d6-9a7c-d6fbdd7bd0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:58.112620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5f295-9b32-42d6-9a7c-d6fbdd7bd0e5 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:58.119217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:58.120277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:58.120701 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:58.121020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] PATH_INFO: `/v3/projects/1ad7b826dbf04d79868da0873d56995c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:58.122482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad7b826dbf04d79868da0873d56995c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:58.124530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:58.220666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad7b826dbf04d79868da0873d56995c', 'request_id': 'req-3c942d53-daa8-4b8f-a07f-c79e21564851'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.228183 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad7b826dbf04d79868da0873d56995c', 'request_id': 'req-3c942d53-daa8-4b8f-a07f-c79e21564851'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.238778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad7b826dbf04d79868da0873d56995c', 'request_id': 'req-3c942d53-daa8-4b8f-a07f-c79e21564851'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.270236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] The token cache is being invalidate because project 1ad7b826dbf04d79868da0873d56995c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:58.270859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.271754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.273557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 959/1930] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:58 2022] DELETE /identity/v3/projects/1ad7b826dbf04d79868da0873d56995c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:58.277606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ff55b-fa77-4ea2-bd8c-0d6ce482e601 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:58.286566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:58.288261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:58.292057 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ff55b-fa77-4ea2-bd8c-0d6ce482e601 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:58.347071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:58.416650 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942d53-daa8-4b8f-a07f-c79e21564851 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:58.431500 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0467d-14d0-41b4-97c7-d64049df55cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:58.432391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0467d-14d0-41b4-97c7-d64049df55cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:58.432881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0467d-14d0-41b4-97c7-d64049df55cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:58.433170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0467d-14d0-41b4-97c7-d64049df55cf admin admin] PATH_INFO: `/v3/projects/974750b90ab84866a9767f76895d6ad0` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:58.437691 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0467d-14d0-41b4-97c7-d64049df55cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=974750b90ab84866a9767f76895d6ad0)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:58.440981 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0467d-14d0-41b4-97c7-d64049df55cf admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:58.475281 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:58.476184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:58.476472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:58.476750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] PATH_INFO: `/v3/users/fd7a0c201add4bb484b5fe890cd6a07c` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:58.483846 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7a0c201add4bb484b5fe890cd6a07c)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:58.486597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:58.515505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:58.552870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b9f0467d-14d0-41b4-97c7-d64049df55cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '974750b90ab84866a9767f76895d6ad0', 'request_id': 'req-b9f0467d-14d0-41b4-97c7-d64049df55cf'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.573047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b9f0467d-14d0-41b4-97c7-d64049df55cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '974750b90ab84866a9767f76895d6ad0', 'request_id': 'req-b9f0467d-14d0-41b4-97c7-d64049df55cf'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.583200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7a0c201add4bb484b5fe890cd6a07c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.584571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7a0c201add4bb484b5fe890cd6a07c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.597807 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b9f0467d-14d0-41b4-97c7-d64049df55cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '974750b90ab84866a9767f76895d6ad0', 'request_id': 'req-b9f0467d-14d0-41b4-97c7-d64049df55cf'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.602396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7a0c201add4bb484b5fe890cd6a07c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.622793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7a0c201add4bb484b5fe890cd6a07c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.623090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b9f0467d-14d0-41b4-97c7-d64049df55cf admin admin] The token cache is being invalidate because project 974750b90ab84866a9767f76895d6ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:58.623616 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7a0c201add4bb484b5fe890cd6a07c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.623723 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b9f0467d-14d0-41b4-97c7-d64049df55cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.624736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b9f0467d-14d0-41b4-97c7-d64049df55cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.628039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 960/1931] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:58 2022] DELETE /identity/v3/projects/974750b90ab84866a9767f76895d6ad0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:58.633557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f681cc-6605-49f3-bc0d-2ea3f14c33a5 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:58.635709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f681cc-6605-49f3-bc0d-2ea3f14c33a5 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:58.636205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f681cc-6605-49f3-bc0d-2ea3f14c33a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:58.665140 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f7f681cc-6605-49f3-bc0d-2ea3f14c33a5 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:58.666499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f7f681cc-6605-49f3-bc0d-2ea3f14c33a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:58.676730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 972/1932] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:58 2022] DELETE /identity/v3/users/fd7a0c201add4bb484b5fe890cd6a07c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:58.678807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:58.681939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:58.822471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 961/1933] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:58.824142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31769353-49d2-4f2d-ac13-db7eb11f067b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:58.824535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31769353-49d2-4f2d-ac13-db7eb11f067b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:58.824977 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31769353-49d2-4f2d-ac13-db7eb11f067b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:58.837033 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b6702-4c1b-419d-9a43-3123d1ba42dd admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:58.842742 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:58.846521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:58.846871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:58.847164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] PATH_INFO: `/v3/projects/53d804b38cba4a5a9edb475974f12f2c` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:58.847688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-31769353-49d2-4f2d-ac13-db7eb11f067b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:58.848633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d804b38cba4a5a9edb475974f12f2c)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:58.849167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-31769353-49d2-4f2d-ac13-db7eb11f067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:58.850822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:58.859500 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 962/1934] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:58.865004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31769353-49d2-4f2d-ac13-db7eb11f067b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:58.876853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31769353-49d2-4f2d-ac13-db7eb11f067b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:58.883058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c1a9-534e-4f3e-9549-4448a0cd5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:58.884230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c1a9-534e-4f3e-9549-4448a0cd5289 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:58.884593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c1a9-534e-4f3e-9549-4448a0cd5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:58.884947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c1a9-534e-4f3e-9549-4448a0cd5289 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:58.886254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c1a9-534e-4f3e-9549-4448a0cd5289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:58.886673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c1a9-534e-4f3e-9549-4448a0cd5289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:58.888539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c1a9-534e-4f3e-9549-4448a0cd5289 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:58.911552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 963/1935] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:09:58.912742 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c1a9-534e-4f3e-9549-4448a0cd5289 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:58.930127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c1a9-534e-4f3e-9549-4448a0cd5289 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:58.950159 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d804b38cba4a5a9edb475974f12f2c', 'request_id': 'req-770d9319-06da-4453-9bc5-8ba2f4b3f700'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.963920 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d804b38cba4a5a9edb475974f12f2c', 'request_id': 'req-770d9319-06da-4453-9bc5-8ba2f4b3f700'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.973840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d804b38cba4a5a9edb475974f12f2c', 'request_id': 'req-770d9319-06da-4453-9bc5-8ba2f4b3f700'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.989710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:58.990209 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] The token cache is being invalidate because project 53d804b38cba4a5a9edb475974f12f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:58.990868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.991335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:58.993946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 973/1936] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:58 2022] DELETE /identity/v3/projects/53d804b38cba4a5a9edb475974f12f2c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:58.998689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:59.000343 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:59.013040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f536e-f1c9-4ed8-b897-efeb1aa41bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:59.014525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f536e-f1c9-4ed8-b897-efeb1aa41bfc admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:59.015357 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f536e-f1c9-4ed8-b897-efeb1aa41bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:59.016441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f536e-f1c9-4ed8-b897-efeb1aa41bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:59.018649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f536e-f1c9-4ed8-b897-efeb1aa41bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:59.020877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f536e-f1c9-4ed8-b897-efeb1aa41bfc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:59.045521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:59.060843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 964/1937] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:58 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:59.066182 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f536e-f1c9-4ed8-b897-efeb1aa41bfc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:59.068186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6e6f536e-f1c9-4ed8-b897-efeb1aa41bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:59.110419 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9319-06da-4453-9bc5-8ba2f4b3f700 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:59.178192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:59.179273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:59.179795 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:59.180323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] PATH_INFO: `/v3/users/0e8b50242db644dc98be6ad0e9b735a9` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:59.181854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8b50242db644dc98be6ad0e9b735a9)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:59.193537 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:59.193666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f536e-f1c9-4ed8-b897-efeb1aa41bfc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:59.198449 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b0bb1-bae3-4259-90ed-d7e0e38df259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:59.199471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b0bb1-bae3-4259-90ed-d7e0e38df259 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:59.199649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b0bb1-bae3-4259-90ed-d7e0e38df259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:59.199933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b0bb1-bae3-4259-90ed-d7e0e38df259 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:59.200700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b0bb1-bae3-4259-90ed-d7e0e38df259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:59.203414 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b0bb1-bae3-4259-90ed-d7e0e38df259 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:59.229808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 965/1938] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:09:59 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:59.240097 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b0bb1-bae3-4259-90ed-d7e0e38df259 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:59.252837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b0bb1-bae3-4259-90ed-d7e0e38df259 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:59.258576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032eb65a-a359-4114-a2ba-d9c953812201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:59.259362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eb65a-a359-4114-a2ba-d9c953812201 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:59.260502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eb65a-a359-4114-a2ba-d9c953812201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:59.260801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eb65a-a359-4114-a2ba-d9c953812201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:59.261787 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032eb65a-a359-4114-a2ba-d9c953812201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:59.263818 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032eb65a-a359-4114-a2ba-d9c953812201 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:59.265302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8b50242db644dc98be6ad0e9b735a9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:59.266822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8b50242db644dc98be6ad0e9b735a9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:59.276465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8b50242db644dc98be6ad0e9b735a9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:59.288396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8b50242db644dc98be6ad0e9b735a9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:59.290718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8b50242db644dc98be6ad0e9b735a9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:59.295808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 966/1939] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:09:59.300092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032eb65a-a359-4114-a2ba-d9c953812201 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:59.302641 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-032eb65a-a359-4114-a2ba-d9c953812201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:59.316905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 974/1940] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:09:58 2022] DELETE /identity/v3/users/0e8b50242db644dc98be6ad0e9b735a9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:59.322688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032eb65a-a359-4114-a2ba-d9c953812201 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:59.467685 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee555e5b-2df9-4f63-965b-9ba84d3ad899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:59.468380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee555e5b-2df9-4f63-965b-9ba84d3ad899 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:59.468674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee555e5b-2df9-4f63-965b-9ba84d3ad899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:59.470469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee555e5b-2df9-4f63-965b-9ba84d3ad899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:59.471264 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee555e5b-2df9-4f63-965b-9ba84d3ad899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:59.472896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee555e5b-2df9-4f63-965b-9ba84d3ad899 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:59.477015 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:59.479351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:59.501353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 967/1941] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:09:59.506790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee555e5b-2df9-4f63-965b-9ba84d3ad899 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:59.513381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9c99b-585f-4d5e-8649-1bbef98377e6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:59.520847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:59.522073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:59.522528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:59.522886 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc admin admin] PATH_INFO: `/v3/projects/6439089a9f6b43439236f86ec4467a13` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:59.525500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6439089a9f6b43439236f86ec4467a13)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:59.527609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:59.541098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee555e5b-2df9-4f63-965b-9ba84d3ad899 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:59.558344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ba6f0-a03d-49f7-ae24-8f8fbebb3d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:59.559338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ba6f0-a03d-49f7-ae24-8f8fbebb3d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:59.559816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ba6f0-a03d-49f7-ae24-8f8fbebb3d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:59.559913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ba6f0-a03d-49f7-ae24-8f8fbebb3d5f admin admin] PATH_INFO: `/v3/projects/5683d1f6367b4d57ab2f081cad752bc1/users/914015cbd40c41cfa81bc3477e0072d5/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:59.584077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ba6f0-a03d-49f7-ae24-8f8fbebb3d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5683d1f6367b4d57ab2f081cad752bc1, user_id=914015cbd40c41cfa81bc3477e0072d5, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:59.587480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ba6f0-a03d-49f7-ae24-8f8fbebb3d5f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:59.604887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:59.611342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6439089a9f6b43439236f86ec4467a13', 'request_id': 'req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:59.611724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 968/1942] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:09:59 2022] PUT /identity/v3/projects/5683d1f6367b4d57ab2f081cad752bc1/users/914015cbd40c41cfa81bc3477e0072d5/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:09:59.622159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4937fb7-e9dc-4eac-ad5e-906b407f22b0 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:59.622670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4937fb7-e9dc-4eac-ad5e-906b407f22b0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:59.623151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4937fb7-e9dc-4eac-ad5e-906b407f22b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:59.624517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6439089a9f6b43439236f86ec4467a13', 'request_id': 'req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:59.633505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6439089a9f6b43439236f86ec4467a13', 'request_id': 'req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:59.646316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc admin admin] The token cache is being invalidate because project 6439089a9f6b43439236f86ec4467a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:09:59.646780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:59.647757 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a8a616-bc8a-4e08-8620-8b0fb021c9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:09:59.654557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 975/1943] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:59 2022] DELETE /identity/v3/projects/6439089a9f6b43439236f86ec4467a13 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:09:59.656177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680c0b4-e5dc-48ad-b025-2e84231c0b71 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:59.656700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680c0b4-e5dc-48ad-b025-2e84231c0b71 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:59.657194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680c0b4-e5dc-48ad-b025-2e84231c0b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:59.681918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1680c0b4-e5dc-48ad-b025-2e84231c0b71 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:59.683592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1680c0b4-e5dc-48ad-b025-2e84231c0b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:59.685480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d4937fb7-e9dc-4eac-ad5e-906b407f22b0 None None] MFA Rules not processed for user `914015cbd40c41cfa81bc3477e0072d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:59.687217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d4937fb7-e9dc-4eac-ad5e-906b407f22b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:59.720969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:59.764118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 976/1944] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:59.765702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25360e-9181-4562-888c-394955634760 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:59.766036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25360e-9181-4562-888c-394955634760 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:59.766328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25360e-9181-4562-888c-394955634760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:59.812444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2a25360e-9181-4562-888c-394955634760 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:59.814150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2a25360e-9181-4562-888c-394955634760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:59.832793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 977/1945] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:59.832793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25360e-9181-4562-888c-394955634760 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:59.840209 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 969/1946] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:59.842255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25360e-9181-4562-888c-394955634760 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:59.864949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc0d13-b9d9-4c11-8da3-0ad48a08605f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:59.865653 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc0d13-b9d9-4c11-8da3-0ad48a08605f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:59.866101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc0d13-b9d9-4c11-8da3-0ad48a08605f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:59.866411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc0d13-b9d9-4c11-8da3-0ad48a08605f admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:59.867164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc0d13-b9d9-4c11-8da3-0ad48a08605f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:09:59.867623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc0d13-b9d9-4c11-8da3-0ad48a08605f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:59.869555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4937fb7-e9dc-4eac-ad5e-906b407f22b0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:59.870232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc0d13-b9d9-4c11-8da3-0ad48a08605f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:59.871333 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d4937fb7-e9dc-4eac-ad5e-906b407f22b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:59.888067 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 978/1947] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:09:59.892462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc0d13-b9d9-4c11-8da3-0ad48a08605f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:59.903190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc0d13-b9d9-4c11-8da3-0ad48a08605f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:59.920637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c80a45-73ad-4efa-940b-8aa231d7521f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:59.921321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c80a45-73ad-4efa-940b-8aa231d7521f admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:59.921606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c80a45-73ad-4efa-940b-8aa231d7521f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:59.921886 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c80a45-73ad-4efa-940b-8aa231d7521f admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:59.923283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c80a45-73ad-4efa-940b-8aa231d7521f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:59.925183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c80a45-73ad-4efa-940b-8aa231d7521f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:59.957240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 979/1948] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:09:59 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:09:59.958450 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c80a45-73ad-4efa-940b-8aa231d7521f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:59.961753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-40c80a45-73ad-4efa-940b-8aa231d7521f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:59.963215 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4937fb7-e9dc-4eac-ad5e-906b407f22b0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.029121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f5716-354d-40a0-aa00-9598acfe80d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.030407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f5716-354d-40a0-aa00-9598acfe80d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.031261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f5716-354d-40a0-aa00-9598acfe80d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.031261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f5716-354d-40a0-aa00-9598acfe80d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.034018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c80a45-73ad-4efa-940b-8aa231d7521f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.039244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.040118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.040404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.040684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed admin admin] PATH_INFO: `/v3/projects/23bd603b89ad4c6780eb937a1a23275b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.041885 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=23bd603b89ad4c6780eb937a1a23275b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.044163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.085447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:00.102116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23bd603b89ad4c6780eb937a1a23275b', 'request_id': 'req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:00.104732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f5716-354d-40a0-aa00-9598acfe80d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.106345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f5716-354d-40a0-aa00-9598acfe80d4 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.112154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23bd603b89ad4c6780eb937a1a23275b', 'request_id': 'req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:00.118309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 970/1949] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:09:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:00.119218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f5716-354d-40a0-aa00-9598acfe80d4 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:00.122938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23bd603b89ad4c6780eb937a1a23275b', 'request_id': 'req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:00.131898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f5716-354d-40a0-aa00-9598acfe80d4 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.138767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed admin admin] The token cache is being invalidate because project 23bd603b89ad4c6780eb937a1a23275b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:00.139075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:00.139817 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-65c2576b-01c2-4ddb-ae36-b5b3f031d7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:00.141518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 980/1950] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:09:59 2022] DELETE /identity/v3/projects/23bd603b89ad4c6780eb937a1a23275b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:00.146173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65250ac-3ab9-4f60-88e7-f16bc5278973 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.146556 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65250ac-3ab9-4f60-88e7-f16bc5278973 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.146775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65250ac-3ab9-4f60-88e7-f16bc5278973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.158664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:00.167468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b65250ac-3ab9-4f60-88e7-f16bc5278973 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:00.168870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b65250ac-3ab9-4f60-88e7-f16bc5278973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:00.217906 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08944a-e191-49c4-81d1-4788b5d641c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.219620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08944a-e191-49c4-81d1-4788b5d641c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.220150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08944a-e191-49c4-81d1-4788b5d641c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.220628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08944a-e191-49c4-81d1-4788b5d641c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.221359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08944a-e191-49c4-81d1-4788b5d641c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.223489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08944a-e191-49c4-81d1-4788b5d641c0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.239720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 981/1951] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:00.254652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 971/1952] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:00 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:00.260161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3266892-3c71-4404-8f38-132473b20c49 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.260344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08944a-e191-49c4-81d1-4788b5d641c0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:00.260532 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3266892-3c71-4404-8f38-132473b20c49 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.262587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6d08944a-e191-49c4-81d1-4788b5d641c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:00.262854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3266892-3c71-4404-8f38-132473b20c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.279638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08944a-e191-49c4-81d1-4788b5d641c0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.288553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10008cc-dec5-48d1-9b8d-cfe132aa2b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.291485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10008cc-dec5-48d1-9b8d-cfe132aa2b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.292100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10008cc-dec5-48d1-9b8d-cfe132aa2b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.292394 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10008cc-dec5-48d1-9b8d-cfe132aa2b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.293301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10008cc-dec5-48d1-9b8d-cfe132aa2b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.295207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10008cc-dec5-48d1-9b8d-cfe132aa2b2c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.299211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a3266892-3c71-4404-8f38-132473b20c49 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:00.300528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a3266892-3c71-4404-8f38-132473b20c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:00.308361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 972/1953] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:00.314767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 982/1954] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:00.318304 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10008cc-dec5-48d1-9b8d-cfe132aa2b2c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:00.319490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3266892-3c71-4404-8f38-132473b20c49 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:00.329429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10008cc-dec5-48d1-9b8d-cfe132aa2b2c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.334333 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccfa7c-dfeb-4462-adb8-cc8e5eea2d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.335095 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccfa7c-dfeb-4462-adb8-cc8e5eea2d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.335423 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccfa7c-dfeb-4462-adb8-cc8e5eea2d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.335711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccfa7c-dfeb-4462-adb8-cc8e5eea2d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.336388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccfa7c-dfeb-4462-adb8-cc8e5eea2d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.338187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccfa7c-dfeb-4462-adb8-cc8e5eea2d87 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.340624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3266892-3c71-4404-8f38-132473b20c49 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.348203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f97479-16a2-40e8-8526-713d4ec22114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.349420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f97479-16a2-40e8-8526-713d4ec22114 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.349858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f97479-16a2-40e8-8526-713d4ec22114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.350667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f97479-16a2-40e8-8526-713d4ec22114 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.351502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 973/1955] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:00.354662 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f97479-16a2-40e8-8526-713d4ec22114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:10:00.355113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f97479-16a2-40e8-8526-713d4ec22114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.356306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccfa7c-dfeb-4462-adb8-cc8e5eea2d87 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:00.360528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f97479-16a2-40e8-8526-713d4ec22114 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.370933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccfa7c-dfeb-4462-adb8-cc8e5eea2d87 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.376058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc107d18-d681-46fc-b577-1a7f99fb587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.377246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107d18-d681-46fc-b577-1a7f99fb587b admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.377628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107d18-d681-46fc-b577-1a7f99fb587b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.378002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107d18-d681-46fc-b577-1a7f99fb587b admin admin] PATH_INFO: `/v3/projects/e9849f743c8f48f3bb9123bfc27cf4f4/users/877193a60bc24251a1df3de5bb563212/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.382292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 983/1956] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:10:00.388773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f97479-16a2-40e8-8526-713d4ec22114 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:00.398765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc107d18-d681-46fc-b577-1a7f99fb587b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9849f743c8f48f3bb9123bfc27cf4f4, user_id=877193a60bc24251a1df3de5bb563212, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.401956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc107d18-d681-46fc-b577-1a7f99fb587b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.405021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f97479-16a2-40e8-8526-713d4ec22114 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.412112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74596472-8df1-487f-9558-382093998a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.412972 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74596472-8df1-487f-9558-382093998a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.413328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74596472-8df1-487f-9558-382093998a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.413615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74596472-8df1-487f-9558-382093998a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.414675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74596472-8df1-487f-9558-382093998a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.416864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74596472-8df1-487f-9558-382093998a11 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.422642 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 974/1957] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:00 2022] PUT /identity/v3/projects/e9849f743c8f48f3bb9123bfc27cf4f4/users/877193a60bc24251a1df3de5bb563212/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:00.433626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55b73c-c099-42ab-bab3-2b2891b171e2 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.433918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55b73c-c099-42ab-bab3-2b2891b171e2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.434197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55b73c-c099-42ab-bab3-2b2891b171e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.467915 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-1e55b73c-c099-42ab-bab3-2b2891b171e2 None None] MFA Rules not processed for user `877193a60bc24251a1df3de5bb563212`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:00.470532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1e55b73c-c099-42ab-bab3-2b2891b171e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:00.479857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 984/1958] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:00 2022] POST /identity/v3/projects => generated 363 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:10:00.481014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74596472-8df1-487f-9558-382093998a11 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:00.560481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 975/1959] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:00.582009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55b73c-c099-42ab-bab3-2b2891b171e2 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:00.584555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1e55b73c-c099-42ab-bab3-2b2891b171e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:00.590985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74596472-8df1-487f-9558-382093998a11 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.597746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104074e8-5f1b-4e10-9188-218a2d9ade9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.598261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104074e8-5f1b-4e10-9188-218a2d9ade9d admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.598686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104074e8-5f1b-4e10-9188-218a2d9ade9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.599048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104074e8-5f1b-4e10-9188-218a2d9ade9d admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.599793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104074e8-5f1b-4e10-9188-218a2d9ade9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.601736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104074e8-5f1b-4e10-9188-218a2d9ade9d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.640603 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 985/1960] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:00 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:00.646475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104074e8-5f1b-4e10-9188-218a2d9ade9d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:00.658492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104074e8-5f1b-4e10-9188-218a2d9ade9d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.663989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ff053-718d-4767-a122-18872b19822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.664863 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ff053-718d-4767-a122-18872b19822d admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.665172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ff053-718d-4767-a122-18872b19822d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.665628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ff053-718d-4767-a122-18872b19822d admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.666501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ff053-718d-4767-a122-18872b19822d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.668334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ff053-718d-4767-a122-18872b19822d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.670745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:00.676734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55b73c-c099-42ab-bab3-2b2891b171e2 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.687036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 986/1961] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:00.688221 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ff053-718d-4767-a122-18872b19822d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:00.696384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:00.700850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ff053-718d-4767-a122-18872b19822d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.708120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa48bfd-431d-4538-8dc4-81e5ee945e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.708547 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa48bfd-431d-4538-8dc4-81e5ee945e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.708949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa48bfd-431d-4538-8dc4-81e5ee945e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.709972 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa48bfd-431d-4538-8dc4-81e5ee945e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.710629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa48bfd-431d-4538-8dc4-81e5ee945e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.712470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa48bfd-431d-4538-8dc4-81e5ee945e34 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.728130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 987/1962] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:00.733831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa48bfd-431d-4538-8dc4-81e5ee945e34 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:00.749436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa48bfd-431d-4538-8dc4-81e5ee945e34 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:00.755236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed4dd-2087-4385-a871-77ea0b297ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.766402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed4dd-2087-4385-a871-77ea0b297ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.766857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed4dd-2087-4385-a871-77ea0b297ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.769058 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed4dd-2087-4385-a871-77ea0b297ee0 admin admin] PATH_INFO: `/v3/projects/4754fb438a0f4a8d909069bc2f71360d/users/bb77707dadf14555a6d2389fc5c12d71/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.789799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412fed3-303c-4d40-9adf-6e0525dd06b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:00.790775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412fed3-303c-4d40-9adf-6e0525dd06b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.791246 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed4dd-2087-4385-a871-77ea0b297ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4754fb438a0f4a8d909069bc2f71360d, user_id=bb77707dadf14555a6d2389fc5c12d71, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.791660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412fed3-303c-4d40-9adf-6e0525dd06b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.792230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412fed3-303c-4d40-9adf-6e0525dd06b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.795162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed4dd-2087-4385-a871-77ea0b297ee0 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.819597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 988/1963] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:00 2022] PUT /identity/v3/projects/4754fb438a0f4a8d909069bc2f71360d/users/bb77707dadf14555a6d2389fc5c12d71/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:00.832285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46dc47-969c-4d62-a5f3-522558918096 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.832841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46dc47-969c-4d62-a5f3-522558918096 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.833199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46dc47-969c-4d62-a5f3-522558918096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.860657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4f46dc47-969c-4d62-a5f3-522558918096 None None] MFA Rules not processed for user `bb77707dadf14555a6d2389fc5c12d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:00.862090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4f46dc47-969c-4d62-a5f3-522558918096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:00.901466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412fed3-303c-4d40-9adf-6e0525dd06b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:00.904163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412fed3-303c-4d40-9adf-6e0525dd06b1 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:00.934611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 976/1964] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:00.967540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 989/1965] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:00.982493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412fed3-303c-4d40-9adf-6e0525dd06b1 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:00.987083 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d412fed3-303c-4d40-9adf-6e0525dd06b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:01.001819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412fed3-303c-4d40-9adf-6e0525dd06b1 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:01.075631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4d22f-2fae-4ff6-9a08-d49fcb4d811a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:01.076431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4d22f-2fae-4ff6-9a08-d49fcb4d811a service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:01.076918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4d22f-2fae-4ff6-9a08-d49fcb4d811a service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:01.077134 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4d22f-2fae-4ff6-9a08-d49fcb4d811a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:01.088131 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4d22f-2fae-4ff6-9a08-d49fcb4d811a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:01.089608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4d22f-2fae-4ff6-9a08-d49fcb4d811a service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:01.110463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 977/1966] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:03.826941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46dc47-969c-4d62-a5f3-522558918096 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:03.911077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46dc47-969c-4d62-a5f3-522558918096 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:03.915750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:03.916662 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:03.916969 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:03.917252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] PATH_INFO: `/v3/users/877193a60bc24251a1df3de5bb563212` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:03.918514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] RBAC: Authorizing `identity:delete_user(user_id=877193a60bc24251a1df3de5bb563212)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:03.920455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:03.985837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877193a60bc24251a1df3de5bb563212'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:03.987182 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877193a60bc24251a1df3de5bb563212'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:03.992845 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:03.995128 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877193a60bc24251a1df3de5bb563212'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:04.003840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877193a60bc24251a1df3de5bb563212'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:04.005093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877193a60bc24251a1df3de5bb563212'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:04.024360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 990/1967] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:03 2022] DELETE /identity/v3/users/877193a60bc24251a1df3de5bb563212 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:04.029113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b5795-407e-4756-bab4-ccada06d7890 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:04.029586 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b5795-407e-4756-bab4-ccada06d7890 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:04.029824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b5795-407e-4756-bab4-ccada06d7890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:04.062090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-bb3b5795-407e-4756-bab4-ccada06d7890 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:04.064385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bb3b5795-407e-4756-bab4-ccada06d7890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:04.129948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 978/1968] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:04.141884 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:04.143619 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:04.235568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb12a17-0561-4bbe-8632-750a01ddc65a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:04.239822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9588571-a1c6-484f-a13e-d07e9ef6cf39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:04.240919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9588571-a1c6-484f-a13e-d07e9ef6cf39 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:04.241373 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9588571-a1c6-484f-a13e-d07e9ef6cf39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:04.241706 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9588571-a1c6-484f-a13e-d07e9ef6cf39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:04.260777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9588571-a1c6-484f-a13e-d07e9ef6cf39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:04.263759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9588571-a1c6-484f-a13e-d07e9ef6cf39 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:04.283951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 991/1969] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:04.967388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b5795-407e-4756-bab4-ccada06d7890 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:04.970600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bb3b5795-407e-4756-bab4-ccada06d7890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:04.999598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b5795-407e-4756-bab4-ccada06d7890 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:05.010249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:05.011426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:05.011860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:05.012282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c admin admin] PATH_INFO: `/v3/projects/e9849f743c8f48f3bb9123bfc27cf4f4` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:05.017039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9849f743c8f48f3bb9123bfc27cf4f4)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:05.022551 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:05.029970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:05.103361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9849f743c8f48f3bb9123bfc27cf4f4', 'request_id': 'req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:05.112179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9849f743c8f48f3bb9123bfc27cf4f4', 'request_id': 'req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:05.120208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9849f743c8f48f3bb9123bfc27cf4f4', 'request_id': 'req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:05.143483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c admin admin] The token cache is being invalidate because project e9849f743c8f48f3bb9123bfc27cf4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:05.143939 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:05.144968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cfbe73a5-7c31-4bc7-9f92-6d37b8a9121c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:05.147478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 979/1970] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:04 2022] DELETE /identity/v3/projects/e9849f743c8f48f3bb9123bfc27cf4f4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:09.002505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771a8b-a703-472f-a282-47462f47cfaa None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:09.003407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771a8b-a703-472f-a282-47462f47cfaa None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:09.003941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771a8b-a703-472f-a282-47462f47cfaa None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:09.006079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 992/1971] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 23 17:10:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:09.039342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307269d-4fb5-43aa-bae8-e09cd4f47dce None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:09.039922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307269d-4fb5-43aa-bae8-e09cd4f47dce None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:09.039922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307269d-4fb5-43aa-bae8-e09cd4f47dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:09.066876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8307269d-4fb5-43aa-bae8-e09cd4f47dce None None] MFA Rules not processed for user `81fb8b261e2142fcbf8d23bd010bf715`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:09.068490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8307269d-4fb5-43aa-bae8-e09cd4f47dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:09.079584 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c771a8b-a703-472f-a282-47462f47cfaa None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:09.081633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8c771a8b-a703-472f-a282-47462f47cfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:09.157714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 980/1972] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 23 17:10:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:09.173493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307269d-4fb5-43aa-bae8-e09cd4f47dce None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:09.176552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8307269d-4fb5-43aa-bae8-e09cd4f47dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:09.180271 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c771a8b-a703-472f-a282-47462f47cfaa None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:09.186024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0f5dd-6d5f-4f87-9f7a-fe6cb53be3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:09.187599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0f5dd-6d5f-4f87-9f7a-fe6cb53be3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:09.188119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0f5dd-6d5f-4f87-9f7a-fe6cb53be3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:09.188590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0f5dd-6d5f-4f87-9f7a-fe6cb53be3d4 admin admin] PATH_INFO: `/v3/users/ab4f8cbfaebc4111ab6a692e55f62bf4` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:09.190206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0f5dd-6d5f-4f87-9f7a-fe6cb53be3d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4f8cbfaebc4111ab6a692e55f62bf4)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:09.192825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0f5dd-6d5f-4f87-9f7a-fe6cb53be3d4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:09.192942 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307269d-4fb5-43aa-bae8-e09cd4f47dce None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:09.198471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41221b-8e1a-407f-a137-cab031f0ae56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81fb8b261e2142fcbf8d23bd010bf715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:09.199131 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41221b-8e1a-407f-a137-cab031f0ae56 service placement] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:09.199605 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41221b-8e1a-407f-a137-cab031f0ae56 service placement] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:09.199890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41221b-8e1a-407f-a137-cab031f0ae56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:09.211557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41221b-8e1a-407f-a137-cab031f0ae56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:09.213344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41221b-8e1a-407f-a137-cab031f0ae56 service placement] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:09.224958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 981/1973] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:09.262968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-96d0f5dd-6d5f-4f87-9f7a-fe6cb53be3d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4f8cbfaebc4111ab6a692e55f62bf4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:09.263659 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-96d0f5dd-6d5f-4f87-9f7a-fe6cb53be3d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4f8cbfaebc4111ab6a692e55f62bf4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:09.272116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-96d0f5dd-6d5f-4f87-9f7a-fe6cb53be3d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4f8cbfaebc4111ab6a692e55f62bf4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:09.279762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-96d0f5dd-6d5f-4f87-9f7a-fe6cb53be3d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4f8cbfaebc4111ab6a692e55f62bf4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:09.280432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-96d0f5dd-6d5f-4f87-9f7a-fe6cb53be3d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4f8cbfaebc4111ab6a692e55f62bf4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:09.292718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:09.303632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 993/1974] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:09 2022] DELETE /identity/v3/users/ab4f8cbfaebc4111ab6a692e55f62bf4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:09.511888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41221b-8e1a-407f-a137-cab031f0ae56 service placement] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:09.530183 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41221b-8e1a-407f-a137-cab031f0ae56 service placement] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:09.606776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ced42-5ffb-4468-94d2-be2f580bb384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:09.607649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ced42-5ffb-4468-94d2-be2f580bb384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:09.607941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ced42-5ffb-4468-94d2-be2f580bb384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:09.608251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ced42-5ffb-4468-94d2-be2f580bb384 admin admin] PATH_INFO: `/v3/projects/c967927653574aa79799d609a9947926` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:09.610213 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ced42-5ffb-4468-94d2-be2f580bb384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c967927653574aa79799d609a9947926)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:09.612882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ced42-5ffb-4468-94d2-be2f580bb384 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:09.635366 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:09.668860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-482ced42-5ffb-4468-94d2-be2f580bb384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c967927653574aa79799d609a9947926', 'request_id': 'req-482ced42-5ffb-4468-94d2-be2f580bb384'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:09.678147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-482ced42-5ffb-4468-94d2-be2f580bb384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c967927653574aa79799d609a9947926', 'request_id': 'req-482ced42-5ffb-4468-94d2-be2f580bb384'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:09.684647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-482ced42-5ffb-4468-94d2-be2f580bb384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c967927653574aa79799d609a9947926', 'request_id': 'req-482ced42-5ffb-4468-94d2-be2f580bb384'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:09.698298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-482ced42-5ffb-4468-94d2-be2f580bb384 admin admin] The token cache is being invalidate because project c967927653574aa79799d609a9947926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:09.698645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-482ced42-5ffb-4468-94d2-be2f580bb384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:09.699298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-482ced42-5ffb-4468-94d2-be2f580bb384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:09.701208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 982/1975] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:09 2022] DELETE /identity/v3/projects/c967927653574aa79799d609a9947926 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:09.707433 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c398008-e997-4b82-8342-66df31273d65 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:09.707852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c398008-e997-4b82-8342-66df31273d65 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:09.708083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c398008-e997-4b82-8342-66df31273d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:09.731417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8c398008-e997-4b82-8342-66df31273d65 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:09.732643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8c398008-e997-4b82-8342-66df31273d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:09.806631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 994/1976] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:09.815482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8080a7-913a-404e-9c2d-105b74bfa963 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:09.815785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8080a7-913a-404e-9c2d-105b74bfa963 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:09.816073 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8080a7-913a-404e-9c2d-105b74bfa963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:09.836861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3c8080a7-913a-404e-9c2d-105b74bfa963 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:09.838108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3c8080a7-913a-404e-9c2d-105b74bfa963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:09.848974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 983/1977] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:09.854101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c398008-e997-4b82-8342-66df31273d65 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:09.866599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c398008-e997-4b82-8342-66df31273d65 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:09.873275 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b03fb-227b-468b-879d-c67dbf892419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:09.873956 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b03fb-227b-468b-879d-c67dbf892419 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:09.874517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b03fb-227b-468b-879d-c67dbf892419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:09.875714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b03fb-227b-468b-879d-c67dbf892419 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:09.876481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b03fb-227b-468b-879d-c67dbf892419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:10:09.876801 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b03fb-227b-468b-879d-c67dbf892419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:09.878431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b03fb-227b-468b-879d-c67dbf892419 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:09.896463 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 995/1978] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:10:09.900334 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8080a7-913a-404e-9c2d-105b74bfa963 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:09.913034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8080a7-913a-404e-9c2d-105b74bfa963 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:09.918057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7fcb-b9c0-46b3-9c4b-0b687e8b5e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:09.918765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7fcb-b9c0-46b3-9c4b-0b687e8b5e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:09.919057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7fcb-b9c0-46b3-9c4b-0b687e8b5e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:09.919330 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7fcb-b9c0-46b3-9c4b-0b687e8b5e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:09.920042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea7fcb-b9c0-46b3-9c4b-0b687e8b5e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:09.922026 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea7fcb-b9c0-46b3-9c4b-0b687e8b5e56 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:09.951927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 984/1979] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:09 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:09.957189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b03fb-227b-468b-879d-c67dbf892419 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:09.969468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b03fb-227b-468b-879d-c67dbf892419 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:10.033605 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d58b46-6e41-4345-8991-0f8c2631dcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:10.034649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d58b46-6e41-4345-8991-0f8c2631dcbb admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.034950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d58b46-6e41-4345-8991-0f8c2631dcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.035406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d58b46-6e41-4345-8991-0f8c2631dcbb admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.036729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d58b46-6e41-4345-8991-0f8c2631dcbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:10.040278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d58b46-6e41-4345-8991-0f8c2631dcbb admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:10.074625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 996/1980] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:09 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:10.076538 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7fcb-b9c0-46b3-9c4b-0b687e8b5e56 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:10.089818 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7fcb-b9c0-46b3-9c4b-0b687e8b5e56 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:10.098916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83fd6f-2aac-43f5-bd6e-c14462ba4e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:10.099918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83fd6f-2aac-43f5-bd6e-c14462ba4e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.100505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83fd6f-2aac-43f5-bd6e-c14462ba4e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.100860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83fd6f-2aac-43f5-bd6e-c14462ba4e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.101693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83fd6f-2aac-43f5-bd6e-c14462ba4e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:10.103420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83fd6f-2aac-43f5-bd6e-c14462ba4e0f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:10.116116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 985/1981] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:10.120121 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d58b46-6e41-4345-8991-0f8c2631dcbb admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:10.132742 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d58b46-6e41-4345-8991-0f8c2631dcbb admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:10.139112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631d76c-c66e-4966-acbf-32ce91f02c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:10.139857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631d76c-c66e-4966-acbf-32ce91f02c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.140144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631d76c-c66e-4966-acbf-32ce91f02c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.140934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631d76c-c66e-4966-acbf-32ce91f02c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.141701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631d76c-c66e-4966-acbf-32ce91f02c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:10.143314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631d76c-c66e-4966-acbf-32ce91f02c82 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:10.153794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 997/1982] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:10.159549 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83fd6f-2aac-43f5-bd6e-c14462ba4e0f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:10.170156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83fd6f-2aac-43f5-bd6e-c14462ba4e0f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:10.175097 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c184ba2-a348-4094-9e7a-6fe328b4d435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:10.176031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c184ba2-a348-4094-9e7a-6fe328b4d435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.176323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c184ba2-a348-4094-9e7a-6fe328b4d435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.176605 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c184ba2-a348-4094-9e7a-6fe328b4d435 admin admin] PATH_INFO: `/v3/projects/f72607f1317747e8bc538dbc460990d6/users/276ad8e838d940819d87b29317f3a8e9/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.192907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c184ba2-a348-4094-9e7a-6fe328b4d435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72607f1317747e8bc538dbc460990d6, user_id=276ad8e838d940819d87b29317f3a8e9, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:10.195615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c184ba2-a348-4094-9e7a-6fe328b4d435 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:10.210336 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 986/1983] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:10 2022] PUT /identity/v3/projects/f72607f1317747e8bc538dbc460990d6/users/276ad8e838d940819d87b29317f3a8e9/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:10.220844 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da57184-bf2f-4a62-8e1a-f276a5c2fdab None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.221141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da57184-bf2f-4a62-8e1a-f276a5c2fdab None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.221425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da57184-bf2f-4a62-8e1a-f276a5c2fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.247661 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4da57184-bf2f-4a62-8e1a-f276a5c2fdab None None] MFA Rules not processed for user `276ad8e838d940819d87b29317f3a8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:10.248874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4da57184-bf2f-4a62-8e1a-f276a5c2fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:10.295862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:10.315429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 998/1984] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:10.319864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c184ba2-a348-4094-9e7a-6fe328b4d435 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:10.380743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c184ba2-a348-4094-9e7a-6fe328b4d435 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:10.385380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a39d9-58e7-440b-8cb3-a37757b0dbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:10.386055 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a39d9-58e7-440b-8cb3-a37757b0dbf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.386338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a39d9-58e7-440b-8cb3-a37757b0dbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.386650 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a39d9-58e7-440b-8cb3-a37757b0dbf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.387344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a39d9-58e7-440b-8cb3-a37757b0dbf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:10.389242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a39d9-58e7-440b-8cb3-a37757b0dbf5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:10.418633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 987/1985] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:10 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:10.422664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da57184-bf2f-4a62-8e1a-f276a5c2fdab None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:10.437199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da57184-bf2f-4a62-8e1a-f276a5c2fdab None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:10.497149 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb8ee6-1b76-4ac3-91a8-8243a0ca917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:10.497893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb8ee6-1b76-4ac3-91a8-8243a0ca917d admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.498203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb8ee6-1b76-4ac3-91a8-8243a0ca917d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.498519 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb8ee6-1b76-4ac3-91a8-8243a0ca917d admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.499276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb8ee6-1b76-4ac3-91a8-8243a0ca917d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:10.501866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb8ee6-1b76-4ac3-91a8-8243a0ca917d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:10.525232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 999/1986] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:10 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:10.526720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a39d9-58e7-440b-8cb3-a37757b0dbf5 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:10.537560 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a39d9-58e7-440b-8cb3-a37757b0dbf5 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:10.542390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eba657-f4b6-4d8a-8e0f-ea1d6785b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:10.543089 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eba657-f4b6-4d8a-8e0f-ea1d6785b5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.543393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eba657-f4b6-4d8a-8e0f-ea1d6785b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.543737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eba657-f4b6-4d8a-8e0f-ea1d6785b5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.544469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eba657-f4b6-4d8a-8e0f-ea1d6785b5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:10.546144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eba657-f4b6-4d8a-8e0f-ea1d6785b5e6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:10.557683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 988/1987] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:10.562923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb8ee6-1b76-4ac3-91a8-8243a0ca917d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:10.572803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb8ee6-1b76-4ac3-91a8-8243a0ca917d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:10.577481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48164d-ef20-444f-b5f6-d0cf1f12d035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:10.578698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48164d-ef20-444f-b5f6-d0cf1f12d035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.579285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48164d-ef20-444f-b5f6-d0cf1f12d035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.579686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48164d-ef20-444f-b5f6-d0cf1f12d035 admin admin] PATH_INFO: `/v3/projects/0a54a40bbc1c4beda08087a2d9c94b8e/users/032a1080c2cd42a4973b6cbae0e93637/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.596443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48164d-ef20-444f-b5f6-d0cf1f12d035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a54a40bbc1c4beda08087a2d9c94b8e, user_id=032a1080c2cd42a4973b6cbae0e93637, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:10.599182 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48164d-ef20-444f-b5f6-d0cf1f12d035 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:10.614918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1000/1988] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:10 2022] PUT /identity/v3/projects/0a54a40bbc1c4beda08087a2d9c94b8e/users/032a1080c2cd42a4973b6cbae0e93637/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:10.618984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eba657-f4b6-4d8a-8e0f-ea1d6785b5e6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:10.629862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eba657-f4b6-4d8a-8e0f-ea1d6785b5e6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:10.644296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:10.691289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d1ca3-1952-4c37-94d3-10e32edd5113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:10.691958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d1ca3-1952-4c37-94d3-10e32edd5113 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.692240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d1ca3-1952-4c37-94d3-10e32edd5113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.692517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d1ca3-1952-4c37-94d3-10e32edd5113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.693236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d1ca3-1952-4c37-94d3-10e32edd5113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:10.694847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d1ca3-1952-4c37-94d3-10e32edd5113 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:10.705803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 989/1989] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:10:10.709937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48164d-ef20-444f-b5f6-d0cf1f12d035 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:10.721040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48164d-ef20-444f-b5f6-d0cf1f12d035 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:10.725719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b698ec2-daa6-41bb-883d-007c0603cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:10.726651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b698ec2-daa6-41bb-883d-007c0603cb67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.726939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b698ec2-daa6-41bb-883d-007c0603cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.727219 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b698ec2-daa6-41bb-883d-007c0603cb67 admin admin] PATH_INFO: `/v3/projects/0a54a40bbc1c4beda08087a2d9c94b8e/users/032a1080c2cd42a4973b6cbae0e93637/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.729200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b698ec2-daa6-41bb-883d-007c0603cb67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a54a40bbc1c4beda08087a2d9c94b8e, user_id=032a1080c2cd42a4973b6cbae0e93637, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:10.731877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b698ec2-daa6-41bb-883d-007c0603cb67 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:10.742692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1001/1990] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:10 2022] PUT /identity/v3/projects/0a54a40bbc1c4beda08087a2d9c94b8e/users/032a1080c2cd42a4973b6cbae0e93637/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:10.754060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7adbc8-aee1-400a-a9e4-732d4f1bf7b2 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.754351 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7adbc8-aee1-400a-a9e4-732d4f1bf7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.754655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7adbc8-aee1-400a-a9e4-732d4f1bf7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.782030 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-db7adbc8-aee1-400a-a9e4-732d4f1bf7b2 None None] MFA Rules not processed for user `032a1080c2cd42a4973b6cbae0e93637`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:10.783289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-db7adbc8-aee1-400a-a9e4-732d4f1bf7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:10.850639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 990/1991] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:10.861856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b698ec2-daa6-41bb-883d-007c0603cb67 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:10.863651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6b698ec2-daa6-41bb-883d-007c0603cb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:10.922093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b698ec2-daa6-41bb-883d-007c0603cb67 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:10.925868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2f7f6-833f-4fe7-9c61-428cfd30ef85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:10.926555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2f7f6-833f-4fe7-9c61-428cfd30ef85 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.926843 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2f7f6-833f-4fe7-9c61-428cfd30ef85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.927123 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2f7f6-833f-4fe7-9c61-428cfd30ef85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.936318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2f7f6-833f-4fe7-9c61-428cfd30ef85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:10.937749 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2f7f6-833f-4fe7-9c61-428cfd30ef85 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:10.948050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1002/1992] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:11.532440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7adbc8-aee1-400a-a9e4-732d4f1bf7b2 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:11.597804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7adbc8-aee1-400a-a9e4-732d4f1bf7b2 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:11.602339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:11.603242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:11.603532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:11.603810 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] PATH_INFO: `/v3/users/276ad8e838d940819d87b29317f3a8e9` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:11.605029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=276ad8e838d940819d87b29317f3a8e9)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:11.607025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:11.655013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:11.661090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276ad8e838d940819d87b29317f3a8e9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:11.674610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276ad8e838d940819d87b29317f3a8e9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:11.675320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276ad8e838d940819d87b29317f3a8e9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:11.683950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276ad8e838d940819d87b29317f3a8e9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:11.684565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276ad8e838d940819d87b29317f3a8e9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:11.698215 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 991/1993] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:11 2022] DELETE /identity/v3/users/276ad8e838d940819d87b29317f3a8e9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:11.702734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3b4f4-4f96-4986-9677-ed29082a655b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:11.703378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3b4f4-4f96-4986-9677-ed29082a655b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:11.703591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3b4f4-4f96-4986-9677-ed29082a655b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:11.722142 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-73d3b4f4-4f96-4986-9677-ed29082a655b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:11.723546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-73d3b4f4-4f96-4986-9677-ed29082a655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:11.766267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:11.787627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1003/1994] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:11.798629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:11.800223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:11.859717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241e58b-fae7-4764-8b4f-dda2a2fa2e16 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:11.863378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48d32f-909f-4fea-b9b3-11e466bc941c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:11.864038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48d32f-909f-4fea-b9b3-11e466bc941c service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:11.864325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48d32f-909f-4fea-b9b3-11e466bc941c service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:11.864606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48d32f-909f-4fea-b9b3-11e466bc941c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:11.873799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48d32f-909f-4fea-b9b3-11e466bc941c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:11.875788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48d32f-909f-4fea-b9b3-11e466bc941c service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:11.885150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 992/1995] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:10:12.159783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3b4f4-4f96-4986-9677-ed29082a655b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:12.161251 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-73d3b4f4-4f96-4986-9677-ed29082a655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:12.176018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3b4f4-4f96-4986-9677-ed29082a655b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:12.181690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:12.182668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:12.182943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:12.183215 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] PATH_INFO: `/v3/projects/f72607f1317747e8bc538dbc460990d6` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:12.184448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72607f1317747e8bc538dbc460990d6)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:12.186412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:12.236690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72607f1317747e8bc538dbc460990d6', 'request_id': 'req-64076100-2f39-4adc-b803-673a26a2a62c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.244791 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72607f1317747e8bc538dbc460990d6', 'request_id': 'req-64076100-2f39-4adc-b803-673a26a2a62c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.252234 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72607f1317747e8bc538dbc460990d6', 'request_id': 'req-64076100-2f39-4adc-b803-673a26a2a62c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.263578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] The token cache is being invalidate because project f72607f1317747e8bc538dbc460990d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:12.263874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.264812 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.266714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1004/1996] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:12 2022] DELETE /identity/v3/projects/f72607f1317747e8bc538dbc460990d6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:12.270558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48d32f-909f-4fea-b9b3-11e466bc941c service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:12.280687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48d32f-909f-4fea-b9b3-11e466bc941c service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:12.347489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdcd17-2149-401b-8230-8061d47868b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:12.348373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdcd17-2149-401b-8230-8061d47868b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:12.348664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdcd17-2149-401b-8230-8061d47868b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:12.348946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdcd17-2149-401b-8230-8061d47868b5 admin admin] PATH_INFO: `/v3/users/032a1080c2cd42a4973b6cbae0e93637` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:12.350415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdcd17-2149-401b-8230-8061d47868b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=032a1080c2cd42a4973b6cbae0e93637)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:12.352100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdcd17-2149-401b-8230-8061d47868b5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:12.405361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-63bdcd17-2149-401b-8230-8061d47868b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032a1080c2cd42a4973b6cbae0e93637'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.417608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:12.419623 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-63bdcd17-2149-401b-8230-8061d47868b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032a1080c2cd42a4973b6cbae0e93637'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.420537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-63bdcd17-2149-401b-8230-8061d47868b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032a1080c2cd42a4973b6cbae0e93637'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.430527 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-63bdcd17-2149-401b-8230-8061d47868b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032a1080c2cd42a4973b6cbae0e93637'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.431379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-63bdcd17-2149-401b-8230-8061d47868b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032a1080c2cd42a4973b6cbae0e93637'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.444980 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 993/1997] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:12 2022] DELETE /identity/v3/users/032a1080c2cd42a4973b6cbae0e93637 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:10:12.729592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:12.731107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:12.746302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64076100-2f39-4adc-b803-673a26a2a62c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:12.810192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:12.811108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:12.811394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:12.811683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] PATH_INFO: `/v3/projects/0a54a40bbc1c4beda08087a2d9c94b8e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:12.813410 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a54a40bbc1c4beda08087a2d9c94b8e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:12.815341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:12.862888 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a54a40bbc1c4beda08087a2d9c94b8e', 'request_id': 'req-ccf8fb7c-827a-456e-90d8-efee47ba16a0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.871327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a54a40bbc1c4beda08087a2d9c94b8e', 'request_id': 'req-ccf8fb7c-827a-456e-90d8-efee47ba16a0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.878492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a54a40bbc1c4beda08087a2d9c94b8e', 'request_id': 'req-ccf8fb7c-827a-456e-90d8-efee47ba16a0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.885272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:12.892282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] The token cache is being invalidate because project 0a54a40bbc1c4beda08087a2d9c94b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:12.892862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.893968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:12.898478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1005/1998] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:12 2022] DELETE /identity/v3/projects/0a54a40bbc1c4beda08087a2d9c94b8e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:12.901180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dea89-0141-44ec-8438-d7a5406f20a9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:12.901649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dea89-0141-44ec-8438-d7a5406f20a9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:12.901927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dea89-0141-44ec-8438-d7a5406f20a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:12.922338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-eb5dea89-0141-44ec-8438-d7a5406f20a9 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:12.923835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-eb5dea89-0141-44ec-8438-d7a5406f20a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:12.985128 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:12.986645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:12.988759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 994/1999] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:12.997063 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50555efc-a2f9-405b-812e-12f7ab173acb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:12.997369 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50555efc-a2f9-405b-812e-12f7ab173acb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:12.997654 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50555efc-a2f9-405b-812e-12f7ab173acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:12.999383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8fb7c-827a-456e-90d8-efee47ba16a0 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:13.005010 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d5a7d-806c-4c5b-abd0-b1fb5b616a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:13.006569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d5a7d-806c-4c5b-abd0-b1fb5b616a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.006859 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d5a7d-806c-4c5b-abd0-b1fb5b616a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.007138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d5a7d-806c-4c5b-abd0-b1fb5b616a07 admin admin] PATH_INFO: `/v3/users/914015cbd40c41cfa81bc3477e0072d5` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.008378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d5a7d-806c-4c5b-abd0-b1fb5b616a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=914015cbd40c41cfa81bc3477e0072d5)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:13.010313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d5a7d-806c-4c5b-abd0-b1fb5b616a07 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:13.016671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-50555efc-a2f9-405b-812e-12f7ab173acb None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:13.017888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-50555efc-a2f9-405b-812e-12f7ab173acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:13.025858 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 995/2000] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:13.029971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50555efc-a2f9-405b-812e-12f7ab173acb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:13.039518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50555efc-a2f9-405b-812e-12f7ab173acb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:13.045015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877f7be-0104-4cb1-82fa-26fddbfcc4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:13.046041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877f7be-0104-4cb1-82fa-26fddbfcc4dd admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.046343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877f7be-0104-4cb1-82fa-26fddbfcc4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.047178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877f7be-0104-4cb1-82fa-26fddbfcc4dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.047915 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877f7be-0104-4cb1-82fa-26fddbfcc4dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:10:13.048221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877f7be-0104-4cb1-82fa-26fddbfcc4dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:13.049828 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877f7be-0104-4cb1-82fa-26fddbfcc4dd admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:13.060491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cb3d5a7d-806c-4c5b-abd0-b1fb5b616a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914015cbd40c41cfa81bc3477e0072d5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:13.061169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cb3d5a7d-806c-4c5b-abd0-b1fb5b616a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914015cbd40c41cfa81bc3477e0072d5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:13.061469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 996/2001] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:10:13.065911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877f7be-0104-4cb1-82fa-26fddbfcc4dd admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:13.069533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cb3d5a7d-806c-4c5b-abd0-b1fb5b616a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914015cbd40c41cfa81bc3477e0072d5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:13.075758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877f7be-0104-4cb1-82fa-26fddbfcc4dd admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:13.077376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cb3d5a7d-806c-4c5b-abd0-b1fb5b616a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914015cbd40c41cfa81bc3477e0072d5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:13.078784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cb3d5a7d-806c-4c5b-abd0-b1fb5b616a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914015cbd40c41cfa81bc3477e0072d5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:13.081531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ae0e7-675f-4779-853c-77320e1f5395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:13.082266 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ae0e7-675f-4779-853c-77320e1f5395 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.082524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ae0e7-675f-4779-853c-77320e1f5395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.082873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ae0e7-675f-4779-853c-77320e1f5395 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.083558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ae0e7-675f-4779-853c-77320e1f5395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:13.085439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ae0e7-675f-4779-853c-77320e1f5395 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:13.096789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1006/2002] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:12 2022] DELETE /identity/v3/users/914015cbd40c41cfa81bc3477e0072d5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:10:13.101177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50e38-4fac-4dc2-bb07-1102cc69648a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.101477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50e38-4fac-4dc2-bb07-1102cc69648a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.101792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50e38-4fac-4dc2-bb07-1102cc69648a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.111902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 997/2003] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:13 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:10:13.115933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ae0e7-675f-4779-853c-77320e1f5395 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:13.117640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cd0ae0e7-675f-4779-853c-77320e1f5395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:13.120302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a4f50e38-4fac-4dc2-bb07-1102cc69648a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:13.121475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a4f50e38-4fac-4dc2-bb07-1102cc69648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:13.181054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1007/2004] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:13.182784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ae0e7-675f-4779-853c-77320e1f5395 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:13.187699 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5b39-be3d-41cf-b016-3e17f382132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:13.188382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5b39-be3d-41cf-b016-3e17f382132e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.188678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5b39-be3d-41cf-b016-3e17f382132e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.188957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5b39-be3d-41cf-b016-3e17f382132e admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.189918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a5b39-be3d-41cf-b016-3e17f382132e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:13.190793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50e38-4fac-4dc2-bb07-1102cc69648a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:13.191897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a5b39-be3d-41cf-b016-3e17f382132e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:13.192099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a4f50e38-4fac-4dc2-bb07-1102cc69648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:13.214316 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 998/2005] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:13 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:10:13.218163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5b39-be3d-41cf-b016-3e17f382132e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:13.228373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5b39-be3d-41cf-b016-3e17f382132e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:13.233326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e33723-5c0b-4172-bcd8-93f1b2b82c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:13.233995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e33723-5c0b-4172-bcd8-93f1b2b82c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.234310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e33723-5c0b-4172-bcd8-93f1b2b82c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.234622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e33723-5c0b-4172-bcd8-93f1b2b82c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.235562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e33723-5c0b-4172-bcd8-93f1b2b82c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:13.237169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e33723-5c0b-4172-bcd8-93f1b2b82c03 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:13.247993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 999/2006] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:10:13.252348 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e33723-5c0b-4172-bcd8-93f1b2b82c03 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:13.259405 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50e38-4fac-4dc2-bb07-1102cc69648a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:13.263160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e33723-5c0b-4172-bcd8-93f1b2b82c03 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:13.263549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24638ccb-f697-4342-b71d-fe255d9d3b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:13.264279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24638ccb-f697-4342-b71d-fe255d9d3b73 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.264641 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24638ccb-f697-4342-b71d-fe255d9d3b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.264994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24638ccb-f697-4342-b71d-fe255d9d3b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.268406 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d328620-79d1-4d88-abb6-b0c6359fe578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:13.269070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d328620-79d1-4d88-abb6-b0c6359fe578 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.269357 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d328620-79d1-4d88-abb6-b0c6359fe578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.269634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d328620-79d1-4d88-abb6-b0c6359fe578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.270352 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d328620-79d1-4d88-abb6-b0c6359fe578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:13.271958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d328620-79d1-4d88-abb6-b0c6359fe578 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:13.275548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24638ccb-f697-4342-b71d-fe255d9d3b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:13.277083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24638ccb-f697-4342-b71d-fe255d9d3b73 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:13.282259 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1000/2007] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:10:13.286089 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d328620-79d1-4d88-abb6-b0c6359fe578 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:13.287511 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1008/2008] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:10:13.295955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d328620-79d1-4d88-abb6-b0c6359fe578 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:13.300896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c68a8-e404-4273-90e1-50a44d8ff212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:13.301778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c68a8-e404-4273-90e1-50a44d8ff212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.302191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c68a8-e404-4273-90e1-50a44d8ff212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.302645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c68a8-e404-4273-90e1-50a44d8ff212 admin admin] PATH_INFO: `/v3/projects/5fc82bf4e28c4820ab212d716ef1f90c/users/4eeecbf2164d43a2b52b65ba36a6cea6/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.305230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:13.323792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c68a8-e404-4273-90e1-50a44d8ff212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc82bf4e28c4820ab212d716ef1f90c, user_id=4eeecbf2164d43a2b52b65ba36a6cea6, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:13.327363 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c68a8-e404-4273-90e1-50a44d8ff212 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:13.342586 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1001/2009] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:13 2022] PUT /identity/v3/projects/5fc82bf4e28c4820ab212d716ef1f90c/users/4eeecbf2164d43a2b52b65ba36a6cea6/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:10:13.348083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754da15-2f7b-4609-acfb-ea4ded144785 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.348374 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754da15-2f7b-4609-acfb-ea4ded144785 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.348878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754da15-2f7b-4609-acfb-ea4ded144785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.369123 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2754da15-2f7b-4609-acfb-ea4ded144785 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:13.370350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2754da15-2f7b-4609-acfb-ea4ded144785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:13.380428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:13.440060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1009/2010] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:13.452394 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c68a8-e404-4273-90e1-50a44d8ff212 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:13.541453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c68a8-e404-4273-90e1-50a44d8ff212 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:13.545493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532f754-dd5a-4e55-b6a9-472e88060061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:13.545921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532f754-dd5a-4e55-b6a9-472e88060061 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.546212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532f754-dd5a-4e55-b6a9-472e88060061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.546555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532f754-dd5a-4e55-b6a9-472e88060061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.556696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532f754-dd5a-4e55-b6a9-472e88060061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:13.558147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532f754-dd5a-4e55-b6a9-472e88060061 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:13.572714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1002/2011] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:13.668615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754da15-2f7b-4609-acfb-ea4ded144785 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:13.670381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2754da15-2f7b-4609-acfb-ea4ded144785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:13.685873 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754da15-2f7b-4609-acfb-ea4ded144785 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:13.691940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e38b0-c981-450c-b870-db8e04259613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:13.692825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e38b0-c981-450c-b870-db8e04259613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.693365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e38b0-c981-450c-b870-db8e04259613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.693895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e38b0-c981-450c-b870-db8e04259613 admin admin] PATH_INFO: `/v3/projects/5683d1f6367b4d57ab2f081cad752bc1` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.695356 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e38b0-c981-450c-b870-db8e04259613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5683d1f6367b4d57ab2f081cad752bc1)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:13.697522 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e38b0-c981-450c-b870-db8e04259613 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:13.754140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3d9e38b0-c981-450c-b870-db8e04259613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5683d1f6367b4d57ab2f081cad752bc1', 'request_id': 'req-3d9e38b0-c981-450c-b870-db8e04259613'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:13.767893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3d9e38b0-c981-450c-b870-db8e04259613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5683d1f6367b4d57ab2f081cad752bc1', 'request_id': 'req-3d9e38b0-c981-450c-b870-db8e04259613'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:13.778940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3d9e38b0-c981-450c-b870-db8e04259613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5683d1f6367b4d57ab2f081cad752bc1', 'request_id': 'req-3d9e38b0-c981-450c-b870-db8e04259613'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:13.801916 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3d9e38b0-c981-450c-b870-db8e04259613 admin admin] The token cache is being invalidate because project 5683d1f6367b4d57ab2f081cad752bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:13.802388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3d9e38b0-c981-450c-b870-db8e04259613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:13.803535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3d9e38b0-c981-450c-b870-db8e04259613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:13.806643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1010/2012] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:13 2022] DELETE /identity/v3/projects/5683d1f6367b4d57ab2f081cad752bc1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:13.813576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102568e-6c81-448c-a447-002efcd53f93 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.813871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102568e-6c81-448c-a447-002efcd53f93 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.814153 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102568e-6c81-448c-a447-002efcd53f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.838553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d102568e-6c81-448c-a447-002efcd53f93 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:13.839794 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d102568e-6c81-448c-a447-002efcd53f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:13.911864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1003/2013] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:13.919523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7825d-775e-4f3d-9b67-875db73b12a6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.919829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7825d-775e-4f3d-9b67-875db73b12a6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.920100 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7825d-775e-4f3d-9b67-875db73b12a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.939565 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-eed7825d-775e-4f3d-9b67-875db73b12a6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:13.941008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-eed7825d-775e-4f3d-9b67-875db73b12a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:13.951376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1011/2014] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:13.956885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102568e-6c81-448c-a447-002efcd53f93 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:13.967706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102568e-6c81-448c-a447-002efcd53f93 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:13.975425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557123c-f0a5-4077-962a-6272df5656e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:13.976489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557123c-f0a5-4077-962a-6272df5656e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.976958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557123c-f0a5-4077-962a-6272df5656e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.977465 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557123c-f0a5-4077-962a-6272df5656e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.978882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557123c-f0a5-4077-962a-6272df5656e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:10:13.979551 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557123c-f0a5-4077-962a-6272df5656e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:13.982204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557123c-f0a5-4077-962a-6272df5656e8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.002783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7825d-775e-4f3d-9b67-875db73b12a6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.007627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1004/2015] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:10:14.013579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7825d-775e-4f3d-9b67-875db73b12a6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.019047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae153-e311-42a1-83f7-5bf6c2af7700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.019797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae153-e311-42a1-83f7-5bf6c2af7700 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.020263 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae153-e311-42a1-83f7-5bf6c2af7700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.020550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae153-e311-42a1-83f7-5bf6c2af7700 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.021572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebae153-e311-42a1-83f7-5bf6c2af7700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.023685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebae153-e311-42a1-83f7-5bf6c2af7700 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.068176 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557123c-f0a5-4077-962a-6272df5656e8 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.068635 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1012/2016] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:14 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:14.087247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557123c-f0a5-4077-962a-6272df5656e8 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.158693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489acb1-6ddc-4a68-9e6e-b22b2ab79a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.159699 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489acb1-6ddc-4a68-9e6e-b22b2ab79a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.159984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489acb1-6ddc-4a68-9e6e-b22b2ab79a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.160260 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489acb1-6ddc-4a68-9e6e-b22b2ab79a75 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.160950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489acb1-6ddc-4a68-9e6e-b22b2ab79a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.162892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489acb1-6ddc-4a68-9e6e-b22b2ab79a75 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.185463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1005/2017] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:14 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:14.189876 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae153-e311-42a1-83f7-5bf6c2af7700 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.200353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae153-e311-42a1-83f7-5bf6c2af7700 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.205392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179ef6e-c90c-40df-8699-abe346b4693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.206147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179ef6e-c90c-40df-8699-abe346b4693d admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.206536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179ef6e-c90c-40df-8699-abe346b4693d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.206822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179ef6e-c90c-40df-8699-abe346b4693d admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.207571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179ef6e-c90c-40df-8699-abe346b4693d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.209163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179ef6e-c90c-40df-8699-abe346b4693d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.220830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1013/2018] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:14.225205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489acb1-6ddc-4a68-9e6e-b22b2ab79a75 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.231736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:14.238618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489acb1-6ddc-4a68-9e6e-b22b2ab79a75 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.243760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcb041-811d-4bf0-8d51-ccb336b43cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.244436 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcb041-811d-4bf0-8d51-ccb336b43cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.244724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcb041-811d-4bf0-8d51-ccb336b43cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.245016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcb041-811d-4bf0-8d51-ccb336b43cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.245746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcb041-811d-4bf0-8d51-ccb336b43cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.252581 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcb041-811d-4bf0-8d51-ccb336b43cc9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.265145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1006/2019] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:14.269538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179ef6e-c90c-40df-8699-abe346b4693d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.279854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179ef6e-c90c-40df-8699-abe346b4693d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.285104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e2aeb-77e0-44a7-abdc-1765f618d9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.286353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e2aeb-77e0-44a7-abdc-1765f618d9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.287096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e2aeb-77e0-44a7-abdc-1765f618d9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.287391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e2aeb-77e0-44a7-abdc-1765f618d9b1 admin admin] PATH_INFO: `/v3/projects/d802cb5f320842a283908e3e59c95ecb/users/fc292d41383e4dde937d3d20c2d5aa12/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.303688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e2aeb-77e0-44a7-abdc-1765f618d9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d802cb5f320842a283908e3e59c95ecb, user_id=fc292d41383e4dde937d3d20c2d5aa12, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.306834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e2aeb-77e0-44a7-abdc-1765f618d9b1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.337032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1014/2020] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:14 2022] PUT /identity/v3/projects/d802cb5f320842a283908e3e59c95ecb/users/fc292d41383e4dde937d3d20c2d5aa12/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:14.339454 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b3a23-bc15-4c2f-b3ff-e5282faeee97 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.339762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b3a23-bc15-4c2f-b3ff-e5282faeee97 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.340042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b3a23-bc15-4c2f-b3ff-e5282faeee97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.358646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafef9d9-fa26-4e49-97ba-aeb70e0b6703 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.359255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafef9d9-fa26-4e49-97ba-aeb70e0b6703 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.359546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafef9d9-fa26-4e49-97ba-aeb70e0b6703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.390438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-fafef9d9-fa26-4e49-97ba-aeb70e0b6703 None None] MFA Rules not processed for user `4eeecbf2164d43a2b52b65ba36a6cea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:14.392895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fafef9d9-fa26-4e49-97ba-aeb70e0b6703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:14.397336 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-dd0b3a23-bc15-4c2f-b3ff-e5282faeee97 None None] MFA Rules not processed for user `fc292d41383e4dde937d3d20c2d5aa12`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:14.399625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dd0b3a23-bc15-4c2f-b3ff-e5282faeee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:14.417861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:14.486313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1015/2021] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:14.490526 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafef9d9-fa26-4e49-97ba-aeb70e0b6703 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.491939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fafef9d9-fa26-4e49-97ba-aeb70e0b6703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:14.498941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1007/2022] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:14.503876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b3a23-bc15-4c2f-b3ff-e5282faeee97 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.572760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafef9d9-fa26-4e49-97ba-aeb70e0b6703 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.579688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b3a23-bc15-4c2f-b3ff-e5282faeee97 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.579864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1ea67-476a-4e76-90d8-b1f83ac7e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.580990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1ea67-476a-4e76-90d8-b1f83ac7e855 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.580990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1ea67-476a-4e76-90d8-b1f83ac7e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.581367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1ea67-476a-4e76-90d8-b1f83ac7e855 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.582076 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1ea67-476a-4e76-90d8-b1f83ac7e855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.584090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1ea67-476a-4e76-90d8-b1f83ac7e855 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.586178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f27a-0014-47a2-a86a-22786bef8842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.586938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f27a-0014-47a2-a86a-22786bef8842 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.587231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f27a-0014-47a2-a86a-22786bef8842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.587762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f27a-0014-47a2-a86a-22786bef8842 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.588585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89f27a-0014-47a2-a86a-22786bef8842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.590850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89f27a-0014-47a2-a86a-22786bef8842 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.621725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1008/2023] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:14 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:10:14.625416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1016/2024] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:14 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:10:14.626053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f27a-0014-47a2-a86a-22786bef8842 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.626567 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1ea67-476a-4e76-90d8-b1f83ac7e855 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.705188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f27a-0014-47a2-a86a-22786bef8842 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.705797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1ea67-476a-4e76-90d8-b1f83ac7e855 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.711420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bbcba-2cbe-4d5e-9967-7572dc146732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.712443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bbcba-2cbe-4d5e-9967-7572dc146732 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.712819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bbcba-2cbe-4d5e-9967-7572dc146732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.712925 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fb86e-d6f0-435b-9a9f-314f5803c462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.713090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bbcba-2cbe-4d5e-9967-7572dc146732 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.714415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fb86e-d6f0-435b-9a9f-314f5803c462 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.714557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bbcba-2cbe-4d5e-9967-7572dc146732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.714638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fb86e-d6f0-435b-9a9f-314f5803c462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.715328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fb86e-d6f0-435b-9a9f-314f5803c462 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.716206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bbcba-2cbe-4d5e-9967-7572dc146732 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.716335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fb86e-d6f0-435b-9a9f-314f5803c462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.718738 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fb86e-d6f0-435b-9a9f-314f5803c462 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.732090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:14.746683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1009/2025] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:14 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:14.751415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bbcba-2cbe-4d5e-9967-7572dc146732 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.752213 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1017/2026] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:14 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:10:14.757473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fb86e-d6f0-435b-9a9f-314f5803c462 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.767686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bbcba-2cbe-4d5e-9967-7572dc146732 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.776483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f24f15-5bd3-4c2d-86a4-bad13b8a7438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.777190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f24f15-5bd3-4c2d-86a4-bad13b8a7438 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.777468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f24f15-5bd3-4c2d-86a4-bad13b8a7438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.777740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f24f15-5bd3-4c2d-86a4-bad13b8a7438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.778532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f24f15-5bd3-4c2d-86a4-bad13b8a7438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.780142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f24f15-5bd3-4c2d-86a4-bad13b8a7438 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.783275 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fb86e-d6f0-435b-9a9f-314f5803c462 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.789371 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f7ac8-3113-4bf4-9cd4-61ea09e8ba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.790062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f7ac8-3113-4bf4-9cd4-61ea09e8ba24 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.790352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f7ac8-3113-4bf4-9cd4-61ea09e8ba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.790661 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f7ac8-3113-4bf4-9cd4-61ea09e8ba24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.791396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f7ac8-3113-4bf4-9cd4-61ea09e8ba24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.791590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1010/2027] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:14.793238 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f7ac8-3113-4bf4-9cd4-61ea09e8ba24 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.795647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f24f15-5bd3-4c2d-86a4-bad13b8a7438 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.806963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f24f15-5bd3-4c2d-86a4-bad13b8a7438 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.808255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1018/2028] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:14.809127 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f7ac8-3113-4bf4-9cd4-61ea09e8ba24 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.815754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0d6b8-d193-4924-99c0-9c9f1a90823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.816687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0d6b8-d193-4924-99c0-9c9f1a90823a admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.816953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0d6b8-d193-4924-99c0-9c9f1a90823a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.817234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0d6b8-d193-4924-99c0-9c9f1a90823a admin admin] PATH_INFO: `/v3/projects/fe11c25f70d040c0a1e46cad9d600b81/users/ffcf0f621514406393cbb897e8b1379d/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.819206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f7ac8-3113-4bf4-9cd4-61ea09e8ba24 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.824322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8d32f-b030-4411-ae0c-d1443944857d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.824988 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8d32f-b030-4411-ae0c-d1443944857d admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.825198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8d32f-b030-4411-ae0c-d1443944857d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.825476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8d32f-b030-4411-ae0c-d1443944857d admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.826215 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8d32f-b030-4411-ae0c-d1443944857d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.827940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8d32f-b030-4411-ae0c-d1443944857d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.835980 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0d6b8-d193-4924-99c0-9c9f1a90823a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe11c25f70d040c0a1e46cad9d600b81, user_id=ffcf0f621514406393cbb897e8b1379d, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.838990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0d6b8-d193-4924-99c0-9c9f1a90823a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.843099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1019/2029] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:10:14.845306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8d32f-b030-4411-ae0c-d1443944857d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.856075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8d32f-b030-4411-ae0c-d1443944857d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.857309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1011/2030] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:14 2022] PUT /identity/v3/projects/fe11c25f70d040c0a1e46cad9d600b81/users/ffcf0f621514406393cbb897e8b1379d/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:10:14.861958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0d6b8-d193-4924-99c0-9c9f1a90823a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.870727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:14.918299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78108915-a1fa-4bb6-9099-5e314d619693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.919216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78108915-a1fa-4bb6-9099-5e314d619693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.919497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78108915-a1fa-4bb6-9099-5e314d619693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.919802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78108915-a1fa-4bb6-9099-5e314d619693 admin admin] PATH_INFO: `/v3/projects/c996d757a94d410b927bf02d4e13119e/users/1f0a1c8ad0414ba2be38ce08ca422190/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.923721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0d6b8-d193-4924-99c0-9c9f1a90823a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.928429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff4c15-4710-4bb6-8bf0-c111f739931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:14.929102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff4c15-4710-4bb6-8bf0-c111f739931b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.929391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff4c15-4710-4bb6-8bf0-c111f739931b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.929670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff4c15-4710-4bb6-8bf0-c111f739931b admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.930429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff4c15-4710-4bb6-8bf0-c111f739931b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.932033 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff4c15-4710-4bb6-8bf0-c111f739931b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.934729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78108915-a1fa-4bb6-9099-5e314d619693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c996d757a94d410b927bf02d4e13119e, user_id=1f0a1c8ad0414ba2be38ce08ca422190, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:14.937431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78108915-a1fa-4bb6-9099-5e314d619693 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:14.941990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1012/2031] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:10:14.946314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff4c15-4710-4bb6-8bf0-c111f739931b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:14.950857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1020/2032] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:14 2022] PUT /identity/v3/projects/c996d757a94d410b927bf02d4e13119e/users/1f0a1c8ad0414ba2be38ce08ca422190/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:10:14.961369 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff4c15-4710-4bb6-8bf0-c111f739931b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:14.963584 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c969455-9832-4d79-808a-1cca3f3abed4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:14.963863 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c969455-9832-4d79-808a-1cca3f3abed4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:14.964147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c969455-9832-4d79-808a-1cca3f3abed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:14.992030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8c969455-9832-4d79-808a-1cca3f3abed4 None None] MFA Rules not processed for user `1f0a1c8ad0414ba2be38ce08ca422190`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:14.993270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8c969455-9832-4d79-808a-1cca3f3abed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:15.020296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396388d-71bd-4a26-9079-758b3af9a555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:15.021184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396388d-71bd-4a26-9079-758b3af9a555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.021468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396388d-71bd-4a26-9079-758b3af9a555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.021742 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396388d-71bd-4a26-9079-758b3af9a555 admin admin] PATH_INFO: `/v3/projects/fe11c25f70d040c0a1e46cad9d600b81/users/ffcf0f621514406393cbb897e8b1379d/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.023743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396388d-71bd-4a26-9079-758b3af9a555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe11c25f70d040c0a1e46cad9d600b81, user_id=ffcf0f621514406393cbb897e8b1379d, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:15.026350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396388d-71bd-4a26-9079-758b3af9a555 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:15.037120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1013/2033] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:14 2022] PUT /identity/v3/projects/fe11c25f70d040c0a1e46cad9d600b81/users/ffcf0f621514406393cbb897e8b1379d/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:10:15.067928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1021/2034] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:15.069062 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396388d-71bd-4a26-9079-758b3af9a555 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:15.149871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:15.158866 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396388d-71bd-4a26-9079-758b3af9a555 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:15.165951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f1f0-445e-4354-923a-db4c02979b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:15.166794 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f1f0-445e-4354-923a-db4c02979b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.167086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f1f0-445e-4354-923a-db4c02979b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.167363 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f1f0-445e-4354-923a-db4c02979b4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.168077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73f1f0-445e-4354-923a-db4c02979b4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:15.170004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73f1f0-445e-4354-923a-db4c02979b4a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:15.196849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1014/2035] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:15 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:15.200897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c969455-9832-4d79-808a-1cca3f3abed4 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:15.213026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c969455-9832-4d79-808a-1cca3f3abed4 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:15.280479 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794b500-8965-4e06-987c-2b1d821e14b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:15.282156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794b500-8965-4e06-987c-2b1d821e14b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.282610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794b500-8965-4e06-987c-2b1d821e14b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.282960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794b500-8965-4e06-987c-2b1d821e14b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.283674 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794b500-8965-4e06-987c-2b1d821e14b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:15.285600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794b500-8965-4e06-987c-2b1d821e14b5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:15.307907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1022/2036] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:15 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:15.311940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f1f0-445e-4354-923a-db4c02979b4a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:15.323981 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f1f0-445e-4354-923a-db4c02979b4a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:15.329695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca67281-6482-427d-bda0-a1713a1a4df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:15.330518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67281-6482-427d-bda0-a1713a1a4df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.330869 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67281-6482-427d-bda0-a1713a1a4df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.331212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67281-6482-427d-bda0-a1713a1a4df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.332089 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca67281-6482-427d-bda0-a1713a1a4df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:15.333781 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca67281-6482-427d-bda0-a1713a1a4df2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:15.344252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1015/2037] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:15.348435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794b500-8965-4e06-987c-2b1d821e14b5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:15.358666 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794b500-8965-4e06-987c-2b1d821e14b5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:15.379615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e926046-4386-4667-af49-36160dfcbe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:15.380721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e926046-4386-4667-af49-36160dfcbe6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.381012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e926046-4386-4667-af49-36160dfcbe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.381875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e926046-4386-4667-af49-36160dfcbe6a admin admin] PATH_INFO: `/v3/projects/70a9b908255b4bd6ac077dd62c7f9721/users/f1d8ca6338664ff091f0c7139c0d39da/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.403809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e926046-4386-4667-af49-36160dfcbe6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a9b908255b4bd6ac077dd62c7f9721, user_id=f1d8ca6338664ff091f0c7139c0d39da, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:15.407206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e926046-4386-4667-af49-36160dfcbe6a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:15.410248 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:15.425302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1023/2038] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:15 2022] PUT /identity/v3/projects/70a9b908255b4bd6ac077dd62c7f9721/users/f1d8ca6338664ff091f0c7139c0d39da/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:15.429448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca67281-6482-427d-bda0-a1713a1a4df2 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:15.443740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca67281-6482-427d-bda0-a1713a1a4df2 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:15.518300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b159d3-9101-424a-ad74-dd1c54aec7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:15.519071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b159d3-9101-424a-ad74-dd1c54aec7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.519362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b159d3-9101-424a-ad74-dd1c54aec7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.519643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b159d3-9101-424a-ad74-dd1c54aec7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.520377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b159d3-9101-424a-ad74-dd1c54aec7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:15.522030 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b159d3-9101-424a-ad74-dd1c54aec7a7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:15.536711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1016/2039] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:15.538179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e926046-4386-4667-af49-36160dfcbe6a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:15.549661 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e926046-4386-4667-af49-36160dfcbe6a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:15.555179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb0af8-be37-413b-a7f3-ebe8638cc5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:15.556188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb0af8-be37-413b-a7f3-ebe8638cc5b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.556554 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb0af8-be37-413b-a7f3-ebe8638cc5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.556900 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb0af8-be37-413b-a7f3-ebe8638cc5b2 admin admin] PATH_INFO: `/v3/projects/70a9b908255b4bd6ac077dd62c7f9721/users/f1d8ca6338664ff091f0c7139c0d39da/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.559040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb0af8-be37-413b-a7f3-ebe8638cc5b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a9b908255b4bd6ac077dd62c7f9721, user_id=f1d8ca6338664ff091f0c7139c0d39da, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:15.562936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb0af8-be37-413b-a7f3-ebe8638cc5b2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:15.582564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1024/2040] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:15 2022] PUT /identity/v3/projects/70a9b908255b4bd6ac077dd62c7f9721/users/f1d8ca6338664ff091f0c7139c0d39da/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:10:15.588735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d261b2-68b7-49d0-826c-a509ebdd3f30 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.589230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d261b2-68b7-49d0-826c-a509ebdd3f30 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.589594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d261b2-68b7-49d0-826c-a509ebdd3f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.622517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-69d261b2-68b7-49d0-826c-a509ebdd3f30 None None] MFA Rules not processed for user `f1d8ca6338664ff091f0c7139c0d39da`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:15.623722 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-69d261b2-68b7-49d0-826c-a509ebdd3f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:15.704796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1017/2041] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:15.716891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb0af8-be37-413b-a7f3-ebe8638cc5b2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:15.719329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-82cb0af8-be37-413b-a7f3-ebe8638cc5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:15.761537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d03be-c5da-4005-abfa-2150b4c73f81 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.762078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d03be-c5da-4005-abfa-2150b4c73f81 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.762480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d03be-c5da-4005-abfa-2150b4c73f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.795190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb0af8-be37-413b-a7f3-ebe8638cc5b2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:15.800895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae74f3c-b3ef-4e90-b51a-50462f060faa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:15.801653 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae74f3c-b3ef-4e90-b51a-50462f060faa service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.802054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae74f3c-b3ef-4e90-b51a-50462f060faa service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.802435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae74f3c-b3ef-4e90-b51a-50462f060faa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.807142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-466d03be-c5da-4005-abfa-2150b4c73f81 None None] MFA Rules not processed for user `ffcf0f621514406393cbb897e8b1379d`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:15.808384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-466d03be-c5da-4005-abfa-2150b4c73f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:15.850017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:15.868095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae74f3c-b3ef-4e90-b51a-50462f060faa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:15.869720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae74f3c-b3ef-4e90-b51a-50462f060faa service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:15.880754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1025/2042] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:15.915001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1018/2043] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:15.923066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05233a42-0bca-45b4-8c3f-c532fc4c6d65 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.923458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05233a42-0bca-45b4-8c3f-c532fc4c6d65 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.923808 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05233a42-0bca-45b4-8c3f-c532fc4c6d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.944048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-05233a42-0bca-45b4-8c3f-c532fc4c6d65 None None] MFA Rules not processed for user `4eeecbf2164d43a2b52b65ba36a6cea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:15.945335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-05233a42-0bca-45b4-8c3f-c532fc4c6d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:16.030619 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1026/2044] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:16.043387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d03be-c5da-4005-abfa-2150b4c73f81 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:16.044873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-466d03be-c5da-4005-abfa-2150b4c73f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:16.131543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d03be-c5da-4005-abfa-2150b4c73f81 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:16.137462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea07981-d931-426d-80aa-0e1dc5584953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:16.138117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea07981-d931-426d-80aa-0e1dc5584953 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:16.138432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea07981-d931-426d-80aa-0e1dc5584953 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:16.138719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea07981-d931-426d-80aa-0e1dc5584953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:16.149219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea07981-d931-426d-80aa-0e1dc5584953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:16.151259 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea07981-d931-426d-80aa-0e1dc5584953 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:16.162231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1019/2045] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:17.467932 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05233a42-0bca-45b4-8c3f-c532fc4c6d65 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:17.470024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-05233a42-0bca-45b4-8c3f-c532fc4c6d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:17.481786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05233a42-0bca-45b4-8c3f-c532fc4c6d65 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:17.486097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37517690-e697-4b44-91b4-d856d7a7cf91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:17.486805 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37517690-e697-4b44-91b4-d856d7a7cf91 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:17.487087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37517690-e697-4b44-91b4-d856d7a7cf91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:17.487361 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37517690-e697-4b44-91b4-d856d7a7cf91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:17.527534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:17.546486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37517690-e697-4b44-91b4-d856d7a7cf91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:17.548468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37517690-e697-4b44-91b4-d856d7a7cf91 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:17.557125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1027/2046] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:10:18.167940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea07981-d931-426d-80aa-0e1dc5584953 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:18.178976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea07981-d931-426d-80aa-0e1dc5584953 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:18.183078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4d564-136c-4071-9dc2-c165fc72129c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:18.183793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d564-136c-4071-9dc2-c165fc72129c service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:18.184132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d564-136c-4071-9dc2-c165fc72129c service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:18.184361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d564-136c-4071-9dc2-c165fc72129c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:18.194715 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4d564-136c-4071-9dc2-c165fc72129c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:18.196252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4d564-136c-4071-9dc2-c165fc72129c service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:18.207389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1020/2047] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:22.169342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37517690-e697-4b44-91b4-d856d7a7cf91 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:22.231016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37517690-e697-4b44-91b4-d856d7a7cf91 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:22.235710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:22.236575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:22.236853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:22.237125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] PATH_INFO: `/v3/users/fc292d41383e4dde937d3d20c2d5aa12` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:22.238285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc292d41383e4dde937d3d20c2d5aa12)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:22.240207 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:22.287674 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc292d41383e4dde937d3d20c2d5aa12'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:22.288250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc292d41383e4dde937d3d20c2d5aa12'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:22.295005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc292d41383e4dde937d3d20c2d5aa12'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:22.302172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc292d41383e4dde937d3d20c2d5aa12'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:22.302804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc292d41383e4dde937d3d20c2d5aa12'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:22.320135 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1028/2048] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:22 2022] DELETE /identity/v3/users/fc292d41383e4dde937d3d20c2d5aa12 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:22.324594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c292d4d-8dbc-4f98-b4a7-feb163975411 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:22.325070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c292d4d-8dbc-4f98-b4a7-feb163975411 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:22.325159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c292d4d-8dbc-4f98-b4a7-feb163975411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:22.343023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5c292d4d-8dbc-4f98-b4a7-feb163975411 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:22.344315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5c292d4d-8dbc-4f98-b4a7-feb163975411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:22.405720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1021/2049] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:22.415373 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:22.416830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:22.479765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e427c31-99a6-4586-b035-83c2f5564f05 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:22.483525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b08bff-4587-48b4-b9f9-9fa4f30bf854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:22.484179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b08bff-4587-48b4-b9f9-9fa4f30bf854 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:22.484468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b08bff-4587-48b4-b9f9-9fa4f30bf854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:22.484780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b08bff-4587-48b4-b9f9-9fa4f30bf854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:22.494211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b08bff-4587-48b4-b9f9-9fa4f30bf854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:22.495689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b08bff-4587-48b4-b9f9-9fa4f30bf854 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:22.501229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:22.515726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1029/2050] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:22.816443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c292d4d-8dbc-4f98-b4a7-feb163975411 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:22.818209 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5c292d4d-8dbc-4f98-b4a7-feb163975411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:22.832800 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c292d4d-8dbc-4f98-b4a7-feb163975411 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:22.838559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:22.839429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:22.839905 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:22.840192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] PATH_INFO: `/v3/projects/d802cb5f320842a283908e3e59c95ecb` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:22.841533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d802cb5f320842a283908e3e59c95ecb)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:22.843496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:22.898929 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:22.908098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd802cb5f320842a283908e3e59c95ecb', 'request_id': 'req-545e8e6f-cc86-4122-b12b-87d8ab6295d3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:22.913583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd802cb5f320842a283908e3e59c95ecb', 'request_id': 'req-545e8e6f-cc86-4122-b12b-87d8ab6295d3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:22.919776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd802cb5f320842a283908e3e59c95ecb', 'request_id': 'req-545e8e6f-cc86-4122-b12b-87d8ab6295d3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:22.932904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] The token cache is being invalidate because project d802cb5f320842a283908e3e59c95ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:22.933227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:22.933870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:22.935506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1022/2051] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:22 2022] DELETE /identity/v3/projects/d802cb5f320842a283908e3e59c95ecb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:10:22.939466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b08bff-4587-48b4-b9f9-9fa4f30bf854 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:22.949383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b08bff-4587-48b4-b9f9-9fa4f30bf854 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:23.013110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:23.014079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:23.014384 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:23.014829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] PATH_INFO: `/v3/users/1f0a1c8ad0414ba2be38ce08ca422190` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:23.016932 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f0a1c8ad0414ba2be38ce08ca422190)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:23.018971 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:23.071179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f0a1c8ad0414ba2be38ce08ca422190'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.071758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f0a1c8ad0414ba2be38ce08ca422190'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.079699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f0a1c8ad0414ba2be38ce08ca422190'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.087485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f0a1c8ad0414ba2be38ce08ca422190'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.088161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f0a1c8ad0414ba2be38ce08ca422190'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.106123 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1030/2052] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:22 2022] DELETE /identity/v3/users/1f0a1c8ad0414ba2be38ce08ca422190 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:23.392235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:23.393932 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:23.410385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e8e6f-cc86-4122-b12b-87d8ab6295d3 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:23.471919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:23.472790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:23.473078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:23.473357 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] PATH_INFO: `/v3/projects/c996d757a94d410b927bf02d4e13119e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:23.474570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c996d757a94d410b927bf02d4e13119e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:23.476488 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:23.528020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c996d757a94d410b927bf02d4e13119e', 'request_id': 'req-2bd93ee6-db18-45af-af69-0c4f5299fb9a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.534240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c996d757a94d410b927bf02d4e13119e', 'request_id': 'req-2bd93ee6-db18-45af-af69-0c4f5299fb9a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.540919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c996d757a94d410b927bf02d4e13119e', 'request_id': 'req-2bd93ee6-db18-45af-af69-0c4f5299fb9a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.556829 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] The token cache is being invalidate because project c996d757a94d410b927bf02d4e13119e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:23.557130 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.557804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.559426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1023/2053] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:23 2022] DELETE /identity/v3/projects/c996d757a94d410b927bf02d4e13119e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:10:23.563540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:23.565043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:23.579768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b90d95-979f-4575-9d23-7dc247283815 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:23.653449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e416ae0-e861-4622-b7ac-0e1945e24847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:23.654372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e416ae0-e861-4622-b7ac-0e1945e24847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:23.654763 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e416ae0-e861-4622-b7ac-0e1945e24847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:23.655101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e416ae0-e861-4622-b7ac-0e1945e24847 admin admin] PATH_INFO: `/v3/users/f1d8ca6338664ff091f0c7139c0d39da` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:23.656410 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e416ae0-e861-4622-b7ac-0e1945e24847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d8ca6338664ff091f0c7139c0d39da)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:23.659696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e416ae0-e861-4622-b7ac-0e1945e24847 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:23.686004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:23.713860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3e416ae0-e861-4622-b7ac-0e1945e24847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d8ca6338664ff091f0c7139c0d39da'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.714565 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3e416ae0-e861-4622-b7ac-0e1945e24847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d8ca6338664ff091f0c7139c0d39da'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.722196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3e416ae0-e861-4622-b7ac-0e1945e24847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d8ca6338664ff091f0c7139c0d39da'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.730761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3e416ae0-e861-4622-b7ac-0e1945e24847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d8ca6338664ff091f0c7139c0d39da'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.731711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3e416ae0-e861-4622-b7ac-0e1945e24847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d8ca6338664ff091f0c7139c0d39da'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:23.750948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1031/2054] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:23 2022] DELETE /identity/v3/users/f1d8ca6338664ff091f0c7139c0d39da => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:24.041619 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:24.043220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:24.057639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93ee6-db18-45af-af69-0c4f5299fb9a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:24.117041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:24.124012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d530b-4ba6-4210-abfa-30d4701eebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:24.125077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d530b-4ba6-4210-abfa-30d4701eebfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:24.126196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d530b-4ba6-4210-abfa-30d4701eebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:24.126861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d530b-4ba6-4210-abfa-30d4701eebfa admin admin] PATH_INFO: `/v3/projects/70a9b908255b4bd6ac077dd62c7f9721` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:24.128350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d530b-4ba6-4210-abfa-30d4701eebfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a9b908255b4bd6ac077dd62c7f9721)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:24.130938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d530b-4ba6-4210-abfa-30d4701eebfa admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:24.177262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-186d530b-4ba6-4210-abfa-30d4701eebfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a9b908255b4bd6ac077dd62c7f9721', 'request_id': 'req-186d530b-4ba6-4210-abfa-30d4701eebfa'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:24.182706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-186d530b-4ba6-4210-abfa-30d4701eebfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a9b908255b4bd6ac077dd62c7f9721', 'request_id': 'req-186d530b-4ba6-4210-abfa-30d4701eebfa'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:24.189480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-186d530b-4ba6-4210-abfa-30d4701eebfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a9b908255b4bd6ac077dd62c7f9721', 'request_id': 'req-186d530b-4ba6-4210-abfa-30d4701eebfa'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:24.201393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-186d530b-4ba6-4210-abfa-30d4701eebfa admin admin] The token cache is being invalidate because project 70a9b908255b4bd6ac077dd62c7f9721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:24.201678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-186d530b-4ba6-4210-abfa-30d4701eebfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:24.202304 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-186d530b-4ba6-4210-abfa-30d4701eebfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:24.204161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1024/2055] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:24 2022] DELETE /identity/v3/projects/70a9b908255b4bd6ac077dd62c7f9721 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:24.209126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61632ae4-ac25-4656-b252-9356580920d4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:24.209495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61632ae4-ac25-4656-b252-9356580920d4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:24.209845 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61632ae4-ac25-4656-b252-9356580920d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:24.229709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-61632ae4-ac25-4656-b252-9356580920d4 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:24.230987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-61632ae4-ac25-4656-b252-9356580920d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:24.292599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1032/2056] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:24.300989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a522914-39e5-4900-a7bf-8166a2897099 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:24.301360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a522914-39e5-4900-a7bf-8166a2897099 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:24.301711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a522914-39e5-4900-a7bf-8166a2897099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:24.321431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0a522914-39e5-4900-a7bf-8166a2897099 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:24.322678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0a522914-39e5-4900-a7bf-8166a2897099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:24.331426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1025/2057] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:24.337525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61632ae4-ac25-4656-b252-9356580920d4 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:24.349181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61632ae4-ac25-4656-b252-9356580920d4 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:24.354196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba443cd-877e-4aea-aae7-b48239c75ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:24.355013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba443cd-877e-4aea-aae7-b48239c75ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:24.355368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba443cd-877e-4aea-aae7-b48239c75ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:24.355653 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba443cd-877e-4aea-aae7-b48239c75ef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:24.356381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba443cd-877e-4aea-aae7-b48239c75ef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:10:24.356687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba443cd-877e-4aea-aae7-b48239c75ef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:24.358264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba443cd-877e-4aea-aae7-b48239c75ef4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:24.370918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1033/2058] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:10:24.375994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a522914-39e5-4900-a7bf-8166a2897099 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:24.385744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a522914-39e5-4900-a7bf-8166a2897099 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:24.390665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4b2ac-a946-48ae-95ad-ddbb20f2316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:24.391846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4b2ac-a946-48ae-95ad-ddbb20f2316e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:24.392129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4b2ac-a946-48ae-95ad-ddbb20f2316e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:24.392403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4b2ac-a946-48ae-95ad-ddbb20f2316e admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:24.393112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4b2ac-a946-48ae-95ad-ddbb20f2316e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:24.395102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4b2ac-a946-48ae-95ad-ddbb20f2316e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:24.424609 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1026/2059] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:24 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:24.425704 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba443cd-877e-4aea-aae7-b48239c75ef4 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:24.436075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba443cd-877e-4aea-aae7-b48239c75ef4 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:24.496687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a73664-1957-430e-a1cd-3547492ba0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:24.497360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a73664-1957-430e-a1cd-3547492ba0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:24.497649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a73664-1957-430e-a1cd-3547492ba0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:24.497929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a73664-1957-430e-a1cd-3547492ba0f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:24.498723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a73664-1957-430e-a1cd-3547492ba0f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:24.501155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a73664-1957-430e-a1cd-3547492ba0f3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:24.521199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1034/2060] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:24 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:24.525454 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4b2ac-a946-48ae-95ad-ddbb20f2316e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:24.535767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4b2ac-a946-48ae-95ad-ddbb20f2316e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:24.540563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a3cbf-d668-4b93-86e5-070104282ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:24.541209 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a3cbf-d668-4b93-86e5-070104282ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:24.541490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a3cbf-d668-4b93-86e5-070104282ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:24.541761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a3cbf-d668-4b93-86e5-070104282ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:24.542706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a3cbf-d668-4b93-86e5-070104282ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:24.544495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a3cbf-d668-4b93-86e5-070104282ec8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:24.560410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1027/2061] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:24.561589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a73664-1957-430e-a1cd-3547492ba0f3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:24.572451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a73664-1957-430e-a1cd-3547492ba0f3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:24.577168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a5615-fd73-4ca1-a634-287ff90b750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:24.577829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5615-fd73-4ca1-a634-287ff90b750a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:24.578118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5615-fd73-4ca1-a634-287ff90b750a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:24.578469 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5615-fd73-4ca1-a634-287ff90b750a admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:24.580020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a5615-fd73-4ca1-a634-287ff90b750a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:24.581954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a5615-fd73-4ca1-a634-287ff90b750a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:24.596554 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1035/2062] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:10:24.597750 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a3cbf-d668-4b93-86e5-070104282ec8 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:24.607840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a3cbf-d668-4b93-86e5-070104282ec8 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:24.613039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8fb45-f10b-4e9e-a597-da1b64fb0a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:24.613907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8fb45-f10b-4e9e-a597-da1b64fb0a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:24.614186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8fb45-f10b-4e9e-a597-da1b64fb0a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:24.614501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8fb45-f10b-4e9e-a597-da1b64fb0a42 admin admin] PATH_INFO: `/v3/projects/c2eff14d3a4043bf820a6411d390f669/users/d0a8726a4e3c4b3aa001cd5bc47243de/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:24.631326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8fb45-f10b-4e9e-a597-da1b64fb0a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2eff14d3a4043bf820a6411d390f669, user_id=d0a8726a4e3c4b3aa001cd5bc47243de, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:24.634024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8fb45-f10b-4e9e-a597-da1b64fb0a42 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:24.648878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1028/2063] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:24 2022] PUT /identity/v3/projects/c2eff14d3a4043bf820a6411d390f669/users/d0a8726a4e3c4b3aa001cd5bc47243de/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:24.653512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b79622-0fcd-4317-b7ce-95847f953f5a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:24.653841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b79622-0fcd-4317-b7ce-95847f953f5a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:24.654103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b79622-0fcd-4317-b7ce-95847f953f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:24.661276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:24.673335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-71b79622-0fcd-4317-b7ce-95847f953f5a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:24.675487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-71b79622-0fcd-4317-b7ce-95847f953f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:24.735266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1036/2064] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:24.745768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8fb45-f10b-4e9e-a597-da1b64fb0a42 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:24.747493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5cc8fb45-f10b-4e9e-a597-da1b64fb0a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:24.817272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8fb45-f10b-4e9e-a597-da1b64fb0a42 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:24.821469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7af6f-707e-4cc9-a2ae-fe27b856ddce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:24.822120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7af6f-707e-4cc9-a2ae-fe27b856ddce service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:24.822451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7af6f-707e-4cc9-a2ae-fe27b856ddce service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:24.822767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7af6f-707e-4cc9-a2ae-fe27b856ddce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:24.833858 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7af6f-707e-4cc9-a2ae-fe27b856ddce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:24.835520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7af6f-707e-4cc9-a2ae-fe27b856ddce service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:24.847203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1029/2065] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:25.690090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9f43-a97f-4959-a71d-46ec964d24c3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:25.690660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9f43-a97f-4959-a71d-46ec964d24c3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:25.690752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9f43-a97f-4959-a71d-46ec964d24c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:25.721629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-271d9f43-a97f-4959-a71d-46ec964d24c3 None None] MFA Rules not processed for user `d0a8726a4e3c4b3aa001cd5bc47243de`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:25.722979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-271d9f43-a97f-4959-a71d-46ec964d24c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:25.809809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1037/2066] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:25.821301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7af6f-707e-4cc9-a2ae-fe27b856ddce service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:25.822809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1dd7af6f-707e-4cc9-a2ae-fe27b856ddce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:25.856078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:25.890030 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7af6f-707e-4cc9-a2ae-fe27b856ddce service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:25.893756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd13263-0bde-4b16-8c62-92cc829bfe3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:25.894452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd13263-0bde-4b16-8c62-92cc829bfe3e service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:25.894750 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd13263-0bde-4b16-8c62-92cc829bfe3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:25.895043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd13263-0bde-4b16-8c62-92cc829bfe3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:25.903384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd13263-0bde-4b16-8c62-92cc829bfe3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:25.904823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd13263-0bde-4b16-8c62-92cc829bfe3e service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:25.913803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1030/2067] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:27.273590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960afbd-63f3-4b97-ad5c-cfd6d957b791 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:27.274148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960afbd-63f3-4b97-ad5c-cfd6d957b791 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:27.274148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960afbd-63f3-4b97-ad5c-cfd6d957b791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:27.292266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f960afbd-63f3-4b97-ad5c-cfd6d957b791 None None] MFA Rules not processed for user `d0a8726a4e3c4b3aa001cd5bc47243de`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:27.293471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f960afbd-63f3-4b97-ad5c-cfd6d957b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:27.300468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1038/2068] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:29.166588 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd13263-0bde-4b16-8c62-92cc829bfe3e service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:29.168127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bbd13263-0bde-4b16-8c62-92cc829bfe3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:29.181738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd13263-0bde-4b16-8c62-92cc829bfe3e service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:29.186407 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b301a8d-ecf2-4398-a50e-b1d924e44561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:29.186897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b301a8d-ecf2-4398-a50e-b1d924e44561 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:29.187186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b301a8d-ecf2-4398-a50e-b1d924e44561 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:29.187471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b301a8d-ecf2-4398-a50e-b1d924e44561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:29.189322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5b301a8d-ecf2-4398-a50e-b1d924e44561 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:29.266330 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b301a8d-ecf2-4398-a50e-b1d924e44561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:29.268210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b301a8d-ecf2-4398-a50e-b1d924e44561 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:29.279958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1031/2069] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:29 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:10:37.287152 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=60 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:39.158811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960afbd-63f3-4b97-ad5c-cfd6d957b791 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:39.162095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f960afbd-63f3-4b97-ad5c-cfd6d957b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:39.183921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960afbd-63f3-4b97-ad5c-cfd6d957b791 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:39.190129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:39.191074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:39.191361 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:39.191638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] PATH_INFO: `/v3/users/bb77707dadf14555a6d2389fc5c12d71` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:39.192882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb77707dadf14555a6d2389fc5c12d71)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:39.194919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:39.256602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb77707dadf14555a6d2389fc5c12d71'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:39.257342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb77707dadf14555a6d2389fc5c12d71'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:39.265535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb77707dadf14555a6d2389fc5c12d71'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:39.274907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=44 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:39.276442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb77707dadf14555a6d2389fc5c12d71'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:39.277194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb77707dadf14555a6d2389fc5c12d71'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:39.302861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1039/2070] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:39 2022] DELETE /identity/v3/users/bb77707dadf14555a6d2389fc5c12d71 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:39.307373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55159-ddba-4af9-b352-d9ed93c109b8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:39.307831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55159-ddba-4af9-b352-d9ed93c109b8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:39.308161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55159-ddba-4af9-b352-d9ed93c109b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:39.326459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-cae55159-ddba-4af9-b352-d9ed93c109b8 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:39.327665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cae55159-ddba-4af9-b352-d9ed93c109b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:39.399555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1032/2071] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:39.409578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:39.411285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:39.488788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00504151-7963-4dad-9cec-0231066dc2da admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:39.493615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2221c75-dc71-4d41-b1f2-bfe5eb12a1b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:39.494591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2221c75-dc71-4d41-b1f2-bfe5eb12a1b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:39.494999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2221c75-dc71-4d41-b1f2-bfe5eb12a1b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:39.495535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2221c75-dc71-4d41-b1f2-bfe5eb12a1b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:39.510054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2221c75-dc71-4d41-b1f2-bfe5eb12a1b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:39.511814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2221c75-dc71-4d41-b1f2-bfe5eb12a1b3 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:39.522693 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1040/2072] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:39.805451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55159-ddba-4af9-b352-d9ed93c109b8 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:39.806917 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cae55159-ddba-4af9-b352-d9ed93c109b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:39.819186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55159-ddba-4af9-b352-d9ed93c109b8 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:39.823812 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25394d29-54bd-4dad-965f-4df8861d949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:39.824702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25394d29-54bd-4dad-965f-4df8861d949c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:39.824988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25394d29-54bd-4dad-965f-4df8861d949c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:39.825265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25394d29-54bd-4dad-965f-4df8861d949c admin admin] PATH_INFO: `/v3/projects/4754fb438a0f4a8d909069bc2f71360d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:39.826635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25394d29-54bd-4dad-965f-4df8861d949c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4754fb438a0f4a8d909069bc2f71360d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:39.828562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25394d29-54bd-4dad-965f-4df8861d949c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:39.877410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-25394d29-54bd-4dad-965f-4df8861d949c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4754fb438a0f4a8d909069bc2f71360d', 'request_id': 'req-25394d29-54bd-4dad-965f-4df8861d949c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:39.883710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-25394d29-54bd-4dad-965f-4df8861d949c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4754fb438a0f4a8d909069bc2f71360d', 'request_id': 'req-25394d29-54bd-4dad-965f-4df8861d949c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:39.889829 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-25394d29-54bd-4dad-965f-4df8861d949c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4754fb438a0f4a8d909069bc2f71360d', 'request_id': 'req-25394d29-54bd-4dad-965f-4df8861d949c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:39.902246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-25394d29-54bd-4dad-965f-4df8861d949c admin admin] The token cache is being invalidate because project 4754fb438a0f4a8d909069bc2f71360d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:39.902573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-25394d29-54bd-4dad-965f-4df8861d949c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:39.903204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-25394d29-54bd-4dad-965f-4df8861d949c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:39.904774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1033/2073] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:39 2022] DELETE /identity/v3/projects/4754fb438a0f4a8d909069bc2f71360d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:39.909636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05064bf8-1212-4c77-a9ad-5c7b24593001 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:39.909935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05064bf8-1212-4c77-a9ad-5c7b24593001 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:39.910214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05064bf8-1212-4c77-a9ad-5c7b24593001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:39.928768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-05064bf8-1212-4c77-a9ad-5c7b24593001 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:39.929973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-05064bf8-1212-4c77-a9ad-5c7b24593001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:39.994101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1041/2074] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:40.002044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2cd14-b888-4abd-be84-14eac000198f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:40.002272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2cd14-b888-4abd-be84-14eac000198f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:40.002629 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2cd14-b888-4abd-be84-14eac000198f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:40.022885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-02d2cd14-b888-4abd-be84-14eac000198f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:40.024092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-02d2cd14-b888-4abd-be84-14eac000198f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:40.032052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1034/2075] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:40.036816 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05064bf8-1212-4c77-a9ad-5c7b24593001 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:40.046317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05064bf8-1212-4c77-a9ad-5c7b24593001 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:40.051979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed75a2-d38a-412e-8bca-375d7f98831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:40.052636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed75a2-d38a-412e-8bca-375d7f98831b admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:40.052919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed75a2-d38a-412e-8bca-375d7f98831b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:40.053568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed75a2-d38a-412e-8bca-375d7f98831b admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:40.053902 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed75a2-d38a-412e-8bca-375d7f98831b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:10:40.054211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed75a2-d38a-412e-8bca-375d7f98831b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:40.055817 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed75a2-d38a-412e-8bca-375d7f98831b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:40.068628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1042/2076] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:10:40.073052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2cd14-b888-4abd-be84-14eac000198f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:40.084165 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2cd14-b888-4abd-be84-14eac000198f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:40.089527 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea2d7f-d3df-44db-8dc8-eeef4b9d4848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:40.090760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea2d7f-d3df-44db-8dc8-eeef4b9d4848 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:40.090975 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea2d7f-d3df-44db-8dc8-eeef4b9d4848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:40.091284 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea2d7f-d3df-44db-8dc8-eeef4b9d4848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:40.092256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea2d7f-d3df-44db-8dc8-eeef4b9d4848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:40.094518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea2d7f-d3df-44db-8dc8-eeef4b9d4848 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:40.121725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1035/2077] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:40 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:40.126027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed75a2-d38a-412e-8bca-375d7f98831b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:40.132153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:40.139500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed75a2-d38a-412e-8bca-375d7f98831b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:40.200339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1642c-62c8-47df-ab96-6a927ff860d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:40.201085 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1642c-62c8-47df-ab96-6a927ff860d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:40.201373 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1642c-62c8-47df-ab96-6a927ff860d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:40.201684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1642c-62c8-47df-ab96-6a927ff860d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:40.202503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1642c-62c8-47df-ab96-6a927ff860d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:40.204752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1642c-62c8-47df-ab96-6a927ff860d3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:40.224657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1043/2078] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:40 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:40.228746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea2d7f-d3df-44db-8dc8-eeef4b9d4848 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:40.239262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea2d7f-d3df-44db-8dc8-eeef4b9d4848 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:40.244128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bf387-25e8-483e-9169-5ff50c0d799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:40.244802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bf387-25e8-483e-9169-5ff50c0d799a admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:40.245107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bf387-25e8-483e-9169-5ff50c0d799a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:40.245376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bf387-25e8-483e-9169-5ff50c0d799a admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:40.246106 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bf387-25e8-483e-9169-5ff50c0d799a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:40.247749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bf387-25e8-483e-9169-5ff50c0d799a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:40.259344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1036/2079] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:40.263226 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1642c-62c8-47df-ab96-6a927ff860d3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:40.273952 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1642c-62c8-47df-ab96-6a927ff860d3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:40.278557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f697e-b96e-4b5b-a0ca-e08015b6e997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:40.279223 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f697e-b96e-4b5b-a0ca-e08015b6e997 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:40.279509 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f697e-b96e-4b5b-a0ca-e08015b6e997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:40.279785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f697e-b96e-4b5b-a0ca-e08015b6e997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:40.280510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f697e-b96e-4b5b-a0ca-e08015b6e997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:40.282088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f697e-b96e-4b5b-a0ca-e08015b6e997 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:40.295323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1044/2080] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:40.297160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bf387-25e8-483e-9169-5ff50c0d799a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:40.310053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bf387-25e8-483e-9169-5ff50c0d799a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:40.314778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaefbe6-8101-406b-9a64-01663a54b040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:40.316200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaefbe6-8101-406b-9a64-01663a54b040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:40.316504 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaefbe6-8101-406b-9a64-01663a54b040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:40.316747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaefbe6-8101-406b-9a64-01663a54b040 admin admin] PATH_INFO: `/v3/projects/ff6ed5ccc6174c2f809b231578ea3acf/users/11f27b6958a546f3825008e10a1cbf6e/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:40.333563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaefbe6-8101-406b-9a64-01663a54b040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6ed5ccc6174c2f809b231578ea3acf, user_id=11f27b6958a546f3825008e10a1cbf6e, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:40.336562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaefbe6-8101-406b-9a64-01663a54b040 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:40.352770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1037/2081] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:40 2022] PUT /identity/v3/projects/ff6ed5ccc6174c2f809b231578ea3acf/users/11f27b6958a546f3825008e10a1cbf6e/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:40.365550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4c417-1040-4300-b1af-ae8e497cbd2f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:40.365998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4c417-1040-4300-b1af-ae8e497cbd2f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:40.366291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4c417-1040-4300-b1af-ae8e497cbd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:40.399928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b6f4c417-1040-4300-b1af-ae8e497cbd2f None None] MFA Rules not processed for user `11f27b6958a546f3825008e10a1cbf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:40.401522 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b6f4c417-1040-4300-b1af-ae8e497cbd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:40.472891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1045/2082] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:40.526712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaefbe6-8101-406b-9a64-01663a54b040 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:40.528903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8eaefbe6-8101-406b-9a64-01663a54b040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:40.553442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:40.606561 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaefbe6-8101-406b-9a64-01663a54b040 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:40.611026 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d251ac-de0d-4f42-982e-14e75126037d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:40.612745 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d251ac-de0d-4f42-982e-14e75126037d service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:40.613354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d251ac-de0d-4f42-982e-14e75126037d service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:40.613882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d251ac-de0d-4f42-982e-14e75126037d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:40.624024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d251ac-de0d-4f42-982e-14e75126037d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:40.625495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d251ac-de0d-4f42-982e-14e75126037d service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:40.648127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1038/2083] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:44.636038 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ecb60-f740-4add-b21f-ecdb7e9b0ee2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:44.636597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ecb60-f740-4add-b21f-ecdb7e9b0ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:44.636688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ecb60-f740-4add-b21f-ecdb7e9b0ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:44.657098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-330ecb60-f740-4add-b21f-ecdb7e9b0ee2 None None] MFA Rules not processed for user `d0a8726a4e3c4b3aa001cd5bc47243de`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:44.658311 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-330ecb60-f740-4add-b21f-ecdb7e9b0ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:44.730671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1046/2084] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:45.838851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d251ac-de0d-4f42-982e-14e75126037d service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:45.933958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d251ac-de0d-4f42-982e-14e75126037d service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:45.940124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:45.941046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:45.941329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:45.941601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] PATH_INFO: `/v3/users/11f27b6958a546f3825008e10a1cbf6e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:45.942873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f27b6958a546f3825008e10a1cbf6e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:45.944907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:45.995711 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f27b6958a546f3825008e10a1cbf6e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:46.008918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f27b6958a546f3825008e10a1cbf6e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:46.009792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f27b6958a546f3825008e10a1cbf6e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:46.017425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f27b6958a546f3825008e10a1cbf6e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:46.018128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f27b6958a546f3825008e10a1cbf6e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:46.034837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1039/2085] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:45 2022] DELETE /identity/v3/users/11f27b6958a546f3825008e10a1cbf6e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:46.040110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460688f5-b382-4d48-81a8-a1a0fc4fbdc1 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:46.040583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460688f5-b382-4d48-81a8-a1a0fc4fbdc1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:46.040675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460688f5-b382-4d48-81a8-a1a0fc4fbdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:46.057986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-460688f5-b382-4d48-81a8-a1a0fc4fbdc1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:46.059221 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-460688f5-b382-4d48-81a8-a1a0fc4fbdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:46.068276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:46.119805 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1047/2086] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:46.129771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:46.132047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:46.179417 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:46.192265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e81b4-b533-4794-8f55-c1ad85cf0f39 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:46.196583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd1e08-354a-4edd-9206-a73785862843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:46.197230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd1e08-354a-4edd-9206-a73785862843 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:46.197518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd1e08-354a-4edd-9206-a73785862843 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:46.197797 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd1e08-354a-4edd-9206-a73785862843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:46.206972 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd1e08-354a-4edd-9206-a73785862843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:46.208393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd1e08-354a-4edd-9206-a73785862843 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:46.218317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1040/2087] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:46.606218 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460688f5-b382-4d48-81a8-a1a0fc4fbdc1 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:46.608009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-460688f5-b382-4d48-81a8-a1a0fc4fbdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:46.620361 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460688f5-b382-4d48-81a8-a1a0fc4fbdc1 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:46.624921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f63c2-f50b-4809-b03b-9364b1ed656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:46.625736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f63c2-f50b-4809-b03b-9364b1ed656a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:46.626018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f63c2-f50b-4809-b03b-9364b1ed656a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:46.626294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f63c2-f50b-4809-b03b-9364b1ed656a admin admin] PATH_INFO: `/v3/projects/ff6ed5ccc6174c2f809b231578ea3acf` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:46.627523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f63c2-f50b-4809-b03b-9364b1ed656a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6ed5ccc6174c2f809b231578ea3acf)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:46.629410 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f63c2-f50b-4809-b03b-9364b1ed656a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:46.688124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1f2f63c2-f50b-4809-b03b-9364b1ed656a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6ed5ccc6174c2f809b231578ea3acf', 'request_id': 'req-1f2f63c2-f50b-4809-b03b-9364b1ed656a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:46.696845 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1f2f63c2-f50b-4809-b03b-9364b1ed656a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6ed5ccc6174c2f809b231578ea3acf', 'request_id': 'req-1f2f63c2-f50b-4809-b03b-9364b1ed656a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:46.703773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1f2f63c2-f50b-4809-b03b-9364b1ed656a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6ed5ccc6174c2f809b231578ea3acf', 'request_id': 'req-1f2f63c2-f50b-4809-b03b-9364b1ed656a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:46.714968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1f2f63c2-f50b-4809-b03b-9364b1ed656a admin admin] The token cache is being invalidate because project ff6ed5ccc6174c2f809b231578ea3acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:46.715262 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1f2f63c2-f50b-4809-b03b-9364b1ed656a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:46.715923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1f2f63c2-f50b-4809-b03b-9364b1ed656a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:46.717563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1048/2088] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:46 2022] DELETE /identity/v3/projects/ff6ed5ccc6174c2f809b231578ea3acf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:50.943336 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb51e38-2a22-4ae8-9cb9-7a646db57e46 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:50.945045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb51e38-2a22-4ae8-9cb9-7a646db57e46 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:50.945676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb51e38-2a22-4ae8-9cb9-7a646db57e46 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:50.947472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1041/2089] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 23 17:10:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:50.958660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a30b3-8586-48c0-8a49-d171132f5535 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:50.959817 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a30b3-8586-48c0-8a49-d171132f5535 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:50.960286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a30b3-8586-48c0-8a49-d171132f5535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:50.992811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-406a30b3-8586-48c0-8a49-d171132f5535 None None] MFA Rules not processed for user `81fb8b261e2142fcbf8d23bd010bf715`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:50.994188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-406a30b3-8586-48c0-8a49-d171132f5535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:51.030919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb51e38-2a22-4ae8-9cb9-7a646db57e46 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:51.032697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dcb51e38-2a22-4ae8-9cb9-7a646db57e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:51.103681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:51.139768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1049/2090] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 23 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:51.152242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a30b3-8586-48c0-8a49-d171132f5535 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:51.153565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb51e38-2a22-4ae8-9cb9-7a646db57e46 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:51.154739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-406a30b3-8586-48c0-8a49-d171132f5535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:51.158575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:51.159450 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:51.159731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:51.160145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] PATH_INFO: `/v3/users/4eeecbf2164d43a2b52b65ba36a6cea6` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:51.161364 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eeecbf2164d43a2b52b65ba36a6cea6)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:51.164378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:51.169176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a30b3-8586-48c0-8a49-d171132f5535 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:51.175548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f15f56-6ede-4cd5-8cba-3ea180b8e44d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81fb8b261e2142fcbf8d23bd010bf715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:51.176415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f15f56-6ede-4cd5-8cba-3ea180b8e44d service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:51.176805 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f15f56-6ede-4cd5-8cba-3ea180b8e44d service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:51.177185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f15f56-6ede-4cd5-8cba-3ea180b8e44d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:51.188440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f15f56-6ede-4cd5-8cba-3ea180b8e44d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:51.190613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f15f56-6ede-4cd5-8cba-3ea180b8e44d service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:51.203093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1050/2091] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:10:51.230264 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eeecbf2164d43a2b52b65ba36a6cea6'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.245296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eeecbf2164d43a2b52b65ba36a6cea6'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.246079 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eeecbf2164d43a2b52b65ba36a6cea6'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.255060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eeecbf2164d43a2b52b65ba36a6cea6'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.255815 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eeecbf2164d43a2b52b65ba36a6cea6'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.271042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1042/2092] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:51 2022] DELETE /identity/v3/users/4eeecbf2164d43a2b52b65ba36a6cea6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:10:51.450507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f15f56-6ede-4cd5-8cba-3ea180b8e44d service placement] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:51.461358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f15f56-6ede-4cd5-8cba-3ea180b8e44d service placement] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:51.523415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:51.524209 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:51.524490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:51.524762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] PATH_INFO: `/v3/projects/5fc82bf4e28c4820ab212d716ef1f90c` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:51.525944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc82bf4e28c4820ab212d716ef1f90c)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:51.527909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:51.572664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc82bf4e28c4820ab212d716ef1f90c', 'request_id': 'req-1245a43a-0166-4ac0-be65-918811421c2c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.580819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc82bf4e28c4820ab212d716ef1f90c', 'request_id': 'req-1245a43a-0166-4ac0-be65-918811421c2c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.588547 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc82bf4e28c4820ab212d716ef1f90c', 'request_id': 'req-1245a43a-0166-4ac0-be65-918811421c2c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.598724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] The token cache is being invalidate because project 5fc82bf4e28c4820ab212d716ef1f90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:51.599011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.599689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.601234 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1051/2093] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:51 2022] DELETE /identity/v3/projects/5fc82bf4e28c4820ab212d716ef1f90c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:51.605351 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:51.606766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:51.619639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43f9af-8ac7-40b1-8976-0e25e04ba111 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:51.654501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:51.683588 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01590d9e-2e0f-4ce2-b3fb-7a1dc0b2311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:51.684575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01590d9e-2e0f-4ce2-b3fb-7a1dc0b2311b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:51.684861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01590d9e-2e0f-4ce2-b3fb-7a1dc0b2311b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:51.685169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01590d9e-2e0f-4ce2-b3fb-7a1dc0b2311b admin admin] PATH_INFO: `/v3/users/ffcf0f621514406393cbb897e8b1379d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:51.686375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01590d9e-2e0f-4ce2-b3fb-7a1dc0b2311b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffcf0f621514406393cbb897e8b1379d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:51.688501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01590d9e-2e0f-4ce2-b3fb-7a1dc0b2311b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:51.738056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-01590d9e-2e0f-4ce2-b3fb-7a1dc0b2311b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffcf0f621514406393cbb897e8b1379d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.752123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-01590d9e-2e0f-4ce2-b3fb-7a1dc0b2311b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffcf0f621514406393cbb897e8b1379d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.752827 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-01590d9e-2e0f-4ce2-b3fb-7a1dc0b2311b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffcf0f621514406393cbb897e8b1379d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.761253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-01590d9e-2e0f-4ce2-b3fb-7a1dc0b2311b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffcf0f621514406393cbb897e8b1379d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.761862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-01590d9e-2e0f-4ce2-b3fb-7a1dc0b2311b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffcf0f621514406393cbb897e8b1379d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:51.778771 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1043/2094] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:51 2022] DELETE /identity/v3/users/ffcf0f621514406393cbb897e8b1379d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:51.971929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:51.973342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:51.989933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245a43a-0166-4ac0-be65-918811421c2c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:52.066891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfc657-5777-4d32-b958-c78a97789aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:52.067765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfc657-5777-4d32-b958-c78a97789aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.068049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfc657-5777-4d32-b958-c78a97789aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.068951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfc657-5777-4d32-b958-c78a97789aad admin admin] PATH_INFO: `/v3/projects/fe11c25f70d040c0a1e46cad9d600b81` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:52.070257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfc657-5777-4d32-b958-c78a97789aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe11c25f70d040c0a1e46cad9d600b81)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:52.072306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfc657-5777-4d32-b958-c78a97789aad admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:52.079246 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:52.121111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f0dfc657-5777-4d32-b958-c78a97789aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe11c25f70d040c0a1e46cad9d600b81', 'request_id': 'req-f0dfc657-5777-4d32-b958-c78a97789aad'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:52.128293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f0dfc657-5777-4d32-b958-c78a97789aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe11c25f70d040c0a1e46cad9d600b81', 'request_id': 'req-f0dfc657-5777-4d32-b958-c78a97789aad'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:52.134977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f0dfc657-5777-4d32-b958-c78a97789aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe11c25f70d040c0a1e46cad9d600b81', 'request_id': 'req-f0dfc657-5777-4d32-b958-c78a97789aad'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:52.145086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f0dfc657-5777-4d32-b958-c78a97789aad admin admin] The token cache is being invalidate because project fe11c25f70d040c0a1e46cad9d600b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:52.145377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f0dfc657-5777-4d32-b958-c78a97789aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:52.146046 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f0dfc657-5777-4d32-b958-c78a97789aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:52.148484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1052/2095] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:51 2022] DELETE /identity/v3/projects/fe11c25f70d040c0a1e46cad9d600b81 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:52.153284 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46744969-810d-43c2-967f-59059dc5423f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.153740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46744969-810d-43c2-967f-59059dc5423f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.153995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46744969-810d-43c2-967f-59059dc5423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:52.199612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-46744969-810d-43c2-967f-59059dc5423f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:52.200822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-46744969-810d-43c2-967f-59059dc5423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:52.258048 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1044/2096] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:52.265781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a6b18-72c7-4167-89fd-e60748fdbe3d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.266078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a6b18-72c7-4167-89fd-e60748fdbe3d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.266393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a6b18-72c7-4167-89fd-e60748fdbe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:52.284907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-157a6b18-72c7-4167-89fd-e60748fdbe3d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:52.286092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-157a6b18-72c7-4167-89fd-e60748fdbe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:52.298036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1053/2097] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:52.302244 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46744969-810d-43c2-967f-59059dc5423f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:52.314693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46744969-810d-43c2-967f-59059dc5423f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:52.319382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db71f93-ad20-408d-9850-0688e8ff3a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:52.320034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db71f93-ad20-408d-9850-0688e8ff3a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.320317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db71f93-ad20-408d-9850-0688e8ff3a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.320591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db71f93-ad20-408d-9850-0688e8ff3a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:52.321321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db71f93-ad20-408d-9850-0688e8ff3a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:10:52.321628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db71f93-ad20-408d-9850-0688e8ff3a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:52.323239 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db71f93-ad20-408d-9850-0688e8ff3a86 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:52.335848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1045/2098] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:10:52.340273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a6b18-72c7-4167-89fd-e60748fdbe3d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:52.349463 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a6b18-72c7-4167-89fd-e60748fdbe3d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:52.354714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a249b1-e9fe-4426-b62d-8644276e048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:52.355363 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a249b1-e9fe-4426-b62d-8644276e048f admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.355645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a249b1-e9fe-4426-b62d-8644276e048f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.355918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a249b1-e9fe-4426-b62d-8644276e048f admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:52.356623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a249b1-e9fe-4426-b62d-8644276e048f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:52.358577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a249b1-e9fe-4426-b62d-8644276e048f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:52.388952 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1054/2099] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:52 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:52.390167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db71f93-ad20-408d-9850-0688e8ff3a86 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:52.400784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db71f93-ad20-408d-9850-0688e8ff3a86 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:52.418892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:52.462324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5a2e-0d82-4504-ae53-171428d3aa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:52.463024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5a2e-0d82-4504-ae53-171428d3aa4d admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.463306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5a2e-0d82-4504-ae53-171428d3aa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.463608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5a2e-0d82-4504-ae53-171428d3aa4d admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:52.464296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c5a2e-0d82-4504-ae53-171428d3aa4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:52.466221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c5a2e-0d82-4504-ae53-171428d3aa4d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:52.486890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1046/2100] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:52 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:52.491754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a249b1-e9fe-4426-b62d-8644276e048f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:52.501821 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a249b1-e9fe-4426-b62d-8644276e048f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:52.507216 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84df57c-be47-41d3-9a14-e02e08c9b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:52.507863 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84df57c-be47-41d3-9a14-e02e08c9b032 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.508145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84df57c-be47-41d3-9a14-e02e08c9b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.508416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84df57c-be47-41d3-9a14-e02e08c9b032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:52.509160 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84df57c-be47-41d3-9a14-e02e08c9b032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:52.510780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84df57c-be47-41d3-9a14-e02e08c9b032 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:52.520961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1055/2101] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:52.525060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5a2e-0d82-4504-ae53-171428d3aa4d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:52.535064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5a2e-0d82-4504-ae53-171428d3aa4d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:52.539673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98346a5f-6b4a-4082-8db1-c947dd931561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:52.540324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98346a5f-6b4a-4082-8db1-c947dd931561 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.540612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98346a5f-6b4a-4082-8db1-c947dd931561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.540891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98346a5f-6b4a-4082-8db1-c947dd931561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:52.541634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98346a5f-6b4a-4082-8db1-c947dd931561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:52.543230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98346a5f-6b4a-4082-8db1-c947dd931561 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:52.553345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1047/2102] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:52.557899 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84df57c-be47-41d3-9a14-e02e08c9b032 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:52.567896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84df57c-be47-41d3-9a14-e02e08c9b032 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:52.573078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00ca14-3fd8-4810-9655-217da5a026a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:52.573958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00ca14-3fd8-4810-9655-217da5a026a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.574246 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00ca14-3fd8-4810-9655-217da5a026a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.574561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00ca14-3fd8-4810-9655-217da5a026a4 admin admin] PATH_INFO: `/v3/projects/051fa56a0dfd45b483fb0da73e2d143f/users/80377c9351264931aa69f6eaa8b9731e/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:52.589563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00ca14-3fd8-4810-9655-217da5a026a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051fa56a0dfd45b483fb0da73e2d143f, user_id=80377c9351264931aa69f6eaa8b9731e, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:52.592246 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00ca14-3fd8-4810-9655-217da5a026a4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:52.604616 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1056/2103] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:52 2022] PUT /identity/v3/projects/051fa56a0dfd45b483fb0da73e2d143f/users/80377c9351264931aa69f6eaa8b9731e/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:52.614732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7921-134d-470e-abc0-78bf6bd59904 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.615031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7921-134d-470e-abc0-78bf6bd59904 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.615936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7921-134d-470e-abc0-78bf6bd59904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:52.642497 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-fa0c7921-134d-470e-abc0-78bf6bd59904 None None] MFA Rules not processed for user `80377c9351264931aa69f6eaa8b9731e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:52.643695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fa0c7921-134d-470e-abc0-78bf6bd59904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:52.708046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1048/2104] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:52.719178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00ca14-3fd8-4810-9655-217da5a026a4 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:52.720825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0c00ca14-3fd8-4810-9655-217da5a026a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:52.778044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00ca14-3fd8-4810-9655-217da5a026a4 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:52.781776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b9e2f-e427-4910-935f-4bd2d7ee866b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:52.782464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b9e2f-e427-4910-935f-4bd2d7ee866b service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.782818 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b9e2f-e427-4910-935f-4bd2d7ee866b service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.783131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b9e2f-e427-4910-935f-4bd2d7ee866b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:52.792095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b9e2f-e427-4910-935f-4bd2d7ee866b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:52.793520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b9e2f-e427-4910-935f-4bd2d7ee866b service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:52.802273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1057/2105] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:52.825076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c7921-134d-470e-abc0-78bf6bd59904 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:52.890752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c7921-134d-470e-abc0-78bf6bd59904 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:52.895396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:52.896280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.896568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.896851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] PATH_INFO: `/v3/users/80377c9351264931aa69f6eaa8b9731e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:52.898103 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80377c9351264931aa69f6eaa8b9731e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:52.901053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:52.939086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:52.953697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80377c9351264931aa69f6eaa8b9731e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:52.966355 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80377c9351264931aa69f6eaa8b9731e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:52.967080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80377c9351264931aa69f6eaa8b9731e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:52.975137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80377c9351264931aa69f6eaa8b9731e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:52.976270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80377c9351264931aa69f6eaa8b9731e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:52.989365 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1049/2106] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:10:52 2022] DELETE /identity/v3/users/80377c9351264931aa69f6eaa8b9731e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:10:52.994211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991c58c-2436-4c09-b2a9-0d3b9f555a32 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:52.994762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991c58c-2436-4c09-b2a9-0d3b9f555a32 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:52.994862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991c58c-2436-4c09-b2a9-0d3b9f555a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:53.012264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a991c58c-2436-4c09-b2a9-0d3b9f555a32 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:53.013462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a991c58c-2436-4c09-b2a9-0d3b9f555a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:53.044792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:53.091797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1058/2107] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:53.104270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:53.105842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:53.207530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd46a4-2a4f-4092-a957-d6b7f9dc4e8a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:53.213185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809065c4-da2f-4395-8719-763d19a62d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:53.214143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809065c4-da2f-4395-8719-763d19a62d20 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:53.214415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809065c4-da2f-4395-8719-763d19a62d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:53.214773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809065c4-da2f-4395-8719-763d19a62d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:53.226074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809065c4-da2f-4395-8719-763d19a62d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:53.227806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809065c4-da2f-4395-8719-763d19a62d20 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:53.239108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1050/2108] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:53.520997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991c58c-2436-4c09-b2a9-0d3b9f555a32 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:53.523545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a991c58c-2436-4c09-b2a9-0d3b9f555a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:53.540429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991c58c-2436-4c09-b2a9-0d3b9f555a32 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:53.545023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:53.545905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:53.546177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:53.546481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024 admin admin] PATH_INFO: `/v3/projects/051fa56a0dfd45b483fb0da73e2d143f` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:53.548297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051fa56a0dfd45b483fb0da73e2d143f)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:53.550612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:53.604252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051fa56a0dfd45b483fb0da73e2d143f', 'request_id': 'req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:53.612990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051fa56a0dfd45b483fb0da73e2d143f', 'request_id': 'req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:53.619647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051fa56a0dfd45b483fb0da73e2d143f', 'request_id': 'req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:53.630354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024 admin admin] The token cache is being invalidate because project 051fa56a0dfd45b483fb0da73e2d143f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:10:53.631378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:53.632017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9fcfaff0-f9cc-47c6-aa38-f43277c9a024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:10:53.633700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1059/2109] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:10:53 2022] DELETE /identity/v3/projects/051fa56a0dfd45b483fb0da73e2d143f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:53.643640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88311694-5b3c-4a9b-8878-26ab773fae41 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:53.644009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88311694-5b3c-4a9b-8878-26ab773fae41 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:53.644388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88311694-5b3c-4a9b-8878-26ab773fae41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:53.663317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-88311694-5b3c-4a9b-8878-26ab773fae41 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:53.664512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-88311694-5b3c-4a9b-8878-26ab773fae41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:53.724082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1051/2110] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:53.732006 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592975a7-00ba-4869-8c97-0471459b534a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:53.732302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592975a7-00ba-4869-8c97-0471459b534a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:53.732588 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592975a7-00ba-4869-8c97-0471459b534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:53.750717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-592975a7-00ba-4869-8c97-0471459b534a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:53.752151 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-592975a7-00ba-4869-8c97-0471459b534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:53.760292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1060/2111] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:53.765749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88311694-5b3c-4a9b-8878-26ab773fae41 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:53.776098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88311694-5b3c-4a9b-8878-26ab773fae41 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:53.782032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba24a4-65d5-4a61-a227-dc162a6b7509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:53.782756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba24a4-65d5-4a61-a227-dc162a6b7509 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:53.783041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba24a4-65d5-4a61-a227-dc162a6b7509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:53.783319 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba24a4-65d5-4a61-a227-dc162a6b7509 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:53.784054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba24a4-65d5-4a61-a227-dc162a6b7509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:10:53.784988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba24a4-65d5-4a61-a227-dc162a6b7509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:53.786638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba24a4-65d5-4a61-a227-dc162a6b7509 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:53.798996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1052/2112] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:10:53.803406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592975a7-00ba-4869-8c97-0471459b534a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:53.812703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592975a7-00ba-4869-8c97-0471459b534a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:53.824644 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680a476-3dc1-4be8-a120-3f9766e610e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:53.825318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680a476-3dc1-4be8-a120-3f9766e610e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:53.825633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680a476-3dc1-4be8-a120-3f9766e610e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:53.825912 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680a476-3dc1-4be8-a120-3f9766e610e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:53.826652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680a476-3dc1-4be8-a120-3f9766e610e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:53.828652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680a476-3dc1-4be8-a120-3f9766e610e6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:53.855556 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1061/2113] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:53 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:53.859592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba24a4-65d5-4a61-a227-dc162a6b7509 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:53.869456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba24a4-65d5-4a61-a227-dc162a6b7509 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:53.883396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:53.931826 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb499-69f6-44a3-8a5f-1ab27ace4326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:53.932509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb499-69f6-44a3-8a5f-1ab27ace4326 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:53.932799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb499-69f6-44a3-8a5f-1ab27ace4326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:53.933078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb499-69f6-44a3-8a5f-1ab27ace4326 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:53.933774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcb499-69f6-44a3-8a5f-1ab27ace4326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:53.935722 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcb499-69f6-44a3-8a5f-1ab27ace4326 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:53.956770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1053/2114] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:53 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:53.961306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680a476-3dc1-4be8-a120-3f9766e610e6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:53.972347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680a476-3dc1-4be8-a120-3f9766e610e6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:53.977024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a16b4-bf2a-4cd2-9800-e87b9ec20b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:53.977723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a16b4-bf2a-4cd2-9800-e87b9ec20b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:53.978012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a16b4-bf2a-4cd2-9800-e87b9ec20b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:53.978289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a16b4-bf2a-4cd2-9800-e87b9ec20b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:53.979073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a16b4-bf2a-4cd2-9800-e87b9ec20b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:53.980658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a16b4-bf2a-4cd2-9800-e87b9ec20b5c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:53.992917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1062/2115] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:53.996654 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb499-69f6-44a3-8a5f-1ab27ace4326 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:54.006579 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb499-69f6-44a3-8a5f-1ab27ace4326 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:54.011171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa448200-7a49-4e5e-8d28-d530627f1cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:54.011823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa448200-7a49-4e5e-8d28-d530627f1cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.012108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa448200-7a49-4e5e-8d28-d530627f1cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.012383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa448200-7a49-4e5e-8d28-d530627f1cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.013109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa448200-7a49-4e5e-8d28-d530627f1cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:54.014733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa448200-7a49-4e5e-8d28-d530627f1cdd admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:54.025326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1054/2116] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:54.029321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a16b4-bf2a-4cd2-9800-e87b9ec20b5c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:54.039822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a16b4-bf2a-4cd2-9800-e87b9ec20b5c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:54.044415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e42075-92c1-4358-bb6a-1f5e9657fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:54.045347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e42075-92c1-4358-bb6a-1f5e9657fcd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.045630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e42075-92c1-4358-bb6a-1f5e9657fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.045903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e42075-92c1-4358-bb6a-1f5e9657fcd9 admin admin] PATH_INFO: `/v3/projects/76fc8c951481458295ceb140a0e44b99/users/ab0d2b0f0dce4964a859d79303638865/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.061113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e42075-92c1-4358-bb6a-1f5e9657fcd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fc8c951481458295ceb140a0e44b99, user_id=ab0d2b0f0dce4964a859d79303638865, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:54.063790 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e42075-92c1-4358-bb6a-1f5e9657fcd9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:54.076789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1063/2117] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:54 2022] PUT /identity/v3/projects/76fc8c951481458295ceb140a0e44b99/users/ab0d2b0f0dce4964a859d79303638865/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:54.087940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531d4f-06dd-47fe-aa60-fd9fbd72c6b3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.088280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531d4f-06dd-47fe-aa60-fd9fbd72c6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.088631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531d4f-06dd-47fe-aa60-fd9fbd72c6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.115894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-bf531d4f-06dd-47fe-aa60-fd9fbd72c6b3 None None] MFA Rules not processed for user `ab0d2b0f0dce4964a859d79303638865`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:54.117039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bf531d4f-06dd-47fe-aa60-fd9fbd72c6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:54.179989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1055/2118] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:54.184432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e42075-92c1-4358-bb6a-1f5e9657fcd9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:54.236118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:54.247323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e42075-92c1-4358-bb6a-1f5e9657fcd9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:54.252958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fb0de-fed4-434c-bfae-a4b8132c912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:54.253622 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fb0de-fed4-434c-bfae-a4b8132c912a admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.253913 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fb0de-fed4-434c-bfae-a4b8132c912a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.254196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fb0de-fed4-434c-bfae-a4b8132c912a admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.254932 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fb0de-fed4-434c-bfae-a4b8132c912a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:54.256984 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fb0de-fed4-434c-bfae-a4b8132c912a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:54.283496 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1064/2119] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:54 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:54.288020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531d4f-06dd-47fe-aa60-fd9fbd72c6b3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:54.299078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531d4f-06dd-47fe-aa60-fd9fbd72c6b3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:54.357619 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de62865-2ae3-4a54-9e24-c76e28064e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:54.358291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de62865-2ae3-4a54-9e24-c76e28064e62 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.358602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de62865-2ae3-4a54-9e24-c76e28064e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.358874 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de62865-2ae3-4a54-9e24-c76e28064e62 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.359572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de62865-2ae3-4a54-9e24-c76e28064e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:54.361501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de62865-2ae3-4a54-9e24-c76e28064e62 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:54.382985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1056/2120] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:54 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:54.387280 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fb0de-fed4-434c-bfae-a4b8132c912a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:54.398917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fb0de-fed4-434c-bfae-a4b8132c912a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:54.404515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3ce60-8c82-4056-9d61-8f582c811136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:54.405194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3ce60-8c82-4056-9d61-8f582c811136 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.405486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3ce60-8c82-4056-9d61-8f582c811136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.405765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3ce60-8c82-4056-9d61-8f582c811136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.406528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3ce60-8c82-4056-9d61-8f582c811136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:54.408125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3ce60-8c82-4056-9d61-8f582c811136 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:54.419348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1065/2121] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:54.423105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de62865-2ae3-4a54-9e24-c76e28064e62 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:54.435773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de62865-2ae3-4a54-9e24-c76e28064e62 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:54.442191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291df32-98f1-459a-97e8-44536656d02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:54.442894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291df32-98f1-459a-97e8-44536656d02b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.443179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291df32-98f1-459a-97e8-44536656d02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.443995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291df32-98f1-459a-97e8-44536656d02b admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.444868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291df32-98f1-459a-97e8-44536656d02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:54.446471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291df32-98f1-459a-97e8-44536656d02b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:54.456877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1057/2122] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:54.461230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3ce60-8c82-4056-9d61-8f582c811136 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:54.471032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3ce60-8c82-4056-9d61-8f582c811136 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:54.476392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4b63d-e47f-41e5-b84f-4c432974040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:54.477266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4b63d-e47f-41e5-b84f-4c432974040c admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.477552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4b63d-e47f-41e5-b84f-4c432974040c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.477827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4b63d-e47f-41e5-b84f-4c432974040c admin admin] PATH_INFO: `/v3/projects/ed588091412d4691996bf422aefb1fab/users/3d206c0cb8ab4522bb322e4f26052801/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.492721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4b63d-e47f-41e5-b84f-4c432974040c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed588091412d4691996bf422aefb1fab, user_id=3d206c0cb8ab4522bb322e4f26052801, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:54.495572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4b63d-e47f-41e5-b84f-4c432974040c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:54.507927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1066/2123] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:54 2022] PUT /identity/v3/projects/ed588091412d4691996bf422aefb1fab/users/3d206c0cb8ab4522bb322e4f26052801/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:54.517961 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f1219-2fac-468f-85b7-70e6303b1d7e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.518258 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f1219-2fac-468f-85b7-70e6303b1d7e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.518570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f1219-2fac-468f-85b7-70e6303b1d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.525281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:54.546085 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-449f1219-2fac-468f-85b7-70e6303b1d7e None None] MFA Rules not processed for user `3d206c0cb8ab4522bb322e4f26052801`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:54.547402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-449f1219-2fac-468f-85b7-70e6303b1d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:54.613359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1058/2124] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:54.618784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4b63d-e47f-41e5-b84f-4c432974040c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:54.682632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4b63d-e47f-41e5-b84f-4c432974040c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:54.687332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde882e0-3aae-4fe1-83c7-c914d7bff528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:54.688118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde882e0-3aae-4fe1-83c7-c914d7bff528 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.688438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde882e0-3aae-4fe1-83c7-c914d7bff528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.688718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde882e0-3aae-4fe1-83c7-c914d7bff528 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.689488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde882e0-3aae-4fe1-83c7-c914d7bff528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:54.691437 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde882e0-3aae-4fe1-83c7-c914d7bff528 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:54.721444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1067/2125] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:10:54 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:10:54.722591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f1219-2fac-468f-85b7-70e6303b1d7e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:54.734119 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f1219-2fac-468f-85b7-70e6303b1d7e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:54.794456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134fbd4-e7b7-4a80-9175-cd1d1534c992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:54.795158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134fbd4-e7b7-4a80-9175-cd1d1534c992 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.795649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134fbd4-e7b7-4a80-9175-cd1d1534c992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.795939 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134fbd4-e7b7-4a80-9175-cd1d1534c992 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.796653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134fbd4-e7b7-4a80-9175-cd1d1534c992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:54.798684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134fbd4-e7b7-4a80-9175-cd1d1534c992 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:54.819641 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1059/2126] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:10:54 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:10:54.823463 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde882e0-3aae-4fe1-83c7-c914d7bff528 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:54.834947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde882e0-3aae-4fe1-83c7-c914d7bff528 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:54.839618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94ce39-b63b-4432-97ca-934ba6369291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:54.840269 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ce39-b63b-4432-97ca-934ba6369291 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.840549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ce39-b63b-4432-97ca-934ba6369291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.840822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ce39-b63b-4432-97ca-934ba6369291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.841542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94ce39-b63b-4432-97ca-934ba6369291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:54.843157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94ce39-b63b-4432-97ca-934ba6369291 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:54.854682 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1068/2127] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:10:54.858432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134fbd4-e7b7-4a80-9175-cd1d1534c992 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:54.868811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134fbd4-e7b7-4a80-9175-cd1d1534c992 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:54.873335 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e1200-8a7a-4b9b-8ad3-5d94d9712bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:54.874203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e1200-8a7a-4b9b-8ad3-5d94d9712bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.874525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e1200-8a7a-4b9b-8ad3-5d94d9712bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.874803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e1200-8a7a-4b9b-8ad3-5d94d9712bd0 admin admin] PATH_INFO: `/v3/projects/fd66553fd7ec434c81a5f8ccde86c4f2/users/1bd55b91a1004c46b9151206cd8ed652/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.889714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e1200-8a7a-4b9b-8ad3-5d94d9712bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd66553fd7ec434c81a5f8ccde86c4f2, user_id=1bd55b91a1004c46b9151206cd8ed652, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:54.892536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e1200-8a7a-4b9b-8ad3-5d94d9712bd0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:54.905867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1060/2128] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:54 2022] PUT /identity/v3/projects/fd66553fd7ec434c81a5f8ccde86c4f2/users/1bd55b91a1004c46b9151206cd8ed652/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:54.909849 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94ce39-b63b-4432-97ca-934ba6369291 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:54.919998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94ce39-b63b-4432-97ca-934ba6369291 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:54.978036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bc2cc-2d27-435b-80ae-12754597bc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:54.978742 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc2cc-2d27-435b-80ae-12754597bc36 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:54.979023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc2cc-2d27-435b-80ae-12754597bc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:54.979298 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc2cc-2d27-435b-80ae-12754597bc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:54.980044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bc2cc-2d27-435b-80ae-12754597bc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:54.981614 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bc2cc-2d27-435b-80ae-12754597bc36 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:54.992080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1069/2129] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:10:54.996310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e1200-8a7a-4b9b-8ad3-5d94d9712bd0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:55.007230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e1200-8a7a-4b9b-8ad3-5d94d9712bd0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:55.011719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9327971-0e60-498f-8398-2349a5f4981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:55.012589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9327971-0e60-498f-8398-2349a5f4981b admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:55.012868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9327971-0e60-498f-8398-2349a5f4981b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:55.013144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9327971-0e60-498f-8398-2349a5f4981b admin admin] PATH_INFO: `/v3/projects/fd66553fd7ec434c81a5f8ccde86c4f2/users/1bd55b91a1004c46b9151206cd8ed652/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:55.015226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9327971-0e60-498f-8398-2349a5f4981b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd66553fd7ec434c81a5f8ccde86c4f2, user_id=1bd55b91a1004c46b9151206cd8ed652, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:55.017992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9327971-0e60-498f-8398-2349a5f4981b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:55.028566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1061/2130] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:10:54 2022] PUT /identity/v3/projects/fd66553fd7ec434c81a5f8ccde86c4f2/users/1bd55b91a1004c46b9151206cd8ed652/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:10:55.039880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556ec2-9d71-4ffb-a595-8fdb9f5140c0 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:55.040386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556ec2-9d71-4ffb-a595-8fdb9f5140c0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:55.040475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556ec2-9d71-4ffb-a595-8fdb9f5140c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:55.065115 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:55.068110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2b556ec2-9d71-4ffb-a595-8fdb9f5140c0 None None] MFA Rules not processed for user `1bd55b91a1004c46b9151206cd8ed652`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:55.070567 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2b556ec2-9d71-4ffb-a595-8fdb9f5140c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:55.140180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1070/2131] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:55.152140 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9327971-0e60-498f-8398-2349a5f4981b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:55.153811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b9327971-0e60-498f-8398-2349a5f4981b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:55.207367 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:55.214006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9327971-0e60-498f-8398-2349a5f4981b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:55.217846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f53b-f44b-468c-a615-d82d3bbbc33b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:55.218532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f53b-f44b-468c-a615-d82d3bbbc33b service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:55.218817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f53b-f44b-468c-a615-d82d3bbbc33b service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:55.219092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f53b-f44b-468c-a615-d82d3bbbc33b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:55.273962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463f53b-f44b-468c-a615-d82d3bbbc33b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:55.275428 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463f53b-f44b-468c-a615-d82d3bbbc33b service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:55.284384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1062/2132] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:56.912930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b556ec2-9d71-4ffb-a595-8fdb9f5140c0 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:56.923680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b556ec2-9d71-4ffb-a595-8fdb9f5140c0 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:56.928451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839373ac-eca0-4a02-97f9-9343a67fbc4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:56.929205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839373ac-eca0-4a02-97f9-9343a67fbc4a service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:56.929495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839373ac-eca0-4a02-97f9-9343a67fbc4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:56.929773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839373ac-eca0-4a02-97f9-9343a67fbc4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:56.995236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839373ac-eca0-4a02-97f9-9343a67fbc4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:56.997800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839373ac-eca0-4a02-97f9-9343a67fbc4a service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:57.008764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1071/2133] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:57.602785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f53b-f44b-468c-a615-d82d3bbbc33b service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:57.611379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f53b-f44b-468c-a615-d82d3bbbc33b service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:57.615660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957f386-0233-4142-becc-c142435ecaee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:57.616305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957f386-0233-4142-becc-c142435ecaee service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:57.616593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957f386-0233-4142-becc-c142435ecaee service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:57.616872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957f386-0233-4142-becc-c142435ecaee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:57.625766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957f386-0233-4142-becc-c142435ecaee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:57.627217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957f386-0233-4142-becc-c142435ecaee service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:57.636746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1063/2134] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:10:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:01.536383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839373ac-eca0-4a02-97f9-9343a67fbc4a service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:01.611493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839373ac-eca0-4a02-97f9-9343a67fbc4a service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:01.616599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:01.617568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:01.617911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:01.618249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] PATH_INFO: `/v3/users/ab0d2b0f0dce4964a859d79303638865` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:01.619543 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0d2b0f0dce4964a859d79303638865)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:01.621517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:01.664342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:01.670820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0d2b0f0dce4964a859d79303638865'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:01.671746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0d2b0f0dce4964a859d79303638865'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:01.681094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0d2b0f0dce4964a859d79303638865'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:01.688256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0d2b0f0dce4964a859d79303638865'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:01.688957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0d2b0f0dce4964a859d79303638865'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:01.710711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1072/2135] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:11:01 2022] DELETE /identity/v3/users/ab0d2b0f0dce4964a859d79303638865 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:11:01.715238 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35810-3fba-4e01-ad44-eb7d0f4db693 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:01.715660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35810-3fba-4e01-ad44-eb7d0f4db693 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:01.715734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35810-3fba-4e01-ad44-eb7d0f4db693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:01.734993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d9c35810-3fba-4e01-ad44-eb7d0f4db693 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:01.736197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d9c35810-3fba-4e01-ad44-eb7d0f4db693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:01.820850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1064/2136] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:01.831262 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:01.832934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:01.910331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267d03f-2445-42d8-8336-72a4a78f9073 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:01.914898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dea947-e2a6-4b06-9af2-9814750507db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:01.915597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea947-e2a6-4b06-9af2-9814750507db service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:01.915824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea947-e2a6-4b06-9af2-9814750507db service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:01.916159 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea947-e2a6-4b06-9af2-9814750507db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:01.927525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dea947-e2a6-4b06-9af2-9814750507db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:01.929564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dea947-e2a6-4b06-9af2-9814750507db service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:01.942079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1073/2137] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:02.216302 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35810-3fba-4e01-ad44-eb7d0f4db693 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:02.218222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d9c35810-3fba-4e01-ad44-eb7d0f4db693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:02.233851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35810-3fba-4e01-ad44-eb7d0f4db693 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:02.242743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:02.244410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:02.245086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:02.246015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] PATH_INFO: `/v3/projects/76fc8c951481458295ceb140a0e44b99` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:02.248012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76fc8c951481458295ceb140a0e44b99)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:02.249913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:02.302161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76fc8c951481458295ceb140a0e44b99', 'request_id': 'req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:02.308209 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76fc8c951481458295ceb140a0e44b99', 'request_id': 'req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:02.314742 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76fc8c951481458295ceb140a0e44b99', 'request_id': 'req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:02.328211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] The token cache is being invalidate because project 76fc8c951481458295ceb140a0e44b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:11:02.328511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:02.329398 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:02.333667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1065/2138] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:11:02 2022] DELETE /identity/v3/projects/76fc8c951481458295ceb140a0e44b99 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:11:02.335073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dea947-e2a6-4b06-9af2-9814750507db service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:02.345014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dea947-e2a6-4b06-9af2-9814750507db service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:02.409523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:02.410537 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:02.410889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:02.411235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] PATH_INFO: `/v3/users/3d206c0cb8ab4522bb322e4f26052801` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:02.412485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d206c0cb8ab4522bb322e4f26052801)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:02.414551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:02.462935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d206c0cb8ab4522bb322e4f26052801'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:02.463592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d206c0cb8ab4522bb322e4f26052801'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:02.472396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d206c0cb8ab4522bb322e4f26052801'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:02.476106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:02.479948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d206c0cb8ab4522bb322e4f26052801'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:02.480832 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d206c0cb8ab4522bb322e4f26052801'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:02.501590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1074/2139] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:11:02 2022] DELETE /identity/v3/users/3d206c0cb8ab4522bb322e4f26052801 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:11:02.854922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:02.856438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:02.871170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac809c26-ddc6-4c7c-99e8-cae078d94bd5 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:02.880802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:02.943151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:02.945547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:02.946041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:02.946557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] PATH_INFO: `/v3/projects/ed588091412d4691996bf422aefb1fab` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:02.947983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed588091412d4691996bf422aefb1fab)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:02.950108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:03.003485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed588091412d4691996bf422aefb1fab', 'request_id': 'req-e6ad7e51-3e31-4906-8c52-7eafc094b75f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.010735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed588091412d4691996bf422aefb1fab', 'request_id': 'req-e6ad7e51-3e31-4906-8c52-7eafc094b75f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.026530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed588091412d4691996bf422aefb1fab', 'request_id': 'req-e6ad7e51-3e31-4906-8c52-7eafc094b75f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.041801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] The token cache is being invalidate because project ed588091412d4691996bf422aefb1fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:11:03.042094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.043242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.045180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1066/2140] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:11:02 2022] DELETE /identity/v3/projects/ed588091412d4691996bf422aefb1fab => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:11:03.049319 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:03.051612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:03.066694 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a235d5-b72b-4cf0-ae0d-483817fa13dd admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:03.130651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1920a-6f14-4b43-b8bc-f94d40df0f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:03.132274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1920a-6f14-4b43-b8bc-f94d40df0f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:03.132743 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1920a-6f14-4b43-b8bc-f94d40df0f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:03.133190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1920a-6f14-4b43-b8bc-f94d40df0f0c admin admin] PATH_INFO: `/v3/users/1bd55b91a1004c46b9151206cd8ed652` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:03.134626 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1920a-6f14-4b43-b8bc-f94d40df0f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd55b91a1004c46b9151206cd8ed652)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:03.136558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1920a-6f14-4b43-b8bc-f94d40df0f0c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:03.182757 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2ee1920a-6f14-4b43-b8bc-f94d40df0f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd55b91a1004c46b9151206cd8ed652'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.183423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2ee1920a-6f14-4b43-b8bc-f94d40df0f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd55b91a1004c46b9151206cd8ed652'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.190997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2ee1920a-6f14-4b43-b8bc-f94d40df0f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd55b91a1004c46b9151206cd8ed652'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.199787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2ee1920a-6f14-4b43-b8bc-f94d40df0f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd55b91a1004c46b9151206cd8ed652'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.200483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2ee1920a-6f14-4b43-b8bc-f94d40df0f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd55b91a1004c46b9151206cd8ed652'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.218969 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1075/2141] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:11:03 2022] DELETE /identity/v3/users/1bd55b91a1004c46b9151206cd8ed652 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:11:03.523363 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:03.524805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:03.539779 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad7e51-3e31-4906-8c52-7eafc094b75f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:03.606173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4886ac9-42c9-4ce2-89a8-902cec364692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:03.607214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4886ac9-42c9-4ce2-89a8-902cec364692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:03.607507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4886ac9-42c9-4ce2-89a8-902cec364692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:03.608027 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4886ac9-42c9-4ce2-89a8-902cec364692 admin admin] PATH_INFO: `/v3/projects/fd66553fd7ec434c81a5f8ccde86c4f2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:03.609552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4886ac9-42c9-4ce2-89a8-902cec364692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd66553fd7ec434c81a5f8ccde86c4f2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:03.611648 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4886ac9-42c9-4ce2-89a8-902cec364692 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:03.658420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ea96e-3bd9-4484-9547-3ee78d38cc70 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:03.658715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ea96e-3bd9-4484-9547-3ee78d38cc70 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:03.658993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ea96e-3bd9-4484-9547-3ee78d38cc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:03.660419 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:03.667085 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e4886ac9-42c9-4ce2-89a8-902cec364692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd66553fd7ec434c81a5f8ccde86c4f2', 'request_id': 'req-e4886ac9-42c9-4ce2-89a8-902cec364692'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.676082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e4886ac9-42c9-4ce2-89a8-902cec364692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd66553fd7ec434c81a5f8ccde86c4f2', 'request_id': 'req-e4886ac9-42c9-4ce2-89a8-902cec364692'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.687056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e4886ac9-42c9-4ce2-89a8-902cec364692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd66553fd7ec434c81a5f8ccde86c4f2', 'request_id': 'req-e4886ac9-42c9-4ce2-89a8-902cec364692'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.689726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6f7ea96e-3bd9-4484-9547-3ee78d38cc70 None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:03.690972 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6f7ea96e-3bd9-4484-9547-3ee78d38cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:03.701656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e4886ac9-42c9-4ce2-89a8-902cec364692 admin admin] The token cache is being invalidate because project fd66553fd7ec434c81a5f8ccde86c4f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:11:03.701953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e4886ac9-42c9-4ce2-89a8-902cec364692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.702636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e4886ac9-42c9-4ce2-89a8-902cec364692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:03.704612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1067/2142] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:11:03 2022] DELETE /identity/v3/projects/fd66553fd7ec434c81a5f8ccde86c4f2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:11:03.709528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff4615-9302-4160-a4b1-0a08e7f9c1c9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:03.710348 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff4615-9302-4160-a4b1-0a08e7f9c1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:03.710676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff4615-9302-4160-a4b1-0a08e7f9c1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:03.740336 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d3ff4615-9302-4160-a4b1-0a08e7f9c1c9 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:03.742052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d3ff4615-9302-4160-a4b1-0a08e7f9c1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:03.746266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:03.761284 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1076/2143] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:11:03.810501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1068/2144] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:11:03.814423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f176-ad30-4953-861b-06f1b8c12516 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:03.814759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f176-ad30-4953-861b-06f1b8c12516 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:03.815042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f176-ad30-4953-861b-06f1b8c12516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:03.820203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff4615-9302-4160-a4b1-0a08e7f9c1c9 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:03.827626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d3ff4615-9302-4160-a4b1-0a08e7f9c1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:03.846199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8f89f176-ad30-4953-861b-06f1b8c12516 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:03.847527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8f89f176-ad30-4953-861b-06f1b8c12516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:03.856005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1077/2145] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:11:03.861217 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f176-ad30-4953-861b-06f1b8c12516 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:03.873630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f176-ad30-4953-861b-06f1b8c12516 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:03.879645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240491e-ec33-457c-8bdd-b83be018829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:03.880493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240491e-ec33-457c-8bdd-b83be018829d admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:03.881124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240491e-ec33-457c-8bdd-b83be018829d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:03.881540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240491e-ec33-457c-8bdd-b83be018829d admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:03.883256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240491e-ec33-457c-8bdd-b83be018829d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:11:03.883871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240491e-ec33-457c-8bdd-b83be018829d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:03.886135 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240491e-ec33-457c-8bdd-b83be018829d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:03.902925 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1078/2146] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:11:03.904661 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240491e-ec33-457c-8bdd-b83be018829d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:03.906458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff4615-9302-4160-a4b1-0a08e7f9c1c9 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:03.912347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fafc81-c3b3-4fc8-be3c-f60b701bfd59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:03.913137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fafc81-c3b3-4fc8-be3c-f60b701bfd59 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:03.913435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fafc81-c3b3-4fc8-be3c-f60b701bfd59 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:03.913714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fafc81-c3b3-4fc8-be3c-f60b701bfd59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:03.916457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240491e-ec33-457c-8bdd-b83be018829d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:03.921362 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01a437-f6e7-45ff-9e4e-db927729d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:03.922017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01a437-f6e7-45ff-9e4e-db927729d4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:03.922304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01a437-f6e7-45ff-9e4e-db927729d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:03.922996 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01a437-f6e7-45ff-9e4e-db927729d4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:03.923108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fafc81-c3b3-4fc8-be3c-f60b701bfd59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:03.923323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01a437-f6e7-45ff-9e4e-db927729d4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:03.924588 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fafc81-c3b3-4fc8-be3c-f60b701bfd59 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:03.925205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01a437-f6e7-45ff-9e4e-db927729d4a7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:03.934505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1069/2147] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:11:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:11:03.961114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1079/2148] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:11:03 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:11:03.963245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fafc81-c3b3-4fc8-be3c-f60b701bfd59 service swift] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:03.979519 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fafc81-c3b3-4fc8-be3c-f60b701bfd59 service swift] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:04.081936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:04.105366 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146f9e3-fb42-4b49-b9f7-40ac0c1731b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:04.106283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146f9e3-fb42-4b49-b9f7-40ac0c1731b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:04.106761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146f9e3-fb42-4b49-b9f7-40ac0c1731b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:04.107292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146f9e3-fb42-4b49-b9f7-40ac0c1731b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:04.108216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146f9e3-fb42-4b49-b9f7-40ac0c1731b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:04.110626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146f9e3-fb42-4b49-b9f7-40ac0c1731b2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:04.149680 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1070/2149] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:11:03 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:11:04.153615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01a437-f6e7-45ff-9e4e-db927729d4a7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:04.177125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01a437-f6e7-45ff-9e4e-db927729d4a7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:04.197811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed34a04-f736-4820-88a4-a39caefae745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:04.198760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed34a04-f736-4820-88a4-a39caefae745 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:04.199259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed34a04-f736-4820-88a4-a39caefae745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:04.199765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed34a04-f736-4820-88a4-a39caefae745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:04.200691 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed34a04-f736-4820-88a4-a39caefae745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:04.209244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed34a04-f736-4820-88a4-a39caefae745 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:04.233833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1080/2150] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:11:04.237838 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146f9e3-fb42-4b49-b9f7-40ac0c1731b2 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:04.250269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146f9e3-fb42-4b49-b9f7-40ac0c1731b2 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:04.259176 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56c6e0-3a1e-4025-b2b1-c2ff2c1c8912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:04.260804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56c6e0-3a1e-4025-b2b1-c2ff2c1c8912 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:04.261353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56c6e0-3a1e-4025-b2b1-c2ff2c1c8912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:04.262420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56c6e0-3a1e-4025-b2b1-c2ff2c1c8912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:04.263601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56c6e0-3a1e-4025-b2b1-c2ff2c1c8912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:04.266627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56c6e0-3a1e-4025-b2b1-c2ff2c1c8912 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:04.286439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1071/2151] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:11:04.287864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed34a04-f736-4820-88a4-a39caefae745 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:04.301405 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed34a04-f736-4820-88a4-a39caefae745 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:04.311456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61798e27-00ba-4327-9522-15d59af13348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:04.315222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61798e27-00ba-4327-9522-15d59af13348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:04.326843 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61798e27-00ba-4327-9522-15d59af13348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:04.327663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61798e27-00ba-4327-9522-15d59af13348 admin admin] PATH_INFO: `/v3/projects/5ea45ae285ca44f3b90ea06c4a546cf4/users/d9e41227f2554f0d91cb8b73d5fb27ce/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:04.389395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61798e27-00ba-4327-9522-15d59af13348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea45ae285ca44f3b90ea06c4a546cf4, user_id=d9e41227f2554f0d91cb8b73d5fb27ce, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:04.394170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61798e27-00ba-4327-9522-15d59af13348 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:04.433654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1081/2152] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:11:04 2022] PUT /identity/v3/projects/5ea45ae285ca44f3b90ea06c4a546cf4/users/d9e41227f2554f0d91cb8b73d5fb27ce/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:11:04.446013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2c6a2-ab77-4c6c-9daf-a18b43ed2be6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:04.446313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2c6a2-ab77-4c6c-9daf-a18b43ed2be6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:04.446640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2c6a2-ab77-4c6c-9daf-a18b43ed2be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:04.506963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b2c2c6a2-ab77-4c6c-9daf-a18b43ed2be6 None None] MFA Rules not processed for user `d9e41227f2554f0d91cb8b73d5fb27ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:04.508579 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b2c2c6a2-ab77-4c6c-9daf-a18b43ed2be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:04.622926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1072/2153] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:04.631331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61798e27-00ba-4327-9522-15d59af13348 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:04.633545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-61798e27-00ba-4327-9522-15d59af13348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:04.732880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61798e27-00ba-4327-9522-15d59af13348 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:04.737107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df693f-a665-4d57-a7b9-25c8ef4f566d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5b9c982724df0b88ce6ad46dc37e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:04.737877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df693f-a665-4d57-a7b9-25c8ef4f566d service glance] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:04.738264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df693f-a665-4d57-a7b9-25c8ef4f566d service glance] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:04.738669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df693f-a665-4d57-a7b9-25c8ef4f566d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:04.750699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df693f-a665-4d57-a7b9-25c8ef4f566d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:04.752497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df693f-a665-4d57-a7b9-25c8ef4f566d service glance] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:04.763317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1082/2154] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:11:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:12.732663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740c8d4-28c3-43a1-b690-67c5ab496763 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:12.733240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740c8d4-28c3-43a1-b690-67c5ab496763 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:12.733240 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740c8d4-28c3-43a1-b690-67c5ab496763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:12.773700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2740c8d4-28c3-43a1-b690-67c5ab496763 None None] MFA Rules not processed for user `ed81799983c143eaa48a6a184c0eaf21`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:12.773700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2740c8d4-28c3-43a1-b690-67c5ab496763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:12.885621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1073/2155] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:13.552824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a267b64-f39e-42c8-b749-be845bdf78f2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:13.553383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a267b64-f39e-42c8-b749-be845bdf78f2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:13.553383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a267b64-f39e-42c8-b749-be845bdf78f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:13.582232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3a267b64-f39e-42c8-b749-be845bdf78f2 None None] MFA Rules not processed for user `8903701eab424530ab822b7e9a1a9181`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:13.583535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3a267b64-f39e-42c8-b749-be845bdf78f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:13.657868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1083/2156] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:22.871557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:23.642663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=87,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:29.191971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afce92-70af-4bb7-ac28-62e2a2d8b8ef None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:29.191971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afce92-70af-4bb7-ac28-62e2a2d8b8ef None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:29.191971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afce92-70af-4bb7-ac28-62e2a2d8b8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:29.209017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f2afce92-70af-4bb7-ac28-62e2a2d8b8ef None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:29.210245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f2afce92-70af-4bb7-ac28-62e2a2d8b8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:29.272938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1074/2157] 10.222.0.49 () {58 vars in 967 bytes} [Mon May 23 17:11:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:29.286122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a267b64-f39e-42c8-b749-be845bdf78f2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:29.358048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a267b64-f39e-42c8-b749-be845bdf78f2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:29.364088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28859a5-b93c-47a5-953d-937166f0f1e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:29.364968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28859a5-b93c-47a5-953d-937166f0f1e1 service swift] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:29.365264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28859a5-b93c-47a5-953d-937166f0f1e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:29.365549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28859a5-b93c-47a5-953d-937166f0f1e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:29.375243 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28859a5-b93c-47a5-953d-937166f0f1e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:29.376908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28859a5-b93c-47a5-953d-937166f0f1e1 service swift] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:29.387460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1084/2158] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:11:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:11:31.608308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afce92-70af-4bb7-ac28-62e2a2d8b8ef None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:31.610094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f2afce92-70af-4bb7-ac28-62e2a2d8b8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:31.678381 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afce92-70af-4bb7-ac28-62e2a2d8b8ef None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:31.683678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77decbd6-43ab-4c53-9a3a-4fbeabab668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:31.684541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77decbd6-43ab-4c53-9a3a-4fbeabab668c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:31.684852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77decbd6-43ab-4c53-9a3a-4fbeabab668c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:31.685094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77decbd6-43ab-4c53-9a3a-4fbeabab668c admin admin] PATH_INFO: `/v3/users/d0a8726a4e3c4b3aa001cd5bc47243de` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:31.686577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77decbd6-43ab-4c53-9a3a-4fbeabab668c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a8726a4e3c4b3aa001cd5bc47243de)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:31.688616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77decbd6-43ab-4c53-9a3a-4fbeabab668c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:31.735991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-77decbd6-43ab-4c53-9a3a-4fbeabab668c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a8726a4e3c4b3aa001cd5bc47243de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:31.749200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-77decbd6-43ab-4c53-9a3a-4fbeabab668c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a8726a4e3c4b3aa001cd5bc47243de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:31.750091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-77decbd6-43ab-4c53-9a3a-4fbeabab668c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a8726a4e3c4b3aa001cd5bc47243de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:31.762417 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-77decbd6-43ab-4c53-9a3a-4fbeabab668c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a8726a4e3c4b3aa001cd5bc47243de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:31.763479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-77decbd6-43ab-4c53-9a3a-4fbeabab668c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a8726a4e3c4b3aa001cd5bc47243de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:31.786545 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1075/2159] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:11:31 2022] DELETE /identity/v3/users/d0a8726a4e3c4b3aa001cd5bc47243de => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:11:31.977461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28859a5-b93c-47a5-953d-937166f0f1e1 service swift] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:31.996555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28859a5-b93c-47a5-953d-937166f0f1e1 service swift] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:32.051047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277414d-c620-4dc6-bbb7-fc81e53695f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:32.051900 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277414d-c620-4dc6-bbb7-fc81e53695f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:32.052183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277414d-c620-4dc6-bbb7-fc81e53695f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:32.052457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277414d-c620-4dc6-bbb7-fc81e53695f9 admin admin] PATH_INFO: `/v3/projects/c2eff14d3a4043bf820a6411d390f669` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:32.053614 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277414d-c620-4dc6-bbb7-fc81e53695f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2eff14d3a4043bf820a6411d390f669)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:32.055556 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277414d-c620-4dc6-bbb7-fc81e53695f9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:32.101415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6277414d-c620-4dc6-bbb7-fc81e53695f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2eff14d3a4043bf820a6411d390f669', 'request_id': 'req-6277414d-c620-4dc6-bbb7-fc81e53695f9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:32.109930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6277414d-c620-4dc6-bbb7-fc81e53695f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2eff14d3a4043bf820a6411d390f669', 'request_id': 'req-6277414d-c620-4dc6-bbb7-fc81e53695f9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:32.115999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6277414d-c620-4dc6-bbb7-fc81e53695f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2eff14d3a4043bf820a6411d390f669', 'request_id': 'req-6277414d-c620-4dc6-bbb7-fc81e53695f9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:32.126129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6277414d-c620-4dc6-bbb7-fc81e53695f9 admin admin] The token cache is being invalidate because project c2eff14d3a4043bf820a6411d390f669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:11:32.126439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6277414d-c620-4dc6-bbb7-fc81e53695f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:32.127063 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6277414d-c620-4dc6-bbb7-fc81e53695f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:32.128605 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1085/2160] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:11:31 2022] DELETE /identity/v3/projects/c2eff14d3a4043bf820a6411d390f669 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:11:32.133473 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52628f4-878a-4380-befa-c0494ea19411 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:32.133772 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52628f4-878a-4380-befa-c0494ea19411 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:32.134052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52628f4-878a-4380-befa-c0494ea19411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:32.152663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b52628f4-878a-4380-befa-c0494ea19411 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:32.153855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b52628f4-878a-4380-befa-c0494ea19411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:32.166655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:32.214743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1076/2161] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:32.222333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579597d2-a015-4b00-94cc-9d81111c3de4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:32.222672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579597d2-a015-4b00-94cc-9d81111c3de4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:32.222949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579597d2-a015-4b00-94cc-9d81111c3de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:32.242186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-579597d2-a015-4b00-94cc-9d81111c3de4 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:32.243341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-579597d2-a015-4b00-94cc-9d81111c3de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:32.251427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1086/2162] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:32.255456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52628f4-878a-4380-befa-c0494ea19411 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:32.265358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52628f4-878a-4380-befa-c0494ea19411 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:32.269898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3bf75-c8f8-4e52-bf1b-6e6aef0eb5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:32.270581 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3bf75-c8f8-4e52-bf1b-6e6aef0eb5bf admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:32.270869 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3bf75-c8f8-4e52-bf1b-6e6aef0eb5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:32.271146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3bf75-c8f8-4e52-bf1b-6e6aef0eb5bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:32.271875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3bf75-c8f8-4e52-bf1b-6e6aef0eb5bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:11:32.272184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3bf75-c8f8-4e52-bf1b-6e6aef0eb5bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:32.273777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3bf75-c8f8-4e52-bf1b-6e6aef0eb5bf admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:32.286029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1077/2163] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:11:32.290186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579597d2-a015-4b00-94cc-9d81111c3de4 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:32.299728 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579597d2-a015-4b00-94cc-9d81111c3de4 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:32.304288 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847fe65-35f1-4b75-a82e-a0c697b6fddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:32.304926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847fe65-35f1-4b75-a82e-a0c697b6fddd admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:32.305208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847fe65-35f1-4b75-a82e-a0c697b6fddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:32.305483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847fe65-35f1-4b75-a82e-a0c697b6fddd admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:32.306821 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847fe65-35f1-4b75-a82e-a0c697b6fddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:32.309320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847fe65-35f1-4b75-a82e-a0c697b6fddd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:32.318965 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:32.338354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1087/2164] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:11:32 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:11:32.342424 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3bf75-c8f8-4e52-bf1b-6e6aef0eb5bf admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:32.352454 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3bf75-c8f8-4e52-bf1b-6e6aef0eb5bf admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:32.411424 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c96fee-b96f-46e2-8c7a-0cfb44c5cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:32.412195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c96fee-b96f-46e2-8c7a-0cfb44c5cfeb admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:32.412484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c96fee-b96f-46e2-8c7a-0cfb44c5cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:32.412766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c96fee-b96f-46e2-8c7a-0cfb44c5cfeb admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:32.413473 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c96fee-b96f-46e2-8c7a-0cfb44c5cfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:32.415441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c96fee-b96f-46e2-8c7a-0cfb44c5cfeb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:32.437561 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1078/2165] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:11:32 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:11:32.441041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847fe65-35f1-4b75-a82e-a0c697b6fddd admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:32.452099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847fe65-35f1-4b75-a82e-a0c697b6fddd admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:32.457160 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693ca63-151a-45c6-9610-7670720d36e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:32.457833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693ca63-151a-45c6-9610-7670720d36e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:32.458125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693ca63-151a-45c6-9610-7670720d36e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:32.458440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693ca63-151a-45c6-9610-7670720d36e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:32.459176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693ca63-151a-45c6-9610-7670720d36e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:32.460769 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693ca63-151a-45c6-9610-7670720d36e9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:32.471480 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1088/2166] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:11:32.475403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c96fee-b96f-46e2-8c7a-0cfb44c5cfeb admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:32.486550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c96fee-b96f-46e2-8c7a-0cfb44c5cfeb admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:32.491770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274073e-0215-471f-af94-d3dca9177c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:32.492515 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274073e-0215-471f-af94-d3dca9177c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:32.492753 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274073e-0215-471f-af94-d3dca9177c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:32.493032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274073e-0215-471f-af94-d3dca9177c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:32.494375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274073e-0215-471f-af94-d3dca9177c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:32.496090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274073e-0215-471f-af94-d3dca9177c8d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:32.505950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1079/2167] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:11:32.510144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693ca63-151a-45c6-9610-7670720d36e9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:32.520012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693ca63-151a-45c6-9610-7670720d36e9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:32.524653 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd3725-4f69-44d6-b5e4-35946aedd89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:32.525533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd3725-4f69-44d6-b5e4-35946aedd89e admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:32.525823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd3725-4f69-44d6-b5e4-35946aedd89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:32.526099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd3725-4f69-44d6-b5e4-35946aedd89e admin admin] PATH_INFO: `/v3/projects/00bd6251f79047f2a3397f58525ccb1f/users/289c4bbbd284402a99bc17666b3d1d3d/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:32.541000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd3725-4f69-44d6-b5e4-35946aedd89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=00bd6251f79047f2a3397f58525ccb1f, user_id=289c4bbbd284402a99bc17666b3d1d3d, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:32.543684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd3725-4f69-44d6-b5e4-35946aedd89e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:32.557316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1089/2168] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:11:32 2022] PUT /identity/v3/projects/00bd6251f79047f2a3397f58525ccb1f/users/289c4bbbd284402a99bc17666b3d1d3d/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:11:32.567789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212445-2c2a-4517-bc29-2c45428ddd15 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:32.568113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212445-2c2a-4517-bc29-2c45428ddd15 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:32.568398 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212445-2c2a-4517-bc29-2c45428ddd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:32.596989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-49212445-2c2a-4517-bc29-2c45428ddd15 None None] MFA Rules not processed for user `289c4bbbd284402a99bc17666b3d1d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:32.598539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-49212445-2c2a-4517-bc29-2c45428ddd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:32.670960 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1080/2169] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:32.684394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd3725-4f69-44d6-b5e4-35946aedd89e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:32.686787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-16bd3725-4f69-44d6-b5e4-35946aedd89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:32.784460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd3725-4f69-44d6-b5e4-35946aedd89e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:32.789638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330740c-bd27-4a1b-9236-37551058c9db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:32.790304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330740c-bd27-4a1b-9236-37551058c9db service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:32.790814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330740c-bd27-4a1b-9236-37551058c9db service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:32.791237 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330740c-bd27-4a1b-9236-37551058c9db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:32.800353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330740c-bd27-4a1b-9236-37551058c9db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:32.801788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330740c-bd27-4a1b-9236-37551058c9db service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:32.811380 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1090/2170] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:11:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:11:33.316491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3adaf0-d1fa-4e97-80ed-24bebae0b6fb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:33.316801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3adaf0-d1fa-4e97-80ed-24bebae0b6fb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:33.317090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3adaf0-d1fa-4e97-80ed-24bebae0b6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:33.335784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7a3adaf0-d1fa-4e97-80ed-24bebae0b6fb None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:33.337034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7a3adaf0-d1fa-4e97-80ed-24bebae0b6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:33.347014 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:33.402081 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1081/2171] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:11:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:33.414312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330740c-bd27-4a1b-9236-37551058c9db service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:33.417289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7330740c-bd27-4a1b-9236-37551058c9db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:33.503192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330740c-bd27-4a1b-9236-37551058c9db service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:33.510850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87821228-4ea8-429d-86df-a2491bd4a059 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:33.511553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821228-4ea8-429d-86df-a2491bd4a059 service swift] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:33.511852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821228-4ea8-429d-86df-a2491bd4a059 service swift] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:33.512104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821228-4ea8-429d-86df-a2491bd4a059 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:33.521974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87821228-4ea8-429d-86df-a2491bd4a059 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:33.523874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87821228-4ea8-429d-86df-a2491bd4a059 service swift] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:33.538569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1091/2172] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:11:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:11:34.196360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12923e68-7c5c-4385-9d41-2e81d3f9c543 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:34.197847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12923e68-7c5c-4385-9d41-2e81d3f9c543 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:34.198340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12923e68-7c5c-4385-9d41-2e81d3f9c543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:34.222413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-12923e68-7c5c-4385-9d41-2e81d3f9c543 None None] MFA Rules not processed for user `289c4bbbd284402a99bc17666b3d1d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:34.223702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-12923e68-7c5c-4385-9d41-2e81d3f9c543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:34.232981 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1082/2173] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:36.302251 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87821228-4ea8-429d-86df-a2491bd4a059 service swift] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:36.305188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-87821228-4ea8-429d-86df-a2491bd4a059 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:36.356782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:36.430632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87821228-4ea8-429d-86df-a2491bd4a059 service swift] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:36.437503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:36.438649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:36.439133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:36.439711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] PATH_INFO: `/v3/users/d9e41227f2554f0d91cb8b73d5fb27ce` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:36.441819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e41227f2554f0d91cb8b73d5fb27ce)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:36.449131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:36.548408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e41227f2554f0d91cb8b73d5fb27ce'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:36.560761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e41227f2554f0d91cb8b73d5fb27ce'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:36.582272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e41227f2554f0d91cb8b73d5fb27ce'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:36.600966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e41227f2554f0d91cb8b73d5fb27ce'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:36.601983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e41227f2554f0d91cb8b73d5fb27ce'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:36.636313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa295c5-3298-4c17-b4a9-075a5485cb71 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:36.636896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa295c5-3298-4c17-b4a9-075a5485cb71 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:36.637209 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa295c5-3298-4c17-b4a9-075a5485cb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:36.639782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1092/2174] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:11:36 2022] DELETE /identity/v3/users/d9e41227f2554f0d91cb8b73d5fb27ce => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:11:36.657232 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-baa295c5-3298-4c17-b4a9-075a5485cb71 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:36.658869 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-baa295c5-3298-4c17-b4a9-075a5485cb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:36.754077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1083/2175] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:36.764723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:36.766267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:36.834453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9a1e7-8165-4662-b9e9-3582865de7e9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:36.839080 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae18ce2-5467-4dc9-9ffa-97624ba1b46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:36.839838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae18ce2-5467-4dc9-9ffa-97624ba1b46d service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:36.840203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae18ce2-5467-4dc9-9ffa-97624ba1b46d service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:36.840563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae18ce2-5467-4dc9-9ffa-97624ba1b46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:36.855265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae18ce2-5467-4dc9-9ffa-97624ba1b46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:36.856814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae18ce2-5467-4dc9-9ffa-97624ba1b46d service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:36.873299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1093/2176] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:37.878911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa295c5-3298-4c17-b4a9-075a5485cb71 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:37.881563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-baa295c5-3298-4c17-b4a9-075a5485cb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:37.912495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa295c5-3298-4c17-b4a9-075a5485cb71 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:37.924359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84131b2a-9e19-4592-aa12-3c45042a6ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:37.926848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84131b2a-9e19-4592-aa12-3c45042a6ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:37.927143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84131b2a-9e19-4592-aa12-3c45042a6ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:37.927432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84131b2a-9e19-4592-aa12-3c45042a6ca5 admin admin] PATH_INFO: `/v3/projects/5ea45ae285ca44f3b90ea06c4a546cf4` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:37.931191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84131b2a-9e19-4592-aa12-3c45042a6ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea45ae285ca44f3b90ea06c4a546cf4)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:37.937309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84131b2a-9e19-4592-aa12-3c45042a6ca5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:38.064600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-84131b2a-9e19-4592-aa12-3c45042a6ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea45ae285ca44f3b90ea06c4a546cf4', 'request_id': 'req-84131b2a-9e19-4592-aa12-3c45042a6ca5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:38.079573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-84131b2a-9e19-4592-aa12-3c45042a6ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea45ae285ca44f3b90ea06c4a546cf4', 'request_id': 'req-84131b2a-9e19-4592-aa12-3c45042a6ca5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:38.087069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-84131b2a-9e19-4592-aa12-3c45042a6ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea45ae285ca44f3b90ea06c4a546cf4', 'request_id': 'req-84131b2a-9e19-4592-aa12-3c45042a6ca5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:38.117272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-84131b2a-9e19-4592-aa12-3c45042a6ca5 admin admin] The token cache is being invalidate because project 5ea45ae285ca44f3b90ea06c4a546cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:11:38.117490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-84131b2a-9e19-4592-aa12-3c45042a6ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:38.120425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-84131b2a-9e19-4592-aa12-3c45042a6ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:11:38.123488 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1084/2177] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:11:37 2022] DELETE /identity/v3/projects/5ea45ae285ca44f3b90ea06c4a546cf4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:11:38.128081 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5a4d8-9643-41e1-8357-71c04e4ca12c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:38.128943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5a4d8-9643-41e1-8357-71c04e4ca12c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:38.129387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5a4d8-9643-41e1-8357-71c04e4ca12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:38.171582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8ee5a4d8-9643-41e1-8357-71c04e4ca12c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:38.172826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8ee5a4d8-9643-41e1-8357-71c04e4ca12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:38.308486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:38.350398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1094/2178] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:38.356808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707105-a2e7-4f63-b275-b251245c5a7a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:38.359230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707105-a2e7-4f63-b275-b251245c5a7a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:38.359709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707105-a2e7-4f63-b275-b251245c5a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:38.412056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-dc707105-a2e7-4f63-b275-b251245c5a7a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:38.415075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dc707105-a2e7-4f63-b275-b251245c5a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:38.449248 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1085/2179] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:38.453615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5a4d8-9643-41e1-8357-71c04e4ca12c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:38.470610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5a4d8-9643-41e1-8357-71c04e4ca12c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:38.491758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ad24-f6ba-4fd6-9af0-c24eb76e2317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:38.492737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ad24-f6ba-4fd6-9af0-c24eb76e2317 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:38.494837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ad24-f6ba-4fd6-9af0-c24eb76e2317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:38.495522 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ad24-f6ba-4fd6-9af0-c24eb76e2317 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:38.499055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951ad24-f6ba-4fd6-9af0-c24eb76e2317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:11:38.499537 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951ad24-f6ba-4fd6-9af0-c24eb76e2317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:38.502425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951ad24-f6ba-4fd6-9af0-c24eb76e2317 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:38.557353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1095/2180] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:11:38.564415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc707105-a2e7-4f63-b275-b251245c5a7a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:38.593378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc707105-a2e7-4f63-b275-b251245c5a7a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:38.608752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df9f7d-3fe3-43d0-802c-ac1a61ea9468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:38.609463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df9f7d-3fe3-43d0-802c-ac1a61ea9468 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:38.609780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df9f7d-3fe3-43d0-802c-ac1a61ea9468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:38.610084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df9f7d-3fe3-43d0-802c-ac1a61ea9468 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:38.610998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df9f7d-3fe3-43d0-802c-ac1a61ea9468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:38.613057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df9f7d-3fe3-43d0-802c-ac1a61ea9468 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:38.676825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1086/2181] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:11:38 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:11:38.678551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ad24-f6ba-4fd6-9af0-c24eb76e2317 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:38.695729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ad24-f6ba-4fd6-9af0-c24eb76e2317 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:38.892362 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ccfab-bd6d-4961-a9d4-7972cf55c314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:38.893254 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ccfab-bd6d-4961-a9d4-7972cf55c314 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:38.894608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ccfab-bd6d-4961-a9d4-7972cf55c314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:38.894985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ccfab-bd6d-4961-a9d4-7972cf55c314 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:38.895712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ccfab-bd6d-4961-a9d4-7972cf55c314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:38.897989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ccfab-bd6d-4961-a9d4-7972cf55c314 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:38.926860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1096/2182] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:11:38 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:11:38.929994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df9f7d-3fe3-43d0-802c-ac1a61ea9468 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:38.940987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df9f7d-3fe3-43d0-802c-ac1a61ea9468 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:38.955839 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdff2f-a84e-4a40-870d-9d461da123ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:38.958171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdff2f-a84e-4a40-870d-9d461da123ce admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:38.960289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdff2f-a84e-4a40-870d-9d461da123ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:38.960777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdff2f-a84e-4a40-870d-9d461da123ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:38.961635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdff2f-a84e-4a40-870d-9d461da123ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:38.967271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdff2f-a84e-4a40-870d-9d461da123ce admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:38.970289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:38.998054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1087/2183] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:11:39.000665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ccfab-bd6d-4961-a9d4-7972cf55c314 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:39.020762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ccfab-bd6d-4961-a9d4-7972cf55c314 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:39.029783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdf1f9-0e89-484a-a3ac-99a910941766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:39.031797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdf1f9-0e89-484a-a3ac-99a910941766 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:39.032833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdf1f9-0e89-484a-a3ac-99a910941766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:39.033275 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdf1f9-0e89-484a-a3ac-99a910941766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:39.034304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdf1f9-0e89-484a-a3ac-99a910941766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:39.036326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdf1f9-0e89-484a-a3ac-99a910941766 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:39.055053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1097/2184] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:11:39.059363 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdff2f-a84e-4a40-870d-9d461da123ce admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:39.073506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdff2f-a84e-4a40-870d-9d461da123ce admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:39.101143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f6087-1763-4bd4-a2ec-397e866bccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:39.102251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f6087-1763-4bd4-a2ec-397e866bccee admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:39.102667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f6087-1763-4bd4-a2ec-397e866bccee admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:39.103267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f6087-1763-4bd4-a2ec-397e866bccee admin admin] PATH_INFO: `/v3/projects/fa5e9d9ea1804c13876e1e2e4d2e84f0/users/ba38916478fd4c02952938d7bcbd7486/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:39.139274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f6087-1763-4bd4-a2ec-397e866bccee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5e9d9ea1804c13876e1e2e4d2e84f0, user_id=ba38916478fd4c02952938d7bcbd7486, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:39.147212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f6087-1763-4bd4-a2ec-397e866bccee admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:39.178313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1088/2185] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:11:39 2022] PUT /identity/v3/projects/fa5e9d9ea1804c13876e1e2e4d2e84f0/users/ba38916478fd4c02952938d7bcbd7486/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:11:39.180943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f83e00-9266-4c02-a41f-9928e7367532 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:39.181976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f83e00-9266-4c02-a41f-9928e7367532 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:39.182098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f83e00-9266-4c02-a41f-9928e7367532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:39.249465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-77f83e00-9266-4c02-a41f-9928e7367532 None None] MFA Rules not processed for user `ba38916478fd4c02952938d7bcbd7486`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:39.252141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-77f83e00-9266-4c02-a41f-9928e7367532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:39.391024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1098/2186] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:11:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:39.417480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f6087-1763-4bd4-a2ec-397e866bccee admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:39.419439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f75f6087-1763-4bd4-a2ec-397e866bccee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:39.592495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f6087-1763-4bd4-a2ec-397e866bccee admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:39.597783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ed4b8-aeb3-4f64-b96f-796937fb919e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5b9c982724df0b88ce6ad46dc37e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:39.598658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ed4b8-aeb3-4f64-b96f-796937fb919e service glance] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:39.598975 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ed4b8-aeb3-4f64-b96f-796937fb919e service glance] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:39.599261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ed4b8-aeb3-4f64-b96f-796937fb919e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:39.611249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ed4b8-aeb3-4f64-b96f-796937fb919e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:39.612942 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ed4b8-aeb3-4f64-b96f-796937fb919e service glance] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:39.646634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1089/2187] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:11:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:49.387309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:49.620749 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=47,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:51.457475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2b3ed-4334-4179-b284-69dc1fd7cf9a None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:51.458013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2b3ed-4334-4179-b284-69dc1fd7cf9a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:51.458304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2b3ed-4334-4179-b284-69dc1fd7cf9a None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:51.460084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1099/2188] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 23 17:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:51.466470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce73e0-55e2-4278-b53b-b0bd9a7a928d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:51.466929 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce73e0-55e2-4278-b53b-b0bd9a7a928d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:51.467171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce73e0-55e2-4278-b53b-b0bd9a7a928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:51.517719 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-59ce73e0-55e2-4278-b53b-b0bd9a7a928d None None] MFA Rules not processed for user `9884780c88aa48ffa92a696740761387`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:51.519399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-59ce73e0-55e2-4278-b53b-b0bd9a7a928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:51.615483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1090/2189] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:51.627585 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2b3ed-4334-4179-b284-69dc1fd7cf9a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:51.629248 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-afb2b3ed-4334-4179-b284-69dc1fd7cf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:51.642234 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2b3ed-4334-4179-b284-69dc1fd7cf9a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:51.645734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66a605-1305-48fa-acef-f281f4812eff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5b9c982724df0b88ce6ad46dc37e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:51.646385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66a605-1305-48fa-acef-f281f4812eff service glance] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:51.646688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66a605-1305-48fa-acef-f281f4812eff service glance] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:51.646970 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66a605-1305-48fa-acef-f281f4812eff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:51.657565 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66a605-1305-48fa-acef-f281f4812eff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:51.659013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66a605-1305-48fa-acef-f281f4812eff service glance] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:51.670582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1100/2190] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:11:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:51.745344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6e72a-a4e5-497a-8c84-2d645783f637 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:51.745636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6e72a-a4e5-497a-8c84-2d645783f637 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:51.745915 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6e72a-a4e5-497a-8c84-2d645783f637 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:51.747301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1091/2191] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 23 17:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:51.751876 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28cf8e-90b8-4a2b-bdd8-8d16321a7925 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:51.752206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28cf8e-90b8-4a2b-bdd8-8d16321a7925 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:51.752474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28cf8e-90b8-4a2b-bdd8-8d16321a7925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:51.770699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3c28cf8e-90b8-4a2b-bdd8-8d16321a7925 None None] MFA Rules not processed for user `73bdfedb6d9e4ddab18a8143ba7142fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:51.771936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3c28cf8e-90b8-4a2b-bdd8-8d16321a7925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:51.827725 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1101/2192] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:51.841256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6e72a-a4e5-497a-8c84-2d645783f637 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:51.842959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-18a6e72a-a4e5-497a-8c84-2d645783f637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:51.856804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6e72a-a4e5-497a-8c84-2d645783f637 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:51.860242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cfb06-e422-4063-a969-4ed374ee5610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:51.860897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cfb06-e422-4063-a969-4ed374ee5610 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:51.861181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cfb06-e422-4063-a969-4ed374ee5610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:51.861455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cfb06-e422-4063-a969-4ed374ee5610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:51.868982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cfb06-e422-4063-a969-4ed374ee5610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:51.870454 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cfb06-e422-4063-a969-4ed374ee5610 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:51.878218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1092/2193] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:11:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:51.970026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433de2c-6f4e-466d-8431-2d4e9f74984b None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:51.970026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433de2c-6f4e-466d-8431-2d4e9f74984b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:51.970026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433de2c-6f4e-466d-8431-2d4e9f74984b None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:51.971542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1102/2194] 10.222.0.49 () {54 vars in 921 bytes} [Mon May 23 17:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:51.976530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2ac14-6753-492e-8802-6849e3f9e266 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:51.976829 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2ac14-6753-492e-8802-6849e3f9e266 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:51.977114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2ac14-6753-492e-8802-6849e3f9e266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:51.997758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3ee2ac14-6753-492e-8802-6849e3f9e266 None None] MFA Rules not processed for user `9884780c88aa48ffa92a696740761387`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:51.999021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3ee2ac14-6753-492e-8802-6849e3f9e266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:52.011293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1093/2195] 10.222.0.49 () {58 vars in 1018 bytes} [Mon May 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:52.028040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433de2c-6f4e-466d-8431-2d4e9f74984b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:52.043452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433de2c-6f4e-466d-8431-2d4e9f74984b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:52.050766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039cbe0-8253-4de5-a6f2-b9757683b00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:52.051452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039cbe0-8253-4de5-a6f2-b9757683b00f service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:52.051745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039cbe0-8253-4de5-a6f2-b9757683b00f service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:52.052029 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039cbe0-8253-4de5-a6f2-b9757683b00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:52.062945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039cbe0-8253-4de5-a6f2-b9757683b00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:52.064358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039cbe0-8253-4de5-a6f2-b9757683b00f service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:52.075578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1103/2196] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:11:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:55.823468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d014143-cc6f-4470-9161-a7ccee1f7699 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:55.823965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d014143-cc6f-4470-9161-a7ccee1f7699 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:55.824072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d014143-cc6f-4470-9161-a7ccee1f7699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:55.843882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b096ba-bd44-4de2-b989-781276db3f3a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:55.844332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b096ba-bd44-4de2-b989-781276db3f3a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:55.844483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b096ba-bd44-4de2-b989-781276db3f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:55.874856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9d014143-cc6f-4470-9161-a7ccee1f7699 None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:55.876075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9d014143-cc6f-4470-9161-a7ccee1f7699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:55.883171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f5b096ba-bd44-4de2-b989-781276db3f3a None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:55.885158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f5b096ba-bd44-4de2-b989-781276db3f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:55.941816 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1094/2197] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:11:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:55.949962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1104/2198] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:11:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:11:55.958456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d014143-cc6f-4470-9161-a7ccee1f7699 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:55.959803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9d014143-cc6f-4470-9161-a7ccee1f7699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:55.964432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b096ba-bd44-4de2-b989-781276db3f3a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:55.965744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f5b096ba-bd44-4de2-b989-781276db3f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:55.972633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:56.030411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:56.053972 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d014143-cc6f-4470-9161-a7ccee1f7699 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:56.058891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b096ba-bd44-4de2-b989-781276db3f3a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:56.059615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6eb8f-ec06-47eb-8f08-eda0fc482f27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:56.060383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6eb8f-ec06-47eb-8f08-eda0fc482f27 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:56.060853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6eb8f-ec06-47eb-8f08-eda0fc482f27 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:56.061235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6eb8f-ec06-47eb-8f08-eda0fc482f27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:56.063971 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a2c3b-64a4-47c8-9aaf-cb787b6008ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:56.064610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a2c3b-64a4-47c8-9aaf-cb787b6008ef service swift] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:56.064896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a2c3b-64a4-47c8-9aaf-cb787b6008ef service swift] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:56.065174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a2c3b-64a4-47c8-9aaf-cb787b6008ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:56.069904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6eb8f-ec06-47eb-8f08-eda0fc482f27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:56.072148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6eb8f-ec06-47eb-8f08-eda0fc482f27 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:56.073960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a2c3b-64a4-47c8-9aaf-cb787b6008ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:56.075559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a2c3b-64a4-47c8-9aaf-cb787b6008ef service swift] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:56.080493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1095/2199] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:11:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 17:11:56.085780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1105/2200] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:11:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 17:11:56.936171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f257a-fd7c-4324-b723-0ae83f56a395 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:56.936645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f257a-fd7c-4324-b723-0ae83f56a395 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:56.936735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f257a-fd7c-4324-b723-0ae83f56a395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:56.957134 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d73f257a-fd7c-4324-b723-0ae83f56a395 None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:56.958431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d73f257a-fd7c-4324-b723-0ae83f56a395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:56.965718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1096/2201] 10.222.0.49 () {58 vars in 967 bytes} [Mon May 23 17:11:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:11:56.980202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a2c3b-64a4-47c8-9aaf-cb787b6008ef service swift] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:56.991273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a2c3b-64a4-47c8-9aaf-cb787b6008ef service swift] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:56.998605 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5a3d1-bac2-430f-8c68-4b7fee28e491 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:56.999458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5a3d1-bac2-430f-8c68-4b7fee28e491 service swift] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:56.999968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5a3d1-bac2-430f-8c68-4b7fee28e491 service swift] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:57.000476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5a3d1-bac2-430f-8c68-4b7fee28e491 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:57.011834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5a3d1-bac2-430f-8c68-4b7fee28e491 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:57.013476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5a3d1-bac2-430f-8c68-4b7fee28e491 service swift] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:57.022928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1106/2202] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:11:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:11:57.248010 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdcef1-d425-4447-9242-75eef5aaf32c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:57.248371 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdcef1-d425-4447-9242-75eef5aaf32c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:57.248570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdcef1-d425-4447-9242-75eef5aaf32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:57.267279 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a2fdcef1-d425-4447-9242-75eef5aaf32c None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:57.268610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a2fdcef1-d425-4447-9242-75eef5aaf32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:57.276870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1097/2203] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:11:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:57.299117 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5a3d1-bac2-430f-8c68-4b7fee28e491 service swift] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:57.311761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5a3d1-bac2-430f-8c68-4b7fee28e491 service swift] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:57.317000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7260b-2b0c-4b75-9146-80b3b4a25716 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:57.317904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7260b-2b0c-4b75-9146-80b3b4a25716 service swift] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:57.318193 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7260b-2b0c-4b75-9146-80b3b4a25716 service swift] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:57.318503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7260b-2b0c-4b75-9146-80b3b4a25716 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:57.327903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7260b-2b0c-4b75-9146-80b3b4a25716 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:57.329724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7260b-2b0c-4b75-9146-80b3b4a25716 service swift] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:57.340214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1107/2204] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:11:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:11:57.740274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df435-7df0-452a-9ea9-dd39bdf8d784 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:57.740489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df435-7df0-452a-9ea9-dd39bdf8d784 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:57.740959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df435-7df0-452a-9ea9-dd39bdf8d784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:57.760712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b32df435-7df0-452a-9ea9-dd39bdf8d784 None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:57.761937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b32df435-7df0-452a-9ea9-dd39bdf8d784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:57.791029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1098/2205] 10.222.0.49 () {58 vars in 967 bytes} [Mon May 23 17:11:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:57.804052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7260b-2b0c-4b75-9146-80b3b4a25716 service swift] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:57.817490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7260b-2b0c-4b75-9146-80b3b4a25716 service swift] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:57.841557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057c26d-0b07-4e1d-8e73-bd779528d4a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:57.842297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057c26d-0b07-4e1d-8e73-bd779528d4a6 service swift] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:57.842980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057c26d-0b07-4e1d-8e73-bd779528d4a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:57.843963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057c26d-0b07-4e1d-8e73-bd779528d4a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:57.875655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057c26d-0b07-4e1d-8e73-bd779528d4a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:57.878113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057c26d-0b07-4e1d-8e73-bd779528d4a6 service swift] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:57.895660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1108/2206] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:11:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:12:00.147004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df435-7df0-452a-9ea9-dd39bdf8d784 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:00.148492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b32df435-7df0-452a-9ea9-dd39bdf8d784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:00.229560 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df435-7df0-452a-9ea9-dd39bdf8d784 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:00.245901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:00.247045 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:00.247970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:00.247970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] PATH_INFO: `/v3/users/289c4bbbd284402a99bc17666b3d1d3d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:00.248938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] RBAC: Authorizing `identity:delete_user(user_id=289c4bbbd284402a99bc17666b3d1d3d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:00.251149 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:00.328820 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289c4bbbd284402a99bc17666b3d1d3d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:00.348100 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:00.349214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289c4bbbd284402a99bc17666b3d1d3d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:00.350231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289c4bbbd284402a99bc17666b3d1d3d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:00.361627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289c4bbbd284402a99bc17666b3d1d3d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:00.367216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289c4bbbd284402a99bc17666b3d1d3d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:00.387132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1099/2207] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:12:00 2022] DELETE /identity/v3/users/289c4bbbd284402a99bc17666b3d1d3d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:12:00.388957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1fe9b-38bf-4f02-8ae3-0fa86de20c12 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:00.389459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1fe9b-38bf-4f02-8ae3-0fa86de20c12 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:00.389658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1fe9b-38bf-4f02-8ae3-0fa86de20c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:00.415532 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a2c1fe9b-38bf-4f02-8ae3-0fa86de20c12 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:00.416969 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a2c1fe9b-38bf-4f02-8ae3-0fa86de20c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:00.502149 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1109/2208] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:12:00.513491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:00.515166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:00.590854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b787fc-bbe1-4e15-b33a-f237f2a3081f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:00.597656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab2738-b0ea-46c4-a20b-f8d82317f185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:00.598717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2738-b0ea-46c4-a20b-f8d82317f185 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:00.599208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2738-b0ea-46c4-a20b-f8d82317f185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:00.599595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2738-b0ea-46c4-a20b-f8d82317f185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:00.637367 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab2738-b0ea-46c4-a20b-f8d82317f185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:00.639643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab2738-b0ea-46c4-a20b-f8d82317f185 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:00.657453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1100/2209] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:12:00.889663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1fe9b-38bf-4f02-8ae3-0fa86de20c12 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:00.891106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a2c1fe9b-38bf-4f02-8ae3-0fa86de20c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:00.911981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1fe9b-38bf-4f02-8ae3-0fa86de20c12 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:00.917824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc690c3-e490-4d70-b1d9-39a7a52282dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:00.918915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc690c3-e490-4d70-b1d9-39a7a52282dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:00.919373 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc690c3-e490-4d70-b1d9-39a7a52282dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:00.919680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc690c3-e490-4d70-b1d9-39a7a52282dd admin admin] PATH_INFO: `/v3/projects/00bd6251f79047f2a3397f58525ccb1f` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:00.921126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc690c3-e490-4d70-b1d9-39a7a52282dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=00bd6251f79047f2a3397f58525ccb1f)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:00.923142 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc690c3-e490-4d70-b1d9-39a7a52282dd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:00.978462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-afc690c3-e490-4d70-b1d9-39a7a52282dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00bd6251f79047f2a3397f58525ccb1f', 'request_id': 'req-afc690c3-e490-4d70-b1d9-39a7a52282dd'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:00.986160 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-afc690c3-e490-4d70-b1d9-39a7a52282dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00bd6251f79047f2a3397f58525ccb1f', 'request_id': 'req-afc690c3-e490-4d70-b1d9-39a7a52282dd'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:00.993330 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-afc690c3-e490-4d70-b1d9-39a7a52282dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00bd6251f79047f2a3397f58525ccb1f', 'request_id': 'req-afc690c3-e490-4d70-b1d9-39a7a52282dd'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:01.004224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-afc690c3-e490-4d70-b1d9-39a7a52282dd admin admin] The token cache is being invalidate because project 00bd6251f79047f2a3397f58525ccb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:12:01.004525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-afc690c3-e490-4d70-b1d9-39a7a52282dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:01.005184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-afc690c3-e490-4d70-b1d9-39a7a52282dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:01.006784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1110/2210] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:12:00 2022] DELETE /identity/v3/projects/00bd6251f79047f2a3397f58525ccb1f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:12:06.443307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab2738-b0ea-46c4-a20b-f8d82317f185 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:06.444851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-40ab2738-b0ea-46c4-a20b-f8d82317f185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:06.458177 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab2738-b0ea-46c4-a20b-f8d82317f185 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:06.513383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:06.514261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:06.514577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:06.514855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] PATH_INFO: `/v3/users/ba38916478fd4c02952938d7bcbd7486` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:06.516044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba38916478fd4c02952938d7bcbd7486)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:06.517975 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:06.563957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba38916478fd4c02952938d7bcbd7486'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:06.576074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba38916478fd4c02952938d7bcbd7486'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:06.576734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba38916478fd4c02952938d7bcbd7486'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:06.584224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba38916478fd4c02952938d7bcbd7486'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:06.584895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba38916478fd4c02952938d7bcbd7486'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:06.597486 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1101/2211] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:12:06 2022] DELETE /identity/v3/users/ba38916478fd4c02952938d7bcbd7486 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:12:06.602075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5033fd9-d606-46da-88bd-766159c68502 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:06.602667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5033fd9-d606-46da-88bd-766159c68502 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:06.602770 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5033fd9-d606-46da-88bd-766159c68502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:06.621255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e5033fd9-d606-46da-88bd-766159c68502 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:06.622495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e5033fd9-d606-46da-88bd-766159c68502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:06.631523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:06.683913 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1111/2212] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:06.693277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:06.694727 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:06.701191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:06.758928 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fda19-a591-4a1c-9ae6-56ccc452ecac admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:06.762578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01a022-9127-47f3-9912-db5233f6fe59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:06.763224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01a022-9127-47f3-9912-db5233f6fe59 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:06.763510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01a022-9127-47f3-9912-db5233f6fe59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:06.763786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01a022-9127-47f3-9912-db5233f6fe59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:06.774103 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01a022-9127-47f3-9912-db5233f6fe59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:06.776613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01a022-9127-47f3-9912-db5233f6fe59 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:06.786432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1102/2213] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:12:07.048826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5033fd9-d606-46da-88bd-766159c68502 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:07.049337 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e5033fd9-d606-46da-88bd-766159c68502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:07.064316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5033fd9-d606-46da-88bd-766159c68502 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:07.069693 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26872c02-3fc9-49cf-8393-ddbaaba5ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:07.072312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26872c02-3fc9-49cf-8393-ddbaaba5ca62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:07.072312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26872c02-3fc9-49cf-8393-ddbaaba5ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:07.072555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26872c02-3fc9-49cf-8393-ddbaaba5ca62 admin admin] PATH_INFO: `/v3/projects/fa5e9d9ea1804c13876e1e2e4d2e84f0` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:07.073829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26872c02-3fc9-49cf-8393-ddbaaba5ca62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5e9d9ea1804c13876e1e2e4d2e84f0)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:07.075804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26872c02-3fc9-49cf-8393-ddbaaba5ca62 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:07.123725 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26872c02-3fc9-49cf-8393-ddbaaba5ca62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5e9d9ea1804c13876e1e2e4d2e84f0', 'request_id': 'req-26872c02-3fc9-49cf-8393-ddbaaba5ca62'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:07.130771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26872c02-3fc9-49cf-8393-ddbaaba5ca62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5e9d9ea1804c13876e1e2e4d2e84f0', 'request_id': 'req-26872c02-3fc9-49cf-8393-ddbaaba5ca62'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:07.137494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26872c02-3fc9-49cf-8393-ddbaaba5ca62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5e9d9ea1804c13876e1e2e4d2e84f0', 'request_id': 'req-26872c02-3fc9-49cf-8393-ddbaaba5ca62'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:07.147685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26872c02-3fc9-49cf-8393-ddbaaba5ca62 admin admin] The token cache is being invalidate because project fa5e9d9ea1804c13876e1e2e4d2e84f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:12:07.147977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26872c02-3fc9-49cf-8393-ddbaaba5ca62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:07.148614 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26872c02-3fc9-49cf-8393-ddbaaba5ca62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:12:07.150424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1112/2214] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:12:07 2022] DELETE /identity/v3/projects/fa5e9d9ea1804c13876e1e2e4d2e84f0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:12:07.155279 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f45511-9bec-46e8-a3dc-574c0df647bf None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:07.155751 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f45511-9bec-46e8-a3dc-574c0df647bf None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:07.156115 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f45511-9bec-46e8-a3dc-574c0df647bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:07.173864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-45f45511-9bec-46e8-a3dc-574c0df647bf None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:07.175082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-45f45511-9bec-46e8-a3dc-574c0df647bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:07.235456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1103/2215] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:07.244837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e503-ca52-44d4-b9e2-fbbfb5ea1d5a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:07.245369 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e503-ca52-44d4-b9e2-fbbfb5ea1d5a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:07.245654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e503-ca52-44d4-b9e2-fbbfb5ea1d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:07.264945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8d05e503-ca52-44d4-b9e2-fbbfb5ea1d5a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:07.266162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8d05e503-ca52-44d4-b9e2-fbbfb5ea1d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:07.274239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1113/2216] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:07.278570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f45511-9bec-46e8-a3dc-574c0df647bf None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:07.288136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f45511-9bec-46e8-a3dc-574c0df647bf None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:07.293579 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1ce82-89c3-4aed-b98b-5894b98b6046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:07.294242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1ce82-89c3-4aed-b98b-5894b98b6046 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:07.294564 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1ce82-89c3-4aed-b98b-5894b98b6046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:07.294843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1ce82-89c3-4aed-b98b-5894b98b6046 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:07.295581 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1ce82-89c3-4aed-b98b-5894b98b6046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:12:07.295890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1ce82-89c3-4aed-b98b-5894b98b6046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:07.297501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1ce82-89c3-4aed-b98b-5894b98b6046 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:07.311055 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1104/2217] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:12:07.314832 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e503-ca52-44d4-b9e2-fbbfb5ea1d5a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:07.324346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e503-ca52-44d4-b9e2-fbbfb5ea1d5a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:07.329045 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea632e1c-ad45-4953-846c-3f6fd42d900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:07.329957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea632e1c-ad45-4953-846c-3f6fd42d900c admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:07.330245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea632e1c-ad45-4953-846c-3f6fd42d900c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:07.330563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea632e1c-ad45-4953-846c-3f6fd42d900c admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:07.331272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea632e1c-ad45-4953-846c-3f6fd42d900c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:07.333184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea632e1c-ad45-4953-846c-3f6fd42d900c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:07.362985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1114/2218] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:12:07 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:12:07.364107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1ce82-89c3-4aed-b98b-5894b98b6046 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:07.374793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1ce82-89c3-4aed-b98b-5894b98b6046 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:07.436422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261bc61-5c46-4f74-bc8e-8b13676d1582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:07.437093 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261bc61-5c46-4f74-bc8e-8b13676d1582 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:07.437381 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261bc61-5c46-4f74-bc8e-8b13676d1582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:07.437667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261bc61-5c46-4f74-bc8e-8b13676d1582 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:07.438380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261bc61-5c46-4f74-bc8e-8b13676d1582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:07.440305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261bc61-5c46-4f74-bc8e-8b13676d1582 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:07.460842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1105/2219] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:12:07 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:12:07.465214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea632e1c-ad45-4953-846c-3f6fd42d900c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:07.475352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea632e1c-ad45-4953-846c-3f6fd42d900c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:07.480913 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfad9b-a772-4b14-90b0-1ac7acdef2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:07.481580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfad9b-a772-4b14-90b0-1ac7acdef2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:07.481868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfad9b-a772-4b14-90b0-1ac7acdef2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:07.482154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfad9b-a772-4b14-90b0-1ac7acdef2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:07.482928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfad9b-a772-4b14-90b0-1ac7acdef2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:07.484513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfad9b-a772-4b14-90b0-1ac7acdef2f8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:07.495482 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1115/2220] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:12:07.499355 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261bc61-5c46-4f74-bc8e-8b13676d1582 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:07.509500 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261bc61-5c46-4f74-bc8e-8b13676d1582 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:07.514153 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdcd33-c8cd-4864-bc5a-6daa3f81705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:07.514850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdcd33-c8cd-4864-bc5a-6daa3f81705d admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:07.515142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdcd33-c8cd-4864-bc5a-6daa3f81705d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:07.515423 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdcd33-c8cd-4864-bc5a-6daa3f81705d admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:07.516158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdcd33-c8cd-4864-bc5a-6daa3f81705d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:07.517753 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdcd33-c8cd-4864-bc5a-6daa3f81705d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:07.528303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1106/2221] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:12:07.532392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfad9b-a772-4b14-90b0-1ac7acdef2f8 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:07.543110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfad9b-a772-4b14-90b0-1ac7acdef2f8 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:07.547777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea62bc3-de1f-4e5e-98ab-24e74e3bf433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:07.548698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea62bc3-de1f-4e5e-98ab-24e74e3bf433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:07.548980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea62bc3-de1f-4e5e-98ab-24e74e3bf433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:07.549253 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea62bc3-de1f-4e5e-98ab-24e74e3bf433 admin admin] PATH_INFO: `/v3/projects/6763f0fa8aaf47e9ba513ca4c60e743d/users/cf37fdf077124d4ba101bd53c34178e6/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:07.563940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea62bc3-de1f-4e5e-98ab-24e74e3bf433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6763f0fa8aaf47e9ba513ca4c60e743d, user_id=cf37fdf077124d4ba101bd53c34178e6, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:07.566681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea62bc3-de1f-4e5e-98ab-24e74e3bf433 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:07.580626 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1116/2222] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:12:07 2022] PUT /identity/v3/projects/6763f0fa8aaf47e9ba513ca4c60e743d/users/cf37fdf077124d4ba101bd53c34178e6/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:12:07.585672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c2a18-0dad-43d8-b880-3e702e30dfff None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:07.586019 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c2a18-0dad-43d8-b880-3e702e30dfff None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:07.586307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c2a18-0dad-43d8-b880-3e702e30dfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:07.607297 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-463c2a18-0dad-43d8-b880-3e702e30dfff None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:07.608533 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-463c2a18-0dad-43d8-b880-3e702e30dfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:07.613775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:07.668689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1107/2223] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:12:07.678341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea62bc3-de1f-4e5e-98ab-24e74e3bf433 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:07.680184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8ea62bc3-de1f-4e5e-98ab-24e74e3bf433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:07.724737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:07.744420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea62bc3-de1f-4e5e-98ab-24e74e3bf433 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:07.748472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2e77a-f583-4de1-a05c-b7c2cd8da50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:07.749069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2e77a-f583-4de1-a05c-b7c2cd8da50c service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:07.749351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2e77a-f583-4de1-a05c-b7c2cd8da50c service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:07.749627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2e77a-f583-4de1-a05c-b7c2cd8da50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:07.759084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2e77a-f583-4de1-a05c-b7c2cd8da50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:07.761732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2e77a-f583-4de1-a05c-b7c2cd8da50c service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:07.772555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1117/2224] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:12:08.821120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c2a18-0dad-43d8-b880-3e702e30dfff None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:08.822736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-463c2a18-0dad-43d8-b880-3e702e30dfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:08.953555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c2a18-0dad-43d8-b880-3e702e30dfff None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:08.959971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813b2ac-4c0d-4361-91a1-e53762c19045 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81fb8b261e2142fcbf8d23bd010bf715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:08.960694 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b2ac-4c0d-4361-91a1-e53762c19045 service placement] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:08.961164 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b2ac-4c0d-4361-91a1-e53762c19045 service placement] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:08.961672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b2ac-4c0d-4361-91a1-e53762c19045 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:08.964204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8813b2ac-4c0d-4361-91a1-e53762c19045 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:08.977627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813b2ac-4c0d-4361-91a1-e53762c19045 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:08.979513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813b2ac-4c0d-4361-91a1-e53762c19045 service placement] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:08.991891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1108/2225] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:12:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:12:12.573004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188e80-e616-45ec-92b8-d5f98bf899ea None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:12.573531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188e80-e616-45ec-92b8-d5f98bf899ea None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:12.573618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188e80-e616-45ec-92b8-d5f98bf899ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:12.610801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4336cc4-14f6-45c2-bfce-33e82a9ff247 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:12.611265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4336cc4-14f6-45c2-bfce-33e82a9ff247 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:12.611369 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4336cc4-14f6-45c2-bfce-33e82a9ff247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:12.613451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b3188e80-e616-45ec-92b8-d5f98bf899ea None None] MFA Rules not processed for user `cf37fdf077124d4ba101bd53c34178e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:12.614715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b3188e80-e616-45ec-92b8-d5f98bf899ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:12.629539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f4336cc4-14f6-45c2-bfce-33e82a9ff247 None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:12.630838 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f4336cc4-14f6-45c2-bfce-33e82a9ff247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:12.681995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1118/2226] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:12:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:12.686381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188e80-e616-45ec-92b8-d5f98bf899ea None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:12.689628 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1109/2227] 10.222.0.49 () {58 vars in 967 bytes} [Mon May 23 17:12:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:12.696703 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188e80-e616-45ec-92b8-d5f98bf899ea None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:12.701644 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f21ae-9774-4081-be4e-c700c6fbc65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:12.702313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f21ae-9774-4081-be4e-c700c6fbc65f admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:12.702642 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f21ae-9774-4081-be4e-c700c6fbc65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:12.702923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f21ae-9774-4081-be4e-c700c6fbc65f admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:12.703626 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f21ae-9774-4081-be4e-c700c6fbc65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:12.706349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f21ae-9774-4081-be4e-c700c6fbc65f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:12.717379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4336cc4-14f6-45c2-bfce-33e82a9ff247 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:12.719337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f4336cc4-14f6-45c2-bfce-33e82a9ff247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:12.733975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1119/2228] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:12:12 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:12:12.738124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f21ae-9774-4081-be4e-c700c6fbc65f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:12.763379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:12.805168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4336cc4-14f6-45c2-bfce-33e82a9ff247 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:12.805346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f21ae-9774-4081-be4e-c700c6fbc65f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:12.810544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f19f94-71b5-4c9d-b7f0-b6bb2887075b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:12.811223 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f19f94-71b5-4c9d-b7f0-b6bb2887075b admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:12.811512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f19f94-71b5-4c9d-b7f0-b6bb2887075b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:12.811792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f19f94-71b5-4c9d-b7f0-b6bb2887075b admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:12.812484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f19f94-71b5-4c9d-b7f0-b6bb2887075b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:12.814439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f19f94-71b5-4c9d-b7f0-b6bb2887075b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:12.845075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1120/2229] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:12:12 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:12:12.848948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f19f94-71b5-4c9d-b7f0-b6bb2887075b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:12.859549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f19f94-71b5-4c9d-b7f0-b6bb2887075b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:12.864752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948a158-4596-422b-b56e-f07b21018d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:12.865396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a158-4596-422b-b56e-f07b21018d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:12.865702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a158-4596-422b-b56e-f07b21018d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:12.865970 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a158-4596-422b-b56e-f07b21018d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:12.866740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948a158-4596-422b-b56e-f07b21018d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:12.868364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948a158-4596-422b-b56e-f07b21018d71 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:12.879383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaaf8f-02b1-4287-939a-4f10d753eaa9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:12.879552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1121/2230] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:12:12.880042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaaf8f-02b1-4287-939a-4f10d753eaa9 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:12.880403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaaf8f-02b1-4287-939a-4f10d753eaa9 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:12.880689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaaf8f-02b1-4287-939a-4f10d753eaa9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:12.883457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948a158-4596-422b-b56e-f07b21018d71 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:12.893109 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948a158-4596-422b-b56e-f07b21018d71 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:12.897783 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab47c4-bd67-4cc2-94c4-cc8b94abf481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:12.898667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab47c4-bd67-4cc2-94c4-cc8b94abf481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:12.898958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab47c4-bd67-4cc2-94c4-cc8b94abf481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:12.899244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab47c4-bd67-4cc2-94c4-cc8b94abf481 admin admin] PATH_INFO: `/v3/projects/e69dd59fb6064e728604b4a2ab2130b3/users/05ef74cf08ed46be898d3410af0b05c1/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:12.914875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab47c4-bd67-4cc2-94c4-cc8b94abf481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69dd59fb6064e728604b4a2ab2130b3, user_id=05ef74cf08ed46be898d3410af0b05c1, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:12.918204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab47c4-bd67-4cc2-94c4-cc8b94abf481 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:12.928186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:12.934392 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1122/2231] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:12:12 2022] PUT /identity/v3/projects/e69dd59fb6064e728604b4a2ab2130b3/users/05ef74cf08ed46be898d3410af0b05c1/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:12:12.938320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab47c4-bd67-4cc2-94c4-cc8b94abf481 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:12.939218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaaf8f-02b1-4287-939a-4f10d753eaa9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:12.940826 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaaf8f-02b1-4287-939a-4f10d753eaa9 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:12.950349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1110/2232] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:12:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 17:12:13.006850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab47c4-bd67-4cc2-94c4-cc8b94abf481 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:13.012599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53e1a9-d245-457c-9947-d1db6bfccef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:13.013267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53e1a9-d245-457c-9947-d1db6bfccef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:13.013561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53e1a9-d245-457c-9947-d1db6bfccef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:13.013834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53e1a9-d245-457c-9947-d1db6bfccef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:13.014726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53e1a9-d245-457c-9947-d1db6bfccef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:13.016617 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53e1a9-d245-457c-9947-d1db6bfccef3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:13.028895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1123/2233] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:12:13.033183 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaaf8f-02b1-4287-939a-4f10d753eaa9 service swift] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:13.045106 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaaf8f-02b1-4287-939a-4f10d753eaa9 service swift] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:13.049998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82918c-5a46-4a5a-9097-daa1de8e80f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:13.050994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82918c-5a46-4a5a-9097-daa1de8e80f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:13.051280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82918c-5a46-4a5a-9097-daa1de8e80f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:13.051567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82918c-5a46-4a5a-9097-daa1de8e80f6 admin admin] PATH_INFO: `/v3/projects/e69dd59fb6064e728604b4a2ab2130b3/users/05ef74cf08ed46be898d3410af0b05c1/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:13.053788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82918c-5a46-4a5a-9097-daa1de8e80f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69dd59fb6064e728604b4a2ab2130b3, user_id=05ef74cf08ed46be898d3410af0b05c1, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:13.056642 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82918c-5a46-4a5a-9097-daa1de8e80f6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:13.077352 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1111/2234] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:12:13 2022] PUT /identity/v3/projects/e69dd59fb6064e728604b4a2ab2130b3/users/05ef74cf08ed46be898d3410af0b05c1/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:12:17.703297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb0830-65b6-452f-9406-25ef224d6397 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:17.704753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb0830-65b6-452f-9406-25ef224d6397 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:17.705044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb0830-65b6-452f-9406-25ef224d6397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:17.772367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-fdbb0830-65b6-452f-9406-25ef224d6397 None None] MFA Rules not processed for user `05ef74cf08ed46be898d3410af0b05c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:17.772367 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fdbb0830-65b6-452f-9406-25ef224d6397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:17.891031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1124/2235] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:12:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:17.904198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82918c-5a46-4a5a-9097-daa1de8e80f6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:17.906090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-db82918c-5a46-4a5a-9097-daa1de8e80f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:17.976500 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82918c-5a46-4a5a-9097-daa1de8e80f6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:17.980840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9f339-fd69-49b6-a553-124d83b52966 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5b9c982724df0b88ce6ad46dc37e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:17.981503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9f339-fd69-49b6-a553-124d83b52966 service glance] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:17.981793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9f339-fd69-49b6-a553-124d83b52966 service glance] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:17.982077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9f339-fd69-49b6-a553-124d83b52966 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:17.992468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:18.055508 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9f339-fd69-49b6-a553-124d83b52966 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:18.057865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9f339-fd69-49b6-a553-124d83b52966 service glance] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:18.068131 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1112/2236] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:12:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:12:18.173714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47758d9c-9d3c-4265-8c0c-525bf4638f5e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:18.174096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47758d9c-9d3c-4265-8c0c-525bf4638f5e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:18.174487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47758d9c-9d3c-4265-8c0c-525bf4638f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:18.195260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-47758d9c-9d3c-4265-8c0c-525bf4638f5e None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:18.196477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-47758d9c-9d3c-4265-8c0c-525bf4638f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:18.260472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1125/2237] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:18.272896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9f339-fd69-49b6-a553-124d83b52966 service glance] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:18.349713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9f339-fd69-49b6-a553-124d83b52966 service glance] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:18.355829 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc18a3-975d-49e7-a1ca-03c07003ca43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:18.356497 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc18a3-975d-49e7-a1ca-03c07003ca43 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:18.356787 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc18a3-975d-49e7-a1ca-03c07003ca43 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:18.357066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc18a3-975d-49e7-a1ca-03c07003ca43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:18.366232 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc18a3-975d-49e7-a1ca-03c07003ca43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:18.368002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc18a3-975d-49e7-a1ca-03c07003ca43 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:18.377027 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1113/2238] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:12:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:12:28.149304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27308591-9cee-456a-a2cf-c78c0ca2e481 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:28.149749 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27308591-9cee-456a-a2cf-c78c0ca2e481 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:28.149878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27308591-9cee-456a-a2cf-c78c0ca2e481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:28.167919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-27308591-9cee-456a-a2cf-c78c0ca2e481 None None] MFA Rules not processed for user `cf37fdf077124d4ba101bd53c34178e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:28.169121 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-27308591-9cee-456a-a2cf-c78c0ca2e481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:28.176072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1126/2239] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:12:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:28.373608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=54 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:31.836219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9d945-674e-41a9-b820-9370f11f4599 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:31.837230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9d945-674e-41a9-b820-9370f11f4599 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:31.837690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9d945-674e-41a9-b820-9370f11f4599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:31.882169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-32e9d945-674e-41a9-b820-9370f11f4599 None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:31.885230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-32e9d945-674e-41a9-b820-9370f11f4599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:31.908194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1114/2240] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:12:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:12:31.917674 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27308591-9cee-456a-a2cf-c78c0ca2e481 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:31.939512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27308591-9cee-456a-a2cf-c78c0ca2e481 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:31.957830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ef2ab-62de-41ea-81e2-c699923862f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:31.958826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ef2ab-62de-41ea-81e2-c699923862f6 service swift] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:31.959264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ef2ab-62de-41ea-81e2-c699923862f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:31.960909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ef2ab-62de-41ea-81e2-c699923862f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:31.980684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ef2ab-62de-41ea-81e2-c699923862f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:31.985385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ef2ab-62de-41ea-81e2-c699923862f6 service swift] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:32.009929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1127/2241] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:12:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 17:12:41.870783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:42.000424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:51.262436 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be07576-c672-4cad-8521-2f1c78f1fcfb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:51.262899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be07576-c672-4cad-8521-2f1c78f1fcfb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:51.262992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be07576-c672-4cad-8521-2f1c78f1fcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:51.281186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-1be07576-c672-4cad-8521-2f1c78f1fcfb None None] MFA Rules not processed for user `ed81799983c143eaa48a6a184c0eaf21`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:51.282384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1be07576-c672-4cad-8521-2f1c78f1fcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:51.335652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1115/2242] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:12:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:55.521549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ef2ab-62de-41ea-81e2-c699923862f6 service swift] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:55.523078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-384ef2ab-62de-41ea-81e2-c699923862f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:55.581244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ef2ab-62de-41ea-81e2-c699923862f6 service swift] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:55.585000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fb3e5-6282-4ac8-89fa-8325b958bf33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:55.585710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fb3e5-6282-4ac8-89fa-8325b958bf33 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:55.586001 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fb3e5-6282-4ac8-89fa-8325b958bf33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:55.586282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fb3e5-6282-4ac8-89fa-8325b958bf33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:55.596524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fb3e5-6282-4ac8-89fa-8325b958bf33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:55.598023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fb3e5-6282-4ac8-89fa-8325b958bf33 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:55.608908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1128/2243] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:12:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:12:56.964501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a77ac-39e3-4328-b786-9e354483affc None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:56.965038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a77ac-39e3-4328-b786-9e354483affc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:56.965163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a77ac-39e3-4328-b786-9e354483affc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:56.998786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-818a77ac-39e3-4328-b786-9e354483affc None None] MFA Rules not processed for user `8903701eab424530ab822b7e9a1a9181`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:57.000255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-818a77ac-39e3-4328-b786-9e354483affc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:57.106684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1116/2244] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:12:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:13:05.604110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=26 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:13:07.098478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=50 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:13:08.395060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ce0d8-bd95-4cec-a821-45b38193d6f9 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:13:08.395525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ce0d8-bd95-4cec-a821-45b38193d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:13:08.395617 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ce0d8-bd95-4cec-a821-45b38193d6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:13:08.414927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0a3ce0d8-bd95-4cec-a821-45b38193d6f9 None None] MFA Rules not processed for user `4ae911b452a04efe98022f47ae9dcbca`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:13:08.417536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0a3ce0d8-bd95-4cec-a821-45b38193d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:13:08.479092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1129/2245] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:13:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:13:18.471177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=25 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:13:33.240664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430544b-9f92-4d7a-b1e7-e9e3157be88f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:13:33.241227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430544b-9f92-4d7a-b1e7-e9e3157be88f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:13:33.241343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430544b-9f92-4d7a-b1e7-e9e3157be88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:13:33.260681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4430544b-9f92-4d7a-b1e7-e9e3157be88f None None] MFA Rules not processed for user `e40620f994a84438be8274acfe3eb547`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:13:33.262702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4430544b-9f92-4d7a-b1e7-e9e3157be88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:13:33.315609 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1117/2246] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:13:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:13:43.309212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=25 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:06.279026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ce0d8-bd95-4cec-a821-45b38193d6f9 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:06.288520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ce0d8-bd95-4cec-a821-45b38193d6f9 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:06.292110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a93b8-d9d0-4769-bade-a81e9e31f1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:06.292745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a93b8-d9d0-4769-bade-a81e9e31f1cd service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:06.293541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a93b8-d9d0-4769-bade-a81e9e31f1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:06.293834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a93b8-d9d0-4769-bade-a81e9e31f1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:06.295593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6a0a93b8-d9d0-4769-bade-a81e9e31f1cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:06.365331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a93b8-d9d0-4769-bade-a81e9e31f1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:06.366784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a93b8-d9d0-4769-bade-a81e9e31f1cd service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:06.378020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1130/2247] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:09.105171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430544b-9f92-4d7a-b1e7-e9e3157be88f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:09.116267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430544b-9f92-4d7a-b1e7-e9e3157be88f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:09.119999 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45970132-b380-4a71-b057-9c584269462a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:09.120770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45970132-b380-4a71-b057-9c584269462a service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:09.121726 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45970132-b380-4a71-b057-9c584269462a service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:09.122084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45970132-b380-4a71-b057-9c584269462a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:09.124086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-45970132-b380-4a71-b057-9c584269462a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:09.192535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45970132-b380-4a71-b057-9c584269462a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:09.193900 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45970132-b380-4a71-b057-9c584269462a service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:09.204941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1118/2248] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:10.967793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d6522-196f-4527-b0eb-513839acb3d4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:10.968251 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d6522-196f-4527-b0eb-513839acb3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:10.968513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d6522-196f-4527-b0eb-513839acb3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:10.987880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-387d6522-196f-4527-b0eb-513839acb3d4 None None] MFA Rules not processed for user `ed81799983c143eaa48a6a184c0eaf21`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:10.989383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-387d6522-196f-4527-b0eb-513839acb3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:10.997307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1131/2249] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:11.408293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45970132-b380-4a71-b057-9c584269462a service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:11.417049 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45970132-b380-4a71-b057-9c584269462a service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:11.421598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8ce9e-136c-4322-8252-b1e9f2609d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:11.422260 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ce9e-136c-4322-8252-b1e9f2609d85 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:11.422683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ce9e-136c-4322-8252-b1e9f2609d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:11.422995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ce9e-136c-4322-8252-b1e9f2609d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:11.424797 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dda8ce9e-136c-4322-8252-b1e9f2609d85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:11.436228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8ce9e-136c-4322-8252-b1e9f2609d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:11.438261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8ce9e-136c-4322-8252-b1e9f2609d85 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:11.447193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1119/2250] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:11.790018 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d6522-196f-4527-b0eb-513839acb3d4 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:11.791606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-387d6522-196f-4527-b0eb-513839acb3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:11.834276 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8ce9e-136c-4322-8252-b1e9f2609d85 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:11.847054 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8ce9e-136c-4322-8252-b1e9f2609d85 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:11.853970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f640f8-b488-4331-a15a-d6a64eebc0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:11.854864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f640f8-b488-4331-a15a-d6a64eebc0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:11.858481 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f640f8-b488-4331-a15a-d6a64eebc0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:11.858996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f640f8-b488-4331-a15a-d6a64eebc0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:11.861622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-68f640f8-b488-4331-a15a-d6a64eebc0f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:11.879578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f640f8-b488-4331-a15a-d6a64eebc0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:11.881581 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f640f8-b488-4331-a15a-d6a64eebc0f9 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:11.889765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d6522-196f-4527-b0eb-513839acb3d4 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:11.896140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbe5e0-805b-4382-8eda-92c5e78dc9d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81fb8b261e2142fcbf8d23bd010bf715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:11.896998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbe5e0-805b-4382-8eda-92c5e78dc9d0 service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:11.897586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbe5e0-805b-4382-8eda-92c5e78dc9d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:11.897966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbe5e0-805b-4382-8eda-92c5e78dc9d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:11.900317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f1fbe5e0-805b-4382-8eda-92c5e78dc9d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:11.901134 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1120/2251] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:11.918944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbe5e0-805b-4382-8eda-92c5e78dc9d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:11.921848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbe5e0-805b-4382-8eda-92c5e78dc9d0 service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:11.935805 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1132/2252] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:13.126746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f640f8-b488-4331-a15a-d6a64eebc0f9 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:13.128450 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-68f640f8-b488-4331-a15a-d6a64eebc0f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:13.146011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f640f8-b488-4331-a15a-d6a64eebc0f9 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:13.150591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86b66f-27bb-4db3-9792-cdfabf997534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:13.151467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86b66f-27bb-4db3-9792-cdfabf997534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:13.151755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86b66f-27bb-4db3-9792-cdfabf997534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:13.152034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86b66f-27bb-4db3-9792-cdfabf997534 admin admin] PATH_INFO: `/v3/users/8903701eab424530ab822b7e9a1a9181` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:13.153877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86b66f-27bb-4db3-9792-cdfabf997534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8903701eab424530ab822b7e9a1a9181)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:13.155970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86b66f-27bb-4db3-9792-cdfabf997534 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:13.207479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1d86b66f-27bb-4db3-9792-cdfabf997534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8903701eab424530ab822b7e9a1a9181'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:13.223858 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1d86b66f-27bb-4db3-9792-cdfabf997534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8903701eab424530ab822b7e9a1a9181'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:13.224584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1d86b66f-27bb-4db3-9792-cdfabf997534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8903701eab424530ab822b7e9a1a9181'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:13.233499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1d86b66f-27bb-4db3-9792-cdfabf997534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8903701eab424530ab822b7e9a1a9181'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:13.234055 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1d86b66f-27bb-4db3-9792-cdfabf997534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8903701eab424530ab822b7e9a1a9181'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:13.247424 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1121/2253] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:14:13 2022] DELETE /identity/v3/users/8903701eab424530ab822b7e9a1a9181 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:13.559185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbe5e0-805b-4382-8eda-92c5e78dc9d0 service placement] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:13.570193 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbe5e0-805b-4382-8eda-92c5e78dc9d0 service placement] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:13.636444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33313940-1f1e-4ac9-b53c-7459ea4f97ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:13.637415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33313940-1f1e-4ac9-b53c-7459ea4f97ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:13.637697 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33313940-1f1e-4ac9-b53c-7459ea4f97ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:13.637974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33313940-1f1e-4ac9-b53c-7459ea4f97ae admin admin] PATH_INFO: `/v3/projects/73e83b8e77634afe9b24094b9c06fe85` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:13.639204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33313940-1f1e-4ac9-b53c-7459ea4f97ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e83b8e77634afe9b24094b9c06fe85)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:13.641139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33313940-1f1e-4ac9-b53c-7459ea4f97ae admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:13.655212 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:13.699573 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-33313940-1f1e-4ac9-b53c-7459ea4f97ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e83b8e77634afe9b24094b9c06fe85', 'request_id': 'req-33313940-1f1e-4ac9-b53c-7459ea4f97ae'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:13.710017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-33313940-1f1e-4ac9-b53c-7459ea4f97ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e83b8e77634afe9b24094b9c06fe85', 'request_id': 'req-33313940-1f1e-4ac9-b53c-7459ea4f97ae'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:13.717921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-33313940-1f1e-4ac9-b53c-7459ea4f97ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e83b8e77634afe9b24094b9c06fe85', 'request_id': 'req-33313940-1f1e-4ac9-b53c-7459ea4f97ae'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:13.732641 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-33313940-1f1e-4ac9-b53c-7459ea4f97ae admin admin] The token cache is being invalidate because project 73e83b8e77634afe9b24094b9c06fe85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:14:13.733082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-33313940-1f1e-4ac9-b53c-7459ea4f97ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:13.733851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-33313940-1f1e-4ac9-b53c-7459ea4f97ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:13.735562 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1133/2254] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:14:13 2022] DELETE /identity/v3/projects/73e83b8e77634afe9b24094b9c06fe85 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:13.740529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039d97-90a9-4ce2-a460-73fe200df7e3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:13.740878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039d97-90a9-4ce2-a460-73fe200df7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:13.741156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039d97-90a9-4ce2-a460-73fe200df7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:13.791404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-26039d97-90a9-4ce2-a460-73fe200df7e3 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:13.793228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-26039d97-90a9-4ce2-a460-73fe200df7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:13.843237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:13.878776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1122/2255] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:13.888143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe0a4-217e-4482-aa4d-44be33bfd0d2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:13.888143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe0a4-217e-4482-aa4d-44be33bfd0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:13.888426 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe0a4-217e-4482-aa4d-44be33bfd0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:13.911268 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-decfe0a4-217e-4482-aa4d-44be33bfd0d2 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:13.912736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-decfe0a4-217e-4482-aa4d-44be33bfd0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:13.922693 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1134/2256] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:13.926872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039d97-90a9-4ce2-a460-73fe200df7e3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:13.938059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039d97-90a9-4ce2-a460-73fe200df7e3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:13.942931 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8223f21-8452-4ffd-8268-508de816e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:13.943591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8223f21-8452-4ffd-8268-508de816e50d admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:13.944065 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8223f21-8452-4ffd-8268-508de816e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:13.944613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8223f21-8452-4ffd-8268-508de816e50d admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:13.945502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8223f21-8452-4ffd-8268-508de816e50d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:14:13.945817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8223f21-8452-4ffd-8268-508de816e50d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:13.947447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8223f21-8452-4ffd-8268-508de816e50d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:13.963502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1123/2257] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:14:13.965612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfe0a4-217e-4482-aa4d-44be33bfd0d2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:13.975399 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfe0a4-217e-4482-aa4d-44be33bfd0d2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:13.981112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d456a4-f092-443c-a0c5-186f4b0568b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:13.981921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d456a4-f092-443c-a0c5-186f4b0568b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:13.982302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d456a4-f092-443c-a0c5-186f4b0568b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:13.982730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d456a4-f092-443c-a0c5-186f4b0568b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:13.983541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d456a4-f092-443c-a0c5-186f4b0568b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:13.985518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d456a4-f092-443c-a0c5-186f4b0568b5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:14.015608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1135/2258] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:14:13 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:14:14.019601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8223f21-8452-4ffd-8268-508de816e50d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:14.029717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8223f21-8452-4ffd-8268-508de816e50d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:14.096735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85278ee3-4522-4a30-b024-728ec393603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:14.097429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85278ee3-4522-4a30-b024-728ec393603e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:14.097713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85278ee3-4522-4a30-b024-728ec393603e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:14.097988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85278ee3-4522-4a30-b024-728ec393603e admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:14.098979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85278ee3-4522-4a30-b024-728ec393603e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:14.101198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85278ee3-4522-4a30-b024-728ec393603e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:14.130414 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1124/2259] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:14:14 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:14:14.132220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d456a4-f092-443c-a0c5-186f4b0568b5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:14.143683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d456a4-f092-443c-a0c5-186f4b0568b5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:14.154564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e9f3-d12f-4506-9719-4c9d6e6c24fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:14.156315 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e9f3-d12f-4506-9719-4c9d6e6c24fe admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:14.156616 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e9f3-d12f-4506-9719-4c9d6e6c24fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:14.156900 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3e9f3-d12f-4506-9719-4c9d6e6c24fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:14.157756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3e9f3-d12f-4506-9719-4c9d6e6c24fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:14.159729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3e9f3-d12f-4506-9719-4c9d6e6c24fe admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:14.176490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1136/2260] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:14:14.180916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85278ee3-4522-4a30-b024-728ec393603e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:14.193544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85278ee3-4522-4a30-b024-728ec393603e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:14.200328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e216f6-4c7e-428d-8429-07c13f92dec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:14.201495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e216f6-4c7e-428d-8429-07c13f92dec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:14.202206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e216f6-4c7e-428d-8429-07c13f92dec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:14.202776 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e216f6-4c7e-428d-8429-07c13f92dec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:14.204160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e216f6-4c7e-428d-8429-07c13f92dec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:14.206223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e216f6-4c7e-428d-8429-07c13f92dec8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:14.218965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1125/2261] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:14:14.223362 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e9f3-d12f-4506-9719-4c9d6e6c24fe admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:14.238935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3e9f3-d12f-4506-9719-4c9d6e6c24fe admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:14.245048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2664a5a-0c96-46f3-997d-4239c2819b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:14.246830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2664a5a-0c96-46f3-997d-4239c2819b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:14.247342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2664a5a-0c96-46f3-997d-4239c2819b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:14.248079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2664a5a-0c96-46f3-997d-4239c2819b73 admin admin] PATH_INFO: `/v3/projects/8ff20882d93a4a46b32baef9cd45d671/users/881a9ffbdfaf45ee8c5a206811125e9c/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:14.268435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2664a5a-0c96-46f3-997d-4239c2819b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff20882d93a4a46b32baef9cd45d671, user_id=881a9ffbdfaf45ee8c5a206811125e9c, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:14.271956 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2664a5a-0c96-46f3-997d-4239c2819b73 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:14.294304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1137/2262] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:14:14 2022] PUT /identity/v3/projects/8ff20882d93a4a46b32baef9cd45d671/users/881a9ffbdfaf45ee8c5a206811125e9c/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:14.313678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ebd77-ea19-48c5-876a-85650229c770 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:14.313975 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ebd77-ea19-48c5-876a-85650229c770 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:14.314337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ebd77-ea19-48c5-876a-85650229c770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:14.344520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-bf0ebd77-ea19-48c5-876a-85650229c770 None None] MFA Rules not processed for user `881a9ffbdfaf45ee8c5a206811125e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:14.345751 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bf0ebd77-ea19-48c5-876a-85650229c770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:14.418458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1126/2263] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:14.430547 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2664a5a-0c96-46f3-997d-4239c2819b73 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:14.433025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b2664a5a-0c96-46f3-997d-4239c2819b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:14.517475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2664a5a-0c96-46f3-997d-4239c2819b73 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:14.523317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd5206-00b3-466c-86f0-1f19dc68acca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:14.523989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd5206-00b3-466c-86f0-1f19dc68acca service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:14.524276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd5206-00b3-466c-86f0-1f19dc68acca service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:14.524558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd5206-00b3-466c-86f0-1f19dc68acca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:14.535797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd5206-00b3-466c-86f0-1f19dc68acca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:14.537320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd5206-00b3-466c-86f0-1f19dc68acca service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:14.548053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1138/2264] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:19.891892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ebd77-ea19-48c5-876a-85650229c770 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:19.929632 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:19.955514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ebd77-ea19-48c5-876a-85650229c770 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:19.959962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:19.960826 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:19.961109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:19.961381 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] PATH_INFO: `/v3/users/881a9ffbdfaf45ee8c5a206811125e9c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:19.962577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=881a9ffbdfaf45ee8c5a206811125e9c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:19.964701 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:20.013593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881a9ffbdfaf45ee8c5a206811125e9c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:20.025665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881a9ffbdfaf45ee8c5a206811125e9c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:20.026476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881a9ffbdfaf45ee8c5a206811125e9c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:20.034876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881a9ffbdfaf45ee8c5a206811125e9c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:20.035499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881a9ffbdfaf45ee8c5a206811125e9c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:20.048111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1127/2265] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:14:19 2022] DELETE /identity/v3/users/881a9ffbdfaf45ee8c5a206811125e9c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:14:20.052544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff46fc9-06b6-47a5-8293-65a04b1deb69 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:20.053034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff46fc9-06b6-47a5-8293-65a04b1deb69 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:20.053129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff46fc9-06b6-47a5-8293-65a04b1deb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:20.070985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6ff46fc9-06b6-47a5-8293-65a04b1deb69 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:20.072186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6ff46fc9-06b6-47a5-8293-65a04b1deb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:20.085807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:20.136309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1139/2266] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:20.145982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:20.147498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:20.204791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ddf7e-2a7f-4ceb-860f-c029df0c02d6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:20.208428 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c6e39-5a0c-4282-8578-5773cb5cff5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:20.209000 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c6e39-5a0c-4282-8578-5773cb5cff5e service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:20.209283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c6e39-5a0c-4282-8578-5773cb5cff5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:20.209564 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c6e39-5a0c-4282-8578-5773cb5cff5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:20.219437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c6e39-5a0c-4282-8578-5773cb5cff5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:20.220850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c6e39-5a0c-4282-8578-5773cb5cff5e service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:20.230887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1128/2267] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:20.494849 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff46fc9-06b6-47a5-8293-65a04b1deb69 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:20.496596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6ff46fc9-06b6-47a5-8293-65a04b1deb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:20.509245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff46fc9-06b6-47a5-8293-65a04b1deb69 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:20.514779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14facde0-89ee-4308-88ef-c6166b28d256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:20.515739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14facde0-89ee-4308-88ef-c6166b28d256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:20.516036 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14facde0-89ee-4308-88ef-c6166b28d256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:20.516303 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14facde0-89ee-4308-88ef-c6166b28d256 admin admin] PATH_INFO: `/v3/projects/8ff20882d93a4a46b32baef9cd45d671` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:20.517653 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14facde0-89ee-4308-88ef-c6166b28d256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff20882d93a4a46b32baef9cd45d671)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:20.519638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14facde0-89ee-4308-88ef-c6166b28d256 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:20.567478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-14facde0-89ee-4308-88ef-c6166b28d256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff20882d93a4a46b32baef9cd45d671', 'request_id': 'req-14facde0-89ee-4308-88ef-c6166b28d256'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:20.574923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-14facde0-89ee-4308-88ef-c6166b28d256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff20882d93a4a46b32baef9cd45d671', 'request_id': 'req-14facde0-89ee-4308-88ef-c6166b28d256'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:20.581484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-14facde0-89ee-4308-88ef-c6166b28d256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff20882d93a4a46b32baef9cd45d671', 'request_id': 'req-14facde0-89ee-4308-88ef-c6166b28d256'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:20.592053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-14facde0-89ee-4308-88ef-c6166b28d256 admin admin] The token cache is being invalidate because project 8ff20882d93a4a46b32baef9cd45d671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:14:20.592342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-14facde0-89ee-4308-88ef-c6166b28d256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:20.592972 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-14facde0-89ee-4308-88ef-c6166b28d256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:20.594826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1140/2268] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:14:20 2022] DELETE /identity/v3/projects/8ff20882d93a4a46b32baef9cd45d671 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:20.599953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ea8a1-9bae-4c86-8015-d80f6b401e02 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:20.600253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ea8a1-9bae-4c86-8015-d80f6b401e02 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:20.600539 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ea8a1-9bae-4c86-8015-d80f6b401e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:20.618674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8f7ea8a1-9bae-4c86-8015-d80f6b401e02 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:20.619874 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8f7ea8a1-9bae-4c86-8015-d80f6b401e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:20.670329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:20.680591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1129/2269] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:20.690298 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2826253-03e5-4956-8dd7-7aa583fad365 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:20.690617 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2826253-03e5-4956-8dd7-7aa583fad365 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:20.690899 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2826253-03e5-4956-8dd7-7aa583fad365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:20.710117 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b2826253-03e5-4956-8dd7-7aa583fad365 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:20.711335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b2826253-03e5-4956-8dd7-7aa583fad365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:20.719304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1141/2270] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:20.723308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ea8a1-9bae-4c86-8015-d80f6b401e02 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:20.733582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ea8a1-9bae-4c86-8015-d80f6b401e02 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:20.738256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c1cea-b368-4e17-b539-6c0b32d66fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:20.738873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1cea-b368-4e17-b539-6c0b32d66fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:20.739161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1cea-b368-4e17-b539-6c0b32d66fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:20.739440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1cea-b368-4e17-b539-6c0b32d66fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:20.740197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c1cea-b368-4e17-b539-6c0b32d66fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:14:20.740503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c1cea-b368-4e17-b539-6c0b32d66fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:20.742089 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c1cea-b368-4e17-b539-6c0b32d66fcf admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:20.754247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1130/2271] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:14:20.758416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2826253-03e5-4956-8dd7-7aa583fad365 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:20.767895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2826253-03e5-4956-8dd7-7aa583fad365 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:20.773250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e877be9-74ca-46ca-8fb1-a22a1ef461a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:20.773937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e877be9-74ca-46ca-8fb1-a22a1ef461a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:20.774231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e877be9-74ca-46ca-8fb1-a22a1ef461a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:20.774545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e877be9-74ca-46ca-8fb1-a22a1ef461a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:20.775366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e877be9-74ca-46ca-8fb1-a22a1ef461a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:20.777811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e877be9-74ca-46ca-8fb1-a22a1ef461a2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:20.807122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1142/2272] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:14:20 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:14:20.809137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c1cea-b368-4e17-b539-6c0b32d66fcf admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:20.819480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c1cea-b368-4e17-b539-6c0b32d66fcf admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:20.881464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e3474-97be-454a-8bc5-b33442a5e5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:20.882220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e3474-97be-454a-8bc5-b33442a5e5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:20.882622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e3474-97be-454a-8bc5-b33442a5e5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:20.882964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e3474-97be-454a-8bc5-b33442a5e5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:20.883726 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e3474-97be-454a-8bc5-b33442a5e5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:20.885705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e3474-97be-454a-8bc5-b33442a5e5f0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:20.912883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1131/2273] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:14:20 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:14:20.916667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e877be9-74ca-46ca-8fb1-a22a1ef461a2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:20.927746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e877be9-74ca-46ca-8fb1-a22a1ef461a2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:20.933060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f8f5b-5cc5-4fbb-870e-5ff28b572301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:20.933850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8f5b-5cc5-4fbb-870e-5ff28b572301 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:20.934391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8f5b-5cc5-4fbb-870e-5ff28b572301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:20.935440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8f5b-5cc5-4fbb-870e-5ff28b572301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:20.935440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f8f5b-5cc5-4fbb-870e-5ff28b572301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:20.937069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f8f5b-5cc5-4fbb-870e-5ff28b572301 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:20.948327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1143/2274] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:14:20.952245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e3474-97be-454a-8bc5-b33442a5e5f0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:20.962660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e3474-97be-454a-8bc5-b33442a5e5f0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:20.968518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c472b-895f-4921-a72d-55527c212a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:20.969519 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c472b-895f-4921-a72d-55527c212a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:20.969670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c472b-895f-4921-a72d-55527c212a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:20.970254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c472b-895f-4921-a72d-55527c212a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:20.971263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c472b-895f-4921-a72d-55527c212a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:20.972659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c472b-895f-4921-a72d-55527c212a2b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:20.987793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1132/2275] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:14:20.988776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f8f5b-5cc5-4fbb-870e-5ff28b572301 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:21.001292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f8f5b-5cc5-4fbb-870e-5ff28b572301 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:21.006859 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67d570-bd13-43c6-9a7b-46b7e22e46e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:21.007772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67d570-bd13-43c6-9a7b-46b7e22e46e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:21.008114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67d570-bd13-43c6-9a7b-46b7e22e46e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:21.008401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67d570-bd13-43c6-9a7b-46b7e22e46e7 admin admin] PATH_INFO: `/v3/projects/793dbb841306412085b15fcf58374cdd/users/f9dd557a38e34f6780e8705271dc3423/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:21.026025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67d570-bd13-43c6-9a7b-46b7e22e46e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793dbb841306412085b15fcf58374cdd, user_id=f9dd557a38e34f6780e8705271dc3423, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:21.029385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67d570-bd13-43c6-9a7b-46b7e22e46e7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:21.046654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1144/2276] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:14:20 2022] PUT /identity/v3/projects/793dbb841306412085b15fcf58374cdd/users/f9dd557a38e34f6780e8705271dc3423/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:14:21.061958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4562d9f-73a2-4e13-a142-09ce68095105 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:21.062254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4562d9f-73a2-4e13-a142-09ce68095105 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:21.062567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4562d9f-73a2-4e13-a142-09ce68095105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:21.091083 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a4562d9f-73a2-4e13-a142-09ce68095105 None None] MFA Rules not processed for user `f9dd557a38e34f6780e8705271dc3423`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:21.092321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a4562d9f-73a2-4e13-a142-09ce68095105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:21.164748 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1133/2277] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:21.181211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67d570-bd13-43c6-9a7b-46b7e22e46e7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:21.182981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8b67d570-bd13-43c6-9a7b-46b7e22e46e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:21.229641 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:21.251731 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67d570-bd13-43c6-9a7b-46b7e22e46e7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:21.256289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b91d6-5050-48b7-b854-bb92554c24e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:21.257142 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b91d6-5050-48b7-b854-bb92554c24e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:21.257600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b91d6-5050-48b7-b854-bb92554c24e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:21.258176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b91d6-5050-48b7-b854-bb92554c24e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:21.268165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b91d6-5050-48b7-b854-bb92554c24e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:21.269544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b91d6-5050-48b7-b854-bb92554c24e1 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:21.279169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1145/2278] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:26.858186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4562d9f-73a2-4e13-a142-09ce68095105 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:26.859652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a4562d9f-73a2-4e13-a142-09ce68095105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:26.911061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:26.932680 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4562d9f-73a2-4e13-a142-09ce68095105 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:26.938642 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7ba30-9385-42f1-b284-be89fb3e4bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:26.939285 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7ba30-9385-42f1-b284-be89fb3e4bd0 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:26.939571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7ba30-9385-42f1-b284-be89fb3e4bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:26.939846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7ba30-9385-42f1-b284-be89fb3e4bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:26.941592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5af7ba30-9385-42f1-b284-be89fb3e4bd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:26.998983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7ba30-9385-42f1-b284-be89fb3e4bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:27.000551 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7ba30-9385-42f1-b284-be89fb3e4bd0 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:27.009521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1134/2279] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:29.326559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b91d6-5050-48b7-b854-bb92554c24e1 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:29.339560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b91d6-5050-48b7-b854-bb92554c24e1 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:29.345638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96e994-91c7-4420-b841-c458cee471fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:29.346355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e994-91c7-4420-b841-c458cee471fb service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:29.346670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e994-91c7-4420-b841-c458cee471fb service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:29.346947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e994-91c7-4420-b841-c458cee471fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:29.348831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ac96e994-91c7-4420-b841-c458cee471fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:29.409867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96e994-91c7-4420-b841-c458cee471fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:29.411481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96e994-91c7-4420-b841-c458cee471fb service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:29.421092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1146/2280] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:29.625109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7ba30-9385-42f1-b284-be89fb3e4bd0 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:29.694613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7ba30-9385-42f1-b284-be89fb3e4bd0 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:29.699184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:29.700319 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:29.700761 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:29.701046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] PATH_INFO: `/v3/users/f9dd557a38e34f6780e8705271dc3423` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:29.702244 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9dd557a38e34f6780e8705271dc3423)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:29.704180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:29.761764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9dd557a38e34f6780e8705271dc3423'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:29.782664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9dd557a38e34f6780e8705271dc3423'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:29.784251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9dd557a38e34f6780e8705271dc3423'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:29.792026 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9dd557a38e34f6780e8705271dc3423'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:29.792678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9dd557a38e34f6780e8705271dc3423'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:29.806681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1135/2281] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:14:29 2022] DELETE /identity/v3/users/f9dd557a38e34f6780e8705271dc3423 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:29.811479 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aee842-26cc-421e-869b-8dfb23404763 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:29.811777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aee842-26cc-421e-869b-8dfb23404763 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:29.812060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aee842-26cc-421e-869b-8dfb23404763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:29.830247 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-37aee842-26cc-421e-869b-8dfb23404763 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:29.831632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-37aee842-26cc-421e-869b-8dfb23404763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:29.890606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1147/2282] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:29.900177 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:29.901559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:29.913192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:29.961022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1eacf-27c4-4499-9e3a-e2a9f76f4075 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:29.964652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f87af-9838-4ce0-aa1c-3b29beaf7c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:29.965856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f87af-9838-4ce0-aa1c-3b29beaf7c53 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:29.966197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f87af-9838-4ce0-aa1c-3b29beaf7c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:29.966536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f87af-9838-4ce0-aa1c-3b29beaf7c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:29.975437 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f87af-9838-4ce0-aa1c-3b29beaf7c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:29.976857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f87af-9838-4ce0-aa1c-3b29beaf7c53 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:29.987007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1136/2283] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:30.250313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aee842-26cc-421e-869b-8dfb23404763 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:30.251836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-37aee842-26cc-421e-869b-8dfb23404763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:30.264203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aee842-26cc-421e-869b-8dfb23404763 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:30.268875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90093abe-f9e1-4122-b455-fc6d1898d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:30.269799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90093abe-f9e1-4122-b455-fc6d1898d49a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:30.270021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90093abe-f9e1-4122-b455-fc6d1898d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:30.270308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90093abe-f9e1-4122-b455-fc6d1898d49a admin admin] PATH_INFO: `/v3/projects/793dbb841306412085b15fcf58374cdd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:30.271583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90093abe-f9e1-4122-b455-fc6d1898d49a admin admin] RBAC: Authorizing `identity:delete_project(project_id=793dbb841306412085b15fcf58374cdd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:30.273566 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90093abe-f9e1-4122-b455-fc6d1898d49a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:30.322631 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-90093abe-f9e1-4122-b455-fc6d1898d49a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793dbb841306412085b15fcf58374cdd', 'request_id': 'req-90093abe-f9e1-4122-b455-fc6d1898d49a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:30.330377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-90093abe-f9e1-4122-b455-fc6d1898d49a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793dbb841306412085b15fcf58374cdd', 'request_id': 'req-90093abe-f9e1-4122-b455-fc6d1898d49a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:30.336600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-90093abe-f9e1-4122-b455-fc6d1898d49a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793dbb841306412085b15fcf58374cdd', 'request_id': 'req-90093abe-f9e1-4122-b455-fc6d1898d49a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:30.347566 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-90093abe-f9e1-4122-b455-fc6d1898d49a admin admin] The token cache is being invalidate because project 793dbb841306412085b15fcf58374cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:14:30.347865 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-90093abe-f9e1-4122-b455-fc6d1898d49a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:30.348505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-90093abe-f9e1-4122-b455-fc6d1898d49a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:30.350155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1148/2284] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:14:30 2022] DELETE /identity/v3/projects/793dbb841306412085b15fcf58374cdd => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:30.355074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8630110-1f09-4c82-a362-0ccd954e2925 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:30.355373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8630110-1f09-4c82-a362-0ccd954e2925 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:30.355660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8630110-1f09-4c82-a362-0ccd954e2925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:30.373610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b8630110-1f09-4c82-a362-0ccd954e2925 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:30.374846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b8630110-1f09-4c82-a362-0ccd954e2925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:30.437520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1137/2285] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:30.445150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b6a40-a180-4a4d-8185-bbeaa59d8c61 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:30.445443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b6a40-a180-4a4d-8185-bbeaa59d8c61 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:30.445722 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b6a40-a180-4a4d-8185-bbeaa59d8c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:30.453831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:30.466065 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e28b6a40-a180-4a4d-8185-bbeaa59d8c61 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:30.467304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e28b6a40-a180-4a4d-8185-bbeaa59d8c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:30.475205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1149/2286] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:30.479317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8630110-1f09-4c82-a362-0ccd954e2925 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:30.489024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8630110-1f09-4c82-a362-0ccd954e2925 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:30.493567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199ec58-bfd0-4236-9018-88ba15568d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:30.494211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199ec58-bfd0-4236-9018-88ba15568d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:30.494552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199ec58-bfd0-4236-9018-88ba15568d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:30.494829 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199ec58-bfd0-4236-9018-88ba15568d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:30.495578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199ec58-bfd0-4236-9018-88ba15568d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:14:30.495887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199ec58-bfd0-4236-9018-88ba15568d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:30.498019 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199ec58-bfd0-4236-9018-88ba15568d90 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:30.509249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1138/2287] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:14:30.514259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b6a40-a180-4a4d-8185-bbeaa59d8c61 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:30.523427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b6a40-a180-4a4d-8185-bbeaa59d8c61 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:30.528073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80ab28-643f-49d3-95a9-0621de0cca57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:30.528729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80ab28-643f-49d3-95a9-0621de0cca57 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:30.529015 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80ab28-643f-49d3-95a9-0621de0cca57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:30.529292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80ab28-643f-49d3-95a9-0621de0cca57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:30.529985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80ab28-643f-49d3-95a9-0621de0cca57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:30.531906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80ab28-643f-49d3-95a9-0621de0cca57 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:30.558278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1150/2288] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:14:30 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:14:30.563170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199ec58-bfd0-4236-9018-88ba15568d90 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:30.573406 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199ec58-bfd0-4236-9018-88ba15568d90 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:30.632737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096e174-9c2b-4a0e-9265-9cbaa89f62b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:30.633410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096e174-9c2b-4a0e-9265-9cbaa89f62b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:30.633697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096e174-9c2b-4a0e-9265-9cbaa89f62b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:30.633976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096e174-9c2b-4a0e-9265-9cbaa89f62b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:30.634705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096e174-9c2b-4a0e-9265-9cbaa89f62b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:30.636619 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096e174-9c2b-4a0e-9265-9cbaa89f62b0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:30.661885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1139/2289] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:14:30 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:14:30.663128 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80ab28-643f-49d3-95a9-0621de0cca57 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:30.673686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80ab28-643f-49d3-95a9-0621de0cca57 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:30.678508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71fb5f-04e8-4d4e-8cf6-56fd7c0ad85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:30.679171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71fb5f-04e8-4d4e-8cf6-56fd7c0ad85e admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:30.679453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71fb5f-04e8-4d4e-8cf6-56fd7c0ad85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:30.679725 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71fb5f-04e8-4d4e-8cf6-56fd7c0ad85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:30.680446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71fb5f-04e8-4d4e-8cf6-56fd7c0ad85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:30.682004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71fb5f-04e8-4d4e-8cf6-56fd7c0ad85e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:30.693736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1151/2290] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:14:30.697575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096e174-9c2b-4a0e-9265-9cbaa89f62b0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:30.708216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096e174-9c2b-4a0e-9265-9cbaa89f62b0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:30.712989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0321ff-f6f7-4162-b59f-2efb73f2d6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:30.713683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0321ff-f6f7-4162-b59f-2efb73f2d6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:30.713975 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0321ff-f6f7-4162-b59f-2efb73f2d6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:30.714261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0321ff-f6f7-4162-b59f-2efb73f2d6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:30.715040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0321ff-f6f7-4162-b59f-2efb73f2d6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:30.717199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0321ff-f6f7-4162-b59f-2efb73f2d6e5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:30.727154 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1140/2291] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:14:30.731814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71fb5f-04e8-4d4e-8cf6-56fd7c0ad85e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:30.741894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71fb5f-04e8-4d4e-8cf6-56fd7c0ad85e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:30.746549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a035bec-0b9e-4e64-893d-dfd458ecfaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:30.747529 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a035bec-0b9e-4e64-893d-dfd458ecfaef admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:30.747810 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a035bec-0b9e-4e64-893d-dfd458ecfaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:30.748086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a035bec-0b9e-4e64-893d-dfd458ecfaef admin admin] PATH_INFO: `/v3/projects/2cca9f4cf3974243a46233fa9ef17dcb/users/fe7e5dae7b5b4096b16817b525ae0572/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:30.763945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a035bec-0b9e-4e64-893d-dfd458ecfaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cca9f4cf3974243a46233fa9ef17dcb, user_id=fe7e5dae7b5b4096b16817b525ae0572, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:30.766586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a035bec-0b9e-4e64-893d-dfd458ecfaef admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:30.781682 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1152/2292] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:14:30 2022] PUT /identity/v3/projects/2cca9f4cf3974243a46233fa9ef17dcb/users/fe7e5dae7b5b4096b16817b525ae0572/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:30.792645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5848e34-b984-4c7f-98b7-dbc2dc08ec53 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:30.792941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5848e34-b984-4c7f-98b7-dbc2dc08ec53 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:30.793274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5848e34-b984-4c7f-98b7-dbc2dc08ec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:30.827968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a5848e34-b984-4c7f-98b7-dbc2dc08ec53 None None] MFA Rules not processed for user `fe7e5dae7b5b4096b16817b525ae0572`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:30.831510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a5848e34-b984-4c7f-98b7-dbc2dc08ec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:30.837795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:30.909311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1141/2293] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:30.921947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a035bec-0b9e-4e64-893d-dfd458ecfaef admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:30.923767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5a035bec-0b9e-4e64-893d-dfd458ecfaef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:31.011784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a035bec-0b9e-4e64-893d-dfd458ecfaef admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:31.019599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa414871-7eff-44c0-af46-1b77f33291d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:31.020273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa414871-7eff-44c0-af46-1b77f33291d0 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:31.020566 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa414871-7eff-44c0-af46-1b77f33291d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:31.020838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa414871-7eff-44c0-af46-1b77f33291d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:31.031157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa414871-7eff-44c0-af46-1b77f33291d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:31.032810 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa414871-7eff-44c0-af46-1b77f33291d0 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:31.043980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1153/2294] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:31.273530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5848e34-b984-4c7f-98b7-dbc2dc08ec53 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:31.339410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5848e34-b984-4c7f-98b7-dbc2dc08ec53 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:31.344401 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:31.345327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:31.345610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:31.345888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] PATH_INFO: `/v3/users/fe7e5dae7b5b4096b16817b525ae0572` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:31.347113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7e5dae7b5b4096b16817b525ae0572)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:31.349038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:31.398043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7e5dae7b5b4096b16817b525ae0572'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:31.411058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7e5dae7b5b4096b16817b525ae0572'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:31.411993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7e5dae7b5b4096b16817b525ae0572'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:31.419520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7e5dae7b5b4096b16817b525ae0572'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:31.420179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7e5dae7b5b4096b16817b525ae0572'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:31.433365 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1142/2295] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:14:31 2022] DELETE /identity/v3/users/fe7e5dae7b5b4096b16817b525ae0572 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:31.438687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55400782-265c-442f-8b99-7ee4b8dd5a7c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:31.439169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55400782-265c-442f-8b99-7ee4b8dd5a7c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:31.439277 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55400782-265c-442f-8b99-7ee4b8dd5a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:31.457713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-55400782-265c-442f-8b99-7ee4b8dd5a7c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:31.458997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-55400782-265c-442f-8b99-7ee4b8dd5a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:31.519722 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1154/2296] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:31.529515 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:31.530945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:31.562484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:31.589730 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610dbd4-cec3-437d-b5d6-ca997991940f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:31.593554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbee07-5acd-4845-b2f2-eb3a79526cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:31.594196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbee07-5acd-4845-b2f2-eb3a79526cdd service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:31.594534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbee07-5acd-4845-b2f2-eb3a79526cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:31.594813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbee07-5acd-4845-b2f2-eb3a79526cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:31.603889 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbee07-5acd-4845-b2f2-eb3a79526cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:31.605440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbee07-5acd-4845-b2f2-eb3a79526cdd service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:31.616527 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1143/2297] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:31.895679 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55400782-265c-442f-8b99-7ee4b8dd5a7c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:31.897293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-55400782-265c-442f-8b99-7ee4b8dd5a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:31.910759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55400782-265c-442f-8b99-7ee4b8dd5a7c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:31.916574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbb69d-3537-429f-85ce-df6de3a10c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:31.917564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbb69d-3537-429f-85ce-df6de3a10c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:31.918046 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbb69d-3537-429f-85ce-df6de3a10c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:31.919237 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbb69d-3537-429f-85ce-df6de3a10c8d admin admin] PATH_INFO: `/v3/projects/2cca9f4cf3974243a46233fa9ef17dcb` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:31.920815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbb69d-3537-429f-85ce-df6de3a10c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cca9f4cf3974243a46233fa9ef17dcb)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:31.923158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbb69d-3537-429f-85ce-df6de3a10c8d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:31.948704 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:31.974797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-40fbb69d-3537-429f-85ce-df6de3a10c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cca9f4cf3974243a46233fa9ef17dcb', 'request_id': 'req-40fbb69d-3537-429f-85ce-df6de3a10c8d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:31.982847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-40fbb69d-3537-429f-85ce-df6de3a10c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cca9f4cf3974243a46233fa9ef17dcb', 'request_id': 'req-40fbb69d-3537-429f-85ce-df6de3a10c8d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:31.989180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-40fbb69d-3537-429f-85ce-df6de3a10c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cca9f4cf3974243a46233fa9ef17dcb', 'request_id': 'req-40fbb69d-3537-429f-85ce-df6de3a10c8d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:31.999625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-40fbb69d-3537-429f-85ce-df6de3a10c8d admin admin] The token cache is being invalidate because project 2cca9f4cf3974243a46233fa9ef17dcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:14:31.999918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-40fbb69d-3537-429f-85ce-df6de3a10c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:32.000568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-40fbb69d-3537-429f-85ce-df6de3a10c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:32.002285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1155/2298] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:14:31 2022] DELETE /identity/v3/projects/2cca9f4cf3974243a46233fa9ef17dcb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:32.007574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55a2ac-09df-4dd9-92fc-77c7eb4c5a55 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.008072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55a2ac-09df-4dd9-92fc-77c7eb4c5a55 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.008072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55a2ac-09df-4dd9-92fc-77c7eb4c5a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.026641 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2f55a2ac-09df-4dd9-92fc-77c7eb4c5a55 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:32.028430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2f55a2ac-09df-4dd9-92fc-77c7eb4c5a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:32.086585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1144/2299] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:32.095050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1d37-d887-44bf-bafc-48f717a85e40 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.095351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1d37-d887-44bf-bafc-48f717a85e40 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.095636 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1d37-d887-44bf-bafc-48f717a85e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.114696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-dd0a1d37-d887-44bf-bafc-48f717a85e40 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:32.115904 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-dd0a1d37-d887-44bf-bafc-48f717a85e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:32.123967 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1156/2300] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:32.128176 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55a2ac-09df-4dd9-92fc-77c7eb4c5a55 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:32.137905 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55a2ac-09df-4dd9-92fc-77c7eb4c5a55 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:32.142558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3b74d-2694-40e9-8c48-9c9a951016ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:32.143213 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3b74d-2694-40e9-8c48-9c9a951016ab admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.143503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3b74d-2694-40e9-8c48-9c9a951016ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.143782 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3b74d-2694-40e9-8c48-9c9a951016ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.144512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3b74d-2694-40e9-8c48-9c9a951016ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:14:32.144825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3b74d-2694-40e9-8c48-9c9a951016ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:32.146449 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3b74d-2694-40e9-8c48-9c9a951016ab admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:32.158418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1145/2301] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:14:32.162515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a1d37-d887-44bf-bafc-48f717a85e40 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:32.172655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a1d37-d887-44bf-bafc-48f717a85e40 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:32.177234 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293f563-4ad8-4ffe-979e-2bd8fbcbb1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:32.177902 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293f563-4ad8-4ffe-979e-2bd8fbcbb1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.178185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293f563-4ad8-4ffe-979e-2bd8fbcbb1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.178499 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293f563-4ad8-4ffe-979e-2bd8fbcbb1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.179189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293f563-4ad8-4ffe-979e-2bd8fbcbb1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:32.181053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293f563-4ad8-4ffe-979e-2bd8fbcbb1c5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:32.227805 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1157/2302] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:14:32 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:14:32.229128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3b74d-2694-40e9-8c48-9c9a951016ab admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:32.240762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3b74d-2694-40e9-8c48-9c9a951016ab admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:32.316753 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f5d41-ed6e-44ef-9c73-eeb55ea6a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:32.317521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f5d41-ed6e-44ef-9c73-eeb55ea6a0ad admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.318053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f5d41-ed6e-44ef-9c73-eeb55ea6a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.318570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f5d41-ed6e-44ef-9c73-eeb55ea6a0ad admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.319317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f5d41-ed6e-44ef-9c73-eeb55ea6a0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:32.321453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f5d41-ed6e-44ef-9c73-eeb55ea6a0ad admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:32.345710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1146/2303] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:14:32 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:14:32.346934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293f563-4ad8-4ffe-979e-2bd8fbcbb1c5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:32.358608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293f563-4ad8-4ffe-979e-2bd8fbcbb1c5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:32.364063 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bc57f-c5f0-4733-8e1b-7077194559b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:32.364734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc57f-c5f0-4733-8e1b-7077194559b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.365030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc57f-c5f0-4733-8e1b-7077194559b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.365310 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc57f-c5f0-4733-8e1b-7077194559b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.366048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bc57f-c5f0-4733-8e1b-7077194559b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:32.367682 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bc57f-c5f0-4733-8e1b-7077194559b2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:32.379164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1158/2304] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:14:32.383230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f5d41-ed6e-44ef-9c73-eeb55ea6a0ad admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:32.394705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f5d41-ed6e-44ef-9c73-eeb55ea6a0ad admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:32.400216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b548d-d349-4e8d-8ab5-fed1ebf1be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:32.400910 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b548d-d349-4e8d-8ab5-fed1ebf1be04 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.401312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b548d-d349-4e8d-8ab5-fed1ebf1be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.401659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b548d-d349-4e8d-8ab5-fed1ebf1be04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.402574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b548d-d349-4e8d-8ab5-fed1ebf1be04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:32.404387 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b548d-d349-4e8d-8ab5-fed1ebf1be04 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:32.415537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1147/2305] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:14:32.421891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bc57f-c5f0-4733-8e1b-7077194559b2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:32.432292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bc57f-c5f0-4733-8e1b-7077194559b2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:32.437461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72463318-d33f-4932-ac73-4b0fef20a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:32.438472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72463318-d33f-4932-ac73-4b0fef20a768 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.438825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72463318-d33f-4932-ac73-4b0fef20a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.439351 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72463318-d33f-4932-ac73-4b0fef20a768 admin admin] PATH_INFO: `/v3/projects/d22db35fe4b64640a4d32382751f88c4/users/02a1b1b7381f4d0e9629938031165c4f/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.456266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72463318-d33f-4932-ac73-4b0fef20a768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22db35fe4b64640a4d32382751f88c4, user_id=02a1b1b7381f4d0e9629938031165c4f, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:32.459002 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72463318-d33f-4932-ac73-4b0fef20a768 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:32.475428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1159/2306] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:14:32 2022] PUT /identity/v3/projects/d22db35fe4b64640a4d32382751f88c4/users/02a1b1b7381f4d0e9629938031165c4f/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:32.487361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b762a6-70c9-414c-8e22-ffeb962839d9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.487668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b762a6-70c9-414c-8e22-ffeb962839d9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.487967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b762a6-70c9-414c-8e22-ffeb962839d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.517427 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-72b762a6-70c9-414c-8e22-ffeb962839d9 None None] MFA Rules not processed for user `02a1b1b7381f4d0e9629938031165c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:32.518670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-72b762a6-70c9-414c-8e22-ffeb962839d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:32.542687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:32.585934 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1148/2307] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:32.590901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72463318-d33f-4932-ac73-4b0fef20a768 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:32.651697 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72463318-d33f-4932-ac73-4b0fef20a768 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:32.656995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e8aef-eb8c-4a8d-827c-04c6f39ec1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:32.657648 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e8aef-eb8c-4a8d-827c-04c6f39ec1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.657931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e8aef-eb8c-4a8d-827c-04c6f39ec1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.658231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e8aef-eb8c-4a8d-827c-04c6f39ec1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.658966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e8aef-eb8c-4a8d-827c-04c6f39ec1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:32.660858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e8aef-eb8c-4a8d-827c-04c6f39ec1e5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:32.686174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1160/2308] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:14:32 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:14:32.690217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b762a6-70c9-414c-8e22-ffeb962839d9 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:32.700995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b762a6-70c9-414c-8e22-ffeb962839d9 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:32.757379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b05fb-f6e5-4ed3-bc57-f9829ac9b4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:32.758044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b05fb-f6e5-4ed3-bc57-f9829ac9b4cf admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.758329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b05fb-f6e5-4ed3-bc57-f9829ac9b4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.758637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b05fb-f6e5-4ed3-bc57-f9829ac9b4cf admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.759322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b05fb-f6e5-4ed3-bc57-f9829ac9b4cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:32.761242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b05fb-f6e5-4ed3-bc57-f9829ac9b4cf admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:32.784708 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1149/2309] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:14:32 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:14:32.788657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e8aef-eb8c-4a8d-827c-04c6f39ec1e5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:32.799924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e8aef-eb8c-4a8d-827c-04c6f39ec1e5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:32.804496 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad63b65-7582-4955-94a0-c2678f255430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:32.805148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad63b65-7582-4955-94a0-c2678f255430 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.805434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad63b65-7582-4955-94a0-c2678f255430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.805709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad63b65-7582-4955-94a0-c2678f255430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.806461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad63b65-7582-4955-94a0-c2678f255430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:32.808060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad63b65-7582-4955-94a0-c2678f255430 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:32.818736 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1161/2310] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:14:32.822828 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b05fb-f6e5-4ed3-bc57-f9829ac9b4cf admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:32.833081 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b05fb-f6e5-4ed3-bc57-f9829ac9b4cf admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:32.837852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c253c-b2b2-4d89-bf27-1951d44f0e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:32.838721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c253c-b2b2-4d89-bf27-1951d44f0e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.839003 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c253c-b2b2-4d89-bf27-1951d44f0e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.839275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c253c-b2b2-4d89-bf27-1951d44f0e94 admin admin] PATH_INFO: `/v3/projects/1c393ac592d94e9b84b24c88f494f334/users/40e2fd87421b45478258675dc59156fb/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.855209 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c253c-b2b2-4d89-bf27-1951d44f0e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c393ac592d94e9b84b24c88f494f334, user_id=40e2fd87421b45478258675dc59156fb, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:32.859311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c253c-b2b2-4d89-bf27-1951d44f0e94 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:32.874147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1150/2311] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:14:32 2022] PUT /identity/v3/projects/1c393ac592d94e9b84b24c88f494f334/users/40e2fd87421b45478258675dc59156fb/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:32.877819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad63b65-7582-4955-94a0-c2678f255430 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:32.890444 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad63b65-7582-4955-94a0-c2678f255430 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:32.912044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:32.973323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b30e6-e5b6-4d22-969f-ab27c724730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:32.974031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b30e6-e5b6-4d22-969f-ab27c724730a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:32.974322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b30e6-e5b6-4d22-969f-ab27c724730a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:32.974622 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b30e6-e5b6-4d22-969f-ab27c724730a admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:32.975490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b30e6-e5b6-4d22-969f-ab27c724730a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:32.977333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b30e6-e5b6-4d22-969f-ab27c724730a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:32.999347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1162/2312] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:14:33.003280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c253c-b2b2-4d89-bf27-1951d44f0e94 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:33.017051 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c253c-b2b2-4d89-bf27-1951d44f0e94 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:33.022475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea34f36-f0a7-4c4c-ae3e-3908843da69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:33.023946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea34f36-f0a7-4c4c-ae3e-3908843da69d admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:33.024342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea34f36-f0a7-4c4c-ae3e-3908843da69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:33.024720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea34f36-f0a7-4c4c-ae3e-3908843da69d admin admin] PATH_INFO: `/v3/projects/1c393ac592d94e9b84b24c88f494f334/users/40e2fd87421b45478258675dc59156fb/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:33.027119 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea34f36-f0a7-4c4c-ae3e-3908843da69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c393ac592d94e9b84b24c88f494f334, user_id=40e2fd87421b45478258675dc59156fb, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:33.031532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea34f36-f0a7-4c4c-ae3e-3908843da69d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:33.059599 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1151/2313] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:14:33 2022] PUT /identity/v3/projects/1c393ac592d94e9b84b24c88f494f334/users/40e2fd87421b45478258675dc59156fb/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:33.059961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af08d-54f1-4bb8-b105-860f67b1a194 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:33.060452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af08d-54f1-4bb8-b105-860f67b1a194 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:33.061009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af08d-54f1-4bb8-b105-860f67b1a194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:33.118524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6e4af08d-54f1-4bb8-b105-860f67b1a194 None None] MFA Rules not processed for user `40e2fd87421b45478258675dc59156fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:33.120426 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6e4af08d-54f1-4bb8-b105-860f67b1a194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:33.216701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1163/2314] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:14:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:14:33.229385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea34f36-f0a7-4c4c-ae3e-3908843da69d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:33.231439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4ea34f36-f0a7-4c4c-ae3e-3908843da69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:33.244767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29990c-5cd8-4d40-94bd-c287ff3cf45d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:33.245356 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29990c-5cd8-4d40-94bd-c287ff3cf45d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:33.245744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29990c-5cd8-4d40-94bd-c287ff3cf45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:33.272727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ee29990c-5cd8-4d40-94bd-c287ff3cf45d None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:33.273843 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ee29990c-5cd8-4d40-94bd-c287ff3cf45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:33.299729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea34f36-f0a7-4c4c-ae3e-3908843da69d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:33.305622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3575cca-2f44-4f99-b179-ad1ed11130ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:33.306555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3575cca-2f44-4f99-b179-ad1ed11130ac service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:33.306765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3575cca-2f44-4f99-b179-ad1ed11130ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:33.306964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3575cca-2f44-4f99-b179-ad1ed11130ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:33.320048 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3575cca-2f44-4f99-b179-ad1ed11130ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:33.321647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3575cca-2f44-4f99-b179-ad1ed11130ac service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:33.343856 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1152/2315] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:33.367880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1164/2316] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:14:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:33.417599 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3575cca-2f44-4f99-b179-ad1ed11130ac service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:33.420115 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a3575cca-2f44-4f99-b179-ad1ed11130ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:33.448317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29990c-5cd8-4d40-94bd-c287ff3cf45d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:33.450751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ee29990c-5cd8-4d40-94bd-c287ff3cf45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:33.457199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:33.472462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29990c-5cd8-4d40-94bd-c287ff3cf45d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:33.476924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd37d07-b0ba-457f-b473-dc67e6f932ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:33.477603 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd37d07-b0ba-457f-b473-dc67e6f932ac service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:33.477889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd37d07-b0ba-457f-b473-dc67e6f932ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:33.478161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd37d07-b0ba-457f-b473-dc67e6f932ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:33.530674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3575cca-2f44-4f99-b179-ad1ed11130ac service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:33.535785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:33.536418 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222a042-e207-45d9-8344-ba99ced6d8da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:33.537569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222a042-e207-45d9-8344-ba99ced6d8da service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:33.538116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222a042-e207-45d9-8344-ba99ced6d8da service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:33.538429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222a042-e207-45d9-8344-ba99ced6d8da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:33.549429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222a042-e207-45d9-8344-ba99ced6d8da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:33.551118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222a042-e207-45d9-8344-ba99ced6d8da service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:33.551369 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd37d07-b0ba-457f-b473-dc67e6f932ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:33.552929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd37d07-b0ba-457f-b473-dc67e6f932ac service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:33.565493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1165/2318] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:33.566431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1153/2318] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:14:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:14:36.515415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd37d07-b0ba-457f-b473-dc67e6f932ac service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:36.517401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5bd37d07-b0ba-457f-b473-dc67e6f932ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:36.663073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd37d07-b0ba-457f-b473-dc67e6f932ac service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:36.674152 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c07b0-e0fd-47ce-a5a0-f4762f8efbb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:36.674858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c07b0-e0fd-47ce-a5a0-f4762f8efbb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:36.675139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c07b0-e0fd-47ce-a5a0-f4762f8efbb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:36.675416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c07b0-e0fd-47ce-a5a0-f4762f8efbb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:36.680334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-150c07b0-e0fd-47ce-a5a0-f4762f8efbb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:36.713052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c07b0-e0fd-47ce-a5a0-f4762f8efbb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:36.713052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c07b0-e0fd-47ce-a5a0-f4762f8efbb4 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:36.725186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1166/2319] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:43.557195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=23 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:46.715102 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=33 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:47.814278 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222a042-e207-45d9-8344-ba99ced6d8da service swift] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:47.815762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6222a042-e207-45d9-8344-ba99ced6d8da service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:47.909269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222a042-e207-45d9-8344-ba99ced6d8da service swift] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:47.915667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1a7d8-04f5-4ec8-800c-d58bce17d890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:47.916584 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1a7d8-04f5-4ec8-800c-d58bce17d890 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:47.917039 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1a7d8-04f5-4ec8-800c-d58bce17d890 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:47.917595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1a7d8-04f5-4ec8-800c-d58bce17d890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:47.920568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-42b1a7d8-04f5-4ec8-800c-d58bce17d890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:47.939744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1a7d8-04f5-4ec8-800c-d58bce17d890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:47.941554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1a7d8-04f5-4ec8-800c-d58bce17d890 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:47.953762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1154/2320] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:51.112330 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a6d1-0c96-4fe6-8e6b-a29174d3c537 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:51.112853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a6d1-0c96-4fe6-8e6b-a29174d3c537 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:51.112953 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a6d1-0c96-4fe6-8e6b-a29174d3c537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:51.135633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e4d3a6d1-0c96-4fe6-8e6b-a29174d3c537 None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:51.137357 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e4d3a6d1-0c96-4fe6-8e6b-a29174d3c537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:51.164777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1167/2321] 10.222.0.49 () {58 vars in 967 bytes} [Mon May 23 17:14:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:14:51.169985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1a7d8-04f5-4ec8-800c-d58bce17d890 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:51.182134 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1a7d8-04f5-4ec8-800c-d58bce17d890 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:51.188022 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc657e-18fb-44c4-bbcd-479a8c2ea93b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:51.189604 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc657e-18fb-44c4-bbcd-479a8c2ea93b service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:51.190074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc657e-18fb-44c4-bbcd-479a8c2ea93b service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:51.190544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc657e-18fb-44c4-bbcd-479a8c2ea93b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:51.199957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc657e-18fb-44c4-bbcd-479a8c2ea93b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:51.202538 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc657e-18fb-44c4-bbcd-479a8c2ea93b service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:51.216143 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1155/2322] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:14:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:14:51.266192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3a6d1-0c96-4fe6-8e6b-a29174d3c537 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:51.280055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3a6d1-0c96-4fe6-8e6b-a29174d3c537 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:51.285721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e87587-f689-451c-bc2b-7c1084ff789e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:51.286454 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e87587-f689-451c-bc2b-7c1084ff789e service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:51.286692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e87587-f689-451c-bc2b-7c1084ff789e service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:51.286969 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e87587-f689-451c-bc2b-7c1084ff789e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:51.290026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-81e87587-f689-451c-bc2b-7c1084ff789e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:51.303383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e87587-f689-451c-bc2b-7c1084ff789e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:51.305098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e87587-f689-451c-bc2b-7c1084ff789e service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:51.318445 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1168/2323] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:53.248055 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ea348-b052-40a9-b4d1-029a3ac6acfd None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:53.248611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ea348-b052-40a9-b4d1-029a3ac6acfd None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:53.249301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ea348-b052-40a9-b4d1-029a3ac6acfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:53.270638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ba2ea348-b052-40a9-b4d1-029a3ac6acfd None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:53.272420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ba2ea348-b052-40a9-b4d1-029a3ac6acfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:53.282678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1156/2324] 10.222.0.49 () {58 vars in 1009 bytes} [Mon May 23 17:14:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:53.298618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e87587-f689-451c-bc2b-7c1084ff789e service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:53.324671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e87587-f689-451c-bc2b-7c1084ff789e service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:53.332061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c63441-b75b-4195-921e-7ecce168cc7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:53.332860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c63441-b75b-4195-921e-7ecce168cc7f service swift] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:53.333155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c63441-b75b-4195-921e-7ecce168cc7f service swift] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:53.333436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c63441-b75b-4195-921e-7ecce168cc7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:53.342209 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c63441-b75b-4195-921e-7ecce168cc7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:53.347725 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c63441-b75b-4195-921e-7ecce168cc7f service swift] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:53.358495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1169/2325] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:14:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:14:54.525567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ea348-b052-40a9-b4d1-029a3ac6acfd None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:54.539245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ea348-b052-40a9-b4d1-029a3ac6acfd None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:54.547289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f332f-dbf6-4773-847a-c9abf5574022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:54.549256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f332f-dbf6-4773-847a-c9abf5574022 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:54.550421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f332f-dbf6-4773-847a-c9abf5574022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:54.550902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f332f-dbf6-4773-847a-c9abf5574022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:54.555996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fb5f332f-dbf6-4773-847a-c9abf5574022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:54.659071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f332f-dbf6-4773-847a-c9abf5574022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:54.661804 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f332f-dbf6-4773-847a-c9abf5574022 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:54.679582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1157/2326] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:14:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:01.330307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c63441-b75b-4195-921e-7ecce168cc7f service swift] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:01.331853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-54c63441-b75b-4195-921e-7ecce168cc7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:01.362337 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c63441-b75b-4195-921e-7ecce168cc7f service swift] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:01.372229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551a1ca-b5d7-478c-9701-9763c0f4ed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:01.373945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551a1ca-b5d7-478c-9701-9763c0f4ed6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:01.373945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551a1ca-b5d7-478c-9701-9763c0f4ed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:01.374417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551a1ca-b5d7-478c-9701-9763c0f4ed6f admin admin] PATH_INFO: `/v3/users/e40620f994a84438be8274acfe3eb547` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:01.376093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551a1ca-b5d7-478c-9701-9763c0f4ed6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40620f994a84438be8274acfe3eb547)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:01.378676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551a1ca-b5d7-478c-9701-9763c0f4ed6f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:01.471019 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d551a1ca-b5d7-478c-9701-9763c0f4ed6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40620f994a84438be8274acfe3eb547'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:01.473160 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d551a1ca-b5d7-478c-9701-9763c0f4ed6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40620f994a84438be8274acfe3eb547'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:01.489593 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d551a1ca-b5d7-478c-9701-9763c0f4ed6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40620f994a84438be8274acfe3eb547'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:01.509328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d551a1ca-b5d7-478c-9701-9763c0f4ed6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40620f994a84438be8274acfe3eb547'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:01.510278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d551a1ca-b5d7-478c-9701-9763c0f4ed6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40620f994a84438be8274acfe3eb547'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:01.543488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1170/2327] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:01 2022] DELETE /identity/v3/users/e40620f994a84438be8274acfe3eb547 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:02.005487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f332f-dbf6-4773-847a-c9abf5574022 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:02.017038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f332f-dbf6-4773-847a-c9abf5574022 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:02.222281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444e9be-022e-41d3-acc0-f2f34f7e3b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:02.225112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444e9be-022e-41d3-acc0-f2f34f7e3b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:02.226166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444e9be-022e-41d3-acc0-f2f34f7e3b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:02.226571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444e9be-022e-41d3-acc0-f2f34f7e3b87 admin admin] PATH_INFO: `/v3/projects/3eae88858fd7487cb48930e899eb63bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:02.230701 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444e9be-022e-41d3-acc0-f2f34f7e3b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eae88858fd7487cb48930e899eb63bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:02.237353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444e9be-022e-41d3-acc0-f2f34f7e3b87 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:02.241981 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:02.357793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0444e9be-022e-41d3-acc0-f2f34f7e3b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eae88858fd7487cb48930e899eb63bd', 'request_id': 'req-0444e9be-022e-41d3-acc0-f2f34f7e3b87'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:02.370393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0444e9be-022e-41d3-acc0-f2f34f7e3b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eae88858fd7487cb48930e899eb63bd', 'request_id': 'req-0444e9be-022e-41d3-acc0-f2f34f7e3b87'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:02.386094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0444e9be-022e-41d3-acc0-f2f34f7e3b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eae88858fd7487cb48930e899eb63bd', 'request_id': 'req-0444e9be-022e-41d3-acc0-f2f34f7e3b87'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:02.418861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0444e9be-022e-41d3-acc0-f2f34f7e3b87 admin admin] The token cache is being invalidate because project 3eae88858fd7487cb48930e899eb63bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:02.419188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0444e9be-022e-41d3-acc0-f2f34f7e3b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:02.420414 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0444e9be-022e-41d3-acc0-f2f34f7e3b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:02.423327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1158/2328] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:02 2022] DELETE /identity/v3/projects/3eae88858fd7487cb48930e899eb63bd => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:02.430846 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00970e0d-fa7f-4123-8411-1ef1ceaf8b52 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:02.431400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00970e0d-fa7f-4123-8411-1ef1ceaf8b52 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:02.431601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00970e0d-fa7f-4123-8411-1ef1ceaf8b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:02.460343 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-00970e0d-fa7f-4123-8411-1ef1ceaf8b52 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:02.462000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-00970e0d-fa7f-4123-8411-1ef1ceaf8b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:02.570639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1171/2329] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:02.578917 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d8cba-12ff-44b8-98ab-098957dba85b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:02.579585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d8cba-12ff-44b8-98ab-098957dba85b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:02.580094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d8cba-12ff-44b8-98ab-098957dba85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:02.602015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-582d8cba-12ff-44b8-98ab-098957dba85b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:02.603390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-582d8cba-12ff-44b8-98ab-098957dba85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:02.618072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1159/2330] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:02.622711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00970e0d-fa7f-4123-8411-1ef1ceaf8b52 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:02.633094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00970e0d-fa7f-4123-8411-1ef1ceaf8b52 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:02.638175 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9cc25-867d-44fa-8527-8689aee8def3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:02.638902 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9cc25-867d-44fa-8527-8689aee8def3 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:02.639253 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9cc25-867d-44fa-8527-8689aee8def3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:02.639446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9cc25-867d-44fa-8527-8689aee8def3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:02.640182 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9cc25-867d-44fa-8527-8689aee8def3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:02.640492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9cc25-867d-44fa-8527-8689aee8def3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:02.642116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9cc25-867d-44fa-8527-8689aee8def3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:02.671591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1172/2331] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:02.675496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d8cba-12ff-44b8-98ab-098957dba85b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:02.688737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d8cba-12ff-44b8-98ab-098957dba85b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:02.693913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4d14-8a9f-4d40-85c0-9520ea4885cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:02.694619 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4d14-8a9f-4d40-85c0-9520ea4885cc admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:02.694933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4d14-8a9f-4d40-85c0-9520ea4885cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:02.695185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4d14-8a9f-4d40-85c0-9520ea4885cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:02.695884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc4d14-8a9f-4d40-85c0-9520ea4885cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:02.697809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc4d14-8a9f-4d40-85c0-9520ea4885cc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:02.731283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1160/2332] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:02 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:02.736380 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9cc25-867d-44fa-8527-8689aee8def3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:02.751973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9cc25-867d-44fa-8527-8689aee8def3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:02.791575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:02.847814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc4cc-ac38-420c-b12b-d9fb82cfb316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:02.848504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc4cc-ac38-420c-b12b-d9fb82cfb316 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:02.849117 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc4cc-ac38-420c-b12b-d9fb82cfb316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:02.849406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc4cc-ac38-420c-b12b-d9fb82cfb316 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:02.850885 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc4cc-ac38-420c-b12b-d9fb82cfb316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:02.852998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc4cc-ac38-420c-b12b-d9fb82cfb316 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:02.875869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1173/2333] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:02 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:02.880401 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4d14-8a9f-4d40-85c0-9520ea4885cc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:02.898145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4d14-8a9f-4d40-85c0-9520ea4885cc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:02.912974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fc61f-7856-4bb9-8316-827ec5bd6bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:02.913704 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fc61f-7856-4bb9-8316-827ec5bd6bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:02.914126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fc61f-7856-4bb9-8316-827ec5bd6bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:02.914470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fc61f-7856-4bb9-8316-827ec5bd6bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:02.915221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fc61f-7856-4bb9-8316-827ec5bd6bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:02.916916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fc61f-7856-4bb9-8316-827ec5bd6bcc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:02.929048 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1161/2334] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:02.933223 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc4cc-ac38-420c-b12b-d9fb82cfb316 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:02.947440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc4cc-ac38-420c-b12b-d9fb82cfb316 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:02.953443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0d942-49ef-4a2d-8f38-9cb8ac91115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:02.954566 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0d942-49ef-4a2d-8f38-9cb8ac91115a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:02.954968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0d942-49ef-4a2d-8f38-9cb8ac91115a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:02.955348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0d942-49ef-4a2d-8f38-9cb8ac91115a admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:02.956195 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0d942-49ef-4a2d-8f38-9cb8ac91115a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:02.957997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0d942-49ef-4a2d-8f38-9cb8ac91115a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:02.970675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1174/2335] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:02.975178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fc61f-7856-4bb9-8316-827ec5bd6bcc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:02.994516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fc61f-7856-4bb9-8316-827ec5bd6bcc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:03.004334 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac479b6e-984a-4944-aa57-12e7c3a66157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:03.005623 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac479b6e-984a-4944-aa57-12e7c3a66157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:03.006187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac479b6e-984a-4944-aa57-12e7c3a66157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:03.006187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac479b6e-984a-4944-aa57-12e7c3a66157 admin admin] PATH_INFO: `/v3/projects/36ebd94cabd1446394180f34e95b275b/users/5f067014a8f54cd6a33ba24801e93e80/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:03.044877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac479b6e-984a-4944-aa57-12e7c3a66157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ebd94cabd1446394180f34e95b275b, user_id=5f067014a8f54cd6a33ba24801e93e80, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:03.052881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac479b6e-984a-4944-aa57-12e7c3a66157 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:03.078825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1162/2336] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:02 2022] PUT /identity/v3/projects/36ebd94cabd1446394180f34e95b275b/users/5f067014a8f54cd6a33ba24801e93e80/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:03.089818 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c0e37-b110-4f64-9898-a84b5f0e88ea None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:03.090252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c0e37-b110-4f64-9898-a84b5f0e88ea None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:03.090626 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c0e37-b110-4f64-9898-a84b5f0e88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:03.141551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a22c0e37-b110-4f64-9898-a84b5f0e88ea None None] MFA Rules not processed for user `5f067014a8f54cd6a33ba24801e93e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:03.142972 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a22c0e37-b110-4f64-9898-a84b5f0e88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:03.245320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1175/2337] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:03.250829 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac479b6e-984a-4944-aa57-12e7c3a66157 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:03.340073 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac479b6e-984a-4944-aa57-12e7c3a66157 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:03.348520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204daaf4-ce3a-452b-8fb6-7522b30127d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:03.349206 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204daaf4-ce3a-452b-8fb6-7522b30127d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:03.349492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204daaf4-ce3a-452b-8fb6-7522b30127d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:03.349773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204daaf4-ce3a-452b-8fb6-7522b30127d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:03.350518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204daaf4-ce3a-452b-8fb6-7522b30127d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:03.352622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204daaf4-ce3a-452b-8fb6-7522b30127d6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:03.388058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1163/2338] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:03 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:03.392017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c0e37-b110-4f64-9898-a84b5f0e88ea None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:03.408540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c0e37-b110-4f64-9898-a84b5f0e88ea None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:03.489502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6893d45-86f1-433e-927c-8b0a8b642dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:03.490408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6893d45-86f1-433e-927c-8b0a8b642dde admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:03.490771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6893d45-86f1-433e-927c-8b0a8b642dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:03.491122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6893d45-86f1-433e-927c-8b0a8b642dde admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:03.492027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6893d45-86f1-433e-927c-8b0a8b642dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:03.494389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6893d45-86f1-433e-927c-8b0a8b642dde admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:03.524037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1176/2339] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:03 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:03.525161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204daaf4-ce3a-452b-8fb6-7522b30127d6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:03.540408 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204daaf4-ce3a-452b-8fb6-7522b30127d6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:03.545520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcf833-10ef-4cb5-9ded-3497044a461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:03.546201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcf833-10ef-4cb5-9ded-3497044a461b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:03.546574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcf833-10ef-4cb5-9ded-3497044a461b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:03.546790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcf833-10ef-4cb5-9ded-3497044a461b admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:03.547605 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcf833-10ef-4cb5-9ded-3497044a461b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:03.549242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcf833-10ef-4cb5-9ded-3497044a461b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:03.555169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:03.562946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1164/2340] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:03.566376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6893d45-86f1-433e-927c-8b0a8b642dde admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:03.577443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6893d45-86f1-433e-927c-8b0a8b642dde admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:03.583355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee935169-2dd4-486e-b30b-0a41ef8f9ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:03.584518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee935169-2dd4-486e-b30b-0a41ef8f9ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:03.584913 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee935169-2dd4-486e-b30b-0a41ef8f9ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:03.585315 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee935169-2dd4-486e-b30b-0a41ef8f9ceb admin admin] PATH_INFO: `/v3/projects/5becb4b308fd4feeb1e8753a6a33ec30/users/ac6ef96dfcf9452cbd74c186742aac60/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:03.608689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee935169-2dd4-486e-b30b-0a41ef8f9ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5becb4b308fd4feeb1e8753a6a33ec30, user_id=ac6ef96dfcf9452cbd74c186742aac60, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:03.612197 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee935169-2dd4-486e-b30b-0a41ef8f9ceb admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:03.626031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:03.634261 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1177/2341] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:03 2022] PUT /identity/v3/projects/5becb4b308fd4feeb1e8753a6a33ec30/users/ac6ef96dfcf9452cbd74c186742aac60/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:03.637986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcf833-10ef-4cb5-9ded-3497044a461b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:03.650395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcf833-10ef-4cb5-9ded-3497044a461b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:03.686989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee935169-2dd4-486e-b30b-0a41ef8f9ceb admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:03.689040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ee935169-2dd4-486e-b30b-0a41ef8f9ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:03.731324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abaffd8-676d-4fa4-a651-f9490d47ad69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:03.732548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaffd8-676d-4fa4-a651-f9490d47ad69 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:03.732837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaffd8-676d-4fa4-a651-f9490d47ad69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:03.733122 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaffd8-676d-4fa4-a651-f9490d47ad69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:03.733849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abaffd8-676d-4fa4-a651-f9490d47ad69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:03.735501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abaffd8-676d-4fa4-a651-f9490d47ad69 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:03.746542 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1165/2342] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:03.751205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abaffd8-676d-4fa4-a651-f9490d47ad69 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:03.761271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abaffd8-676d-4fa4-a651-f9490d47ad69 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:03.767399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42a575-6cf2-4aab-bc52-137ec8dd7958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:03.768408 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42a575-6cf2-4aab-bc52-137ec8dd7958 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:03.768698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42a575-6cf2-4aab-bc52-137ec8dd7958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:03.768981 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42a575-6cf2-4aab-bc52-137ec8dd7958 admin admin] PATH_INFO: `/v3/projects/5becb4b308fd4feeb1e8753a6a33ec30/users/ac6ef96dfcf9452cbd74c186742aac60/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:03.769480 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee935169-2dd4-486e-b30b-0a41ef8f9ceb admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:03.771089 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42a575-6cf2-4aab-bc52-137ec8dd7958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5becb4b308fd4feeb1e8753a6a33ec30, user_id=ac6ef96dfcf9452cbd74c186742aac60, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:03.773868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42a575-6cf2-4aab-bc52-137ec8dd7958 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:03.777130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:03.777955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:03.778272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:03.778594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] PATH_INFO: `/v3/users/cf37fdf077124d4ba101bd53c34178e6` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:03.779939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf37fdf077124d4ba101bd53c34178e6)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:03.783114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:03.792620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1166/2343] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:03 2022] PUT /identity/v3/projects/5becb4b308fd4feeb1e8753a6a33ec30/users/ac6ef96dfcf9452cbd74c186742aac60/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:03.806837 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162d6c4-aa1a-4c7a-8d08-78009f7f2911 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:03.808021 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162d6c4-aa1a-4c7a-8d08-78009f7f2911 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:03.808567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162d6c4-aa1a-4c7a-8d08-78009f7f2911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:03.852645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4162d6c4-aa1a-4c7a-8d08-78009f7f2911 None None] MFA Rules not processed for user `ac6ef96dfcf9452cbd74c186742aac60`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:03.854252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4162d6c4-aa1a-4c7a-8d08-78009f7f2911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:03.860518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf37fdf077124d4ba101bd53c34178e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:03.861955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf37fdf077124d4ba101bd53c34178e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:03.871839 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf37fdf077124d4ba101bd53c34178e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:03.881871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf37fdf077124d4ba101bd53c34178e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:03.882804 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf37fdf077124d4ba101bd53c34178e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:03.903541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1178/2344] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:03 2022] DELETE /identity/v3/users/cf37fdf077124d4ba101bd53c34178e6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:03.947943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1167/2345] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:03.962956 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:03.964497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:04.029887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889be0de-6742-48e3-8eed-51bac6894287 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:04.033514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed2c58-a8f0-4ab8-b460-80eb5864e1b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:04.034163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed2c58-a8f0-4ab8-b460-80eb5864e1b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:04.034481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed2c58-a8f0-4ab8-b460-80eb5864e1b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:04.034758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed2c58-a8f0-4ab8-b460-80eb5864e1b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:04.076840 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:04.101097 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162d6c4-aa1a-4c7a-8d08-78009f7f2911 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:04.103202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4162d6c4-aa1a-4c7a-8d08-78009f7f2911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:04.122794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed2c58-a8f0-4ab8-b460-80eb5864e1b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:04.124574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed2c58-a8f0-4ab8-b460-80eb5864e1b8 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:04.136482 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1179/2346] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:04.169523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed2c58-a8f0-4ab8-b460-80eb5864e1b8 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:04.171098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-dbed2c58-a8f0-4ab8-b460-80eb5864e1b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:04.193287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162d6c4-aa1a-4c7a-8d08-78009f7f2911 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:04.207460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:04.256809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed2c58-a8f0-4ab8-b460-80eb5864e1b8 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:04.261856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbfb5d-0c5d-41ff-9d7f-08a78dd1121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:04.263342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbfb5d-0c5d-41ff-9d7f-08a78dd1121d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:04.263836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbfb5d-0c5d-41ff-9d7f-08a78dd1121d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:04.264272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:04.264453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbfb5d-0c5d-41ff-9d7f-08a78dd1121d admin admin] PATH_INFO: `/v3/users/5f067014a8f54cd6a33ba24801e93e80` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:04.265281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:04.265585 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbfb5d-0c5d-41ff-9d7f-08a78dd1121d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f067014a8f54cd6a33ba24801e93e80)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:04.265685 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:04.266093 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] PATH_INFO: `/v3/projects/6763f0fa8aaf47e9ba513ca4c60e743d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:04.267489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6763f0fa8aaf47e9ba513ca4c60e743d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:04.267697 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbfb5d-0c5d-41ff-9d7f-08a78dd1121d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:04.270023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:04.323557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-28dbfb5d-0c5d-41ff-9d7f-08a78dd1121d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f067014a8f54cd6a33ba24801e93e80'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.324227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-28dbfb5d-0c5d-41ff-9d7f-08a78dd1121d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f067014a8f54cd6a33ba24801e93e80'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.327661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6763f0fa8aaf47e9ba513ca4c60e743d', 'request_id': 'req-0efe2576-0758-45c2-aa9f-045d8c4e8a25'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.332651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-28dbfb5d-0c5d-41ff-9d7f-08a78dd1121d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f067014a8f54cd6a33ba24801e93e80'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.334598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6763f0fa8aaf47e9ba513ca4c60e743d', 'request_id': 'req-0efe2576-0758-45c2-aa9f-045d8c4e8a25'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.343349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-28dbfb5d-0c5d-41ff-9d7f-08a78dd1121d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f067014a8f54cd6a33ba24801e93e80'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.344231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-28dbfb5d-0c5d-41ff-9d7f-08a78dd1121d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f067014a8f54cd6a33ba24801e93e80'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.345184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6763f0fa8aaf47e9ba513ca4c60e743d', 'request_id': 'req-0efe2576-0758-45c2-aa9f-045d8c4e8a25'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.365018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] The token cache is being invalidate because project 6763f0fa8aaf47e9ba513ca4c60e743d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:04.365585 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.366893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.368033 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1180/2347] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:04 2022] DELETE /identity/v3/users/5f067014a8f54cd6a33ba24801e93e80 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:04.371618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1168/2348] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:04 2022] DELETE /identity/v3/projects/6763f0fa8aaf47e9ba513ca4c60e743d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:04.373387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268c2d8-8036-4447-85b2-879058392051 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:04.373667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268c2d8-8036-4447-85b2-879058392051 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:04.373936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268c2d8-8036-4447-85b2-879058392051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:04.375363 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:04.377322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:04.393725 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3268c2d8-8036-4447-85b2-879058392051 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:04.394965 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3268c2d8-8036-4447-85b2-879058392051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:04.446683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:04.451086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe2576-0758-45c2-aa9f-045d8c4e8a25 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:04.468127 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1181/2349] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:04.477577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268c2d8-8036-4447-85b2-879058392051 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:04.478932 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3268c2d8-8036-4447-85b2-879058392051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:04.501408 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:04.511913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:04.513888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:04.514178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:04.514506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] PATH_INFO: `/v3/users/05ef74cf08ed46be898d3410af0b05c1` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:04.515983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ef74cf08ed46be898d3410af0b05c1)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:04.517929 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:04.538656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268c2d8-8036-4447-85b2-879058392051 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:04.542300 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1eafba-0b95-4480-a155-afc3b6f18c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:04.543146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1eafba-0b95-4480-a155-afc3b6f18c8d service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:04.543602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1eafba-0b95-4480-a155-afc3b6f18c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:04.544118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1eafba-0b95-4480-a155-afc3b6f18c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:04.554390 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1eafba-0b95-4480-a155-afc3b6f18c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:04.555963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1eafba-0b95-4480-a155-afc3b6f18c8d service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:04.565473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1182/2350] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:04.566531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ef74cf08ed46be898d3410af0b05c1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.580191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ef74cf08ed46be898d3410af0b05c1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.580934 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ef74cf08ed46be898d3410af0b05c1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.588801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ef74cf08ed46be898d3410af0b05c1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.589613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ef74cf08ed46be898d3410af0b05c1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:04.604202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1169/2351] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:04 2022] DELETE /identity/v3/users/05ef74cf08ed46be898d3410af0b05c1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:04.846977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1eafba-0b95-4480-a155-afc3b6f18c8d service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:04.858521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1eafba-0b95-4480-a155-afc3b6f18c8d service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:04.929531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:04.929531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:04.943758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:04.944833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:04.945122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:04.945912 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] PATH_INFO: `/v3/projects/e69dd59fb6064e728604b4a2ab2130b3` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:04.947408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e69dd59fb6064e728604b4a2ab2130b3)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:04.950101 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:05.007817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b868-b21d-4414-a650-0bc7593420a7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:05.010792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e69dd59fb6064e728604b4a2ab2130b3', 'request_id': 'req-b3738d03-8109-4278-a8b4-6080867e2362'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.020716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e69dd59fb6064e728604b4a2ab2130b3', 'request_id': 'req-b3738d03-8109-4278-a8b4-6080867e2362'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.031938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e69dd59fb6064e728604b4a2ab2130b3', 'request_id': 'req-b3738d03-8109-4278-a8b4-6080867e2362'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.051003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] The token cache is being invalidate because project e69dd59fb6064e728604b4a2ab2130b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:05.051239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.051837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.064663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1183/2352] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:04 2022] DELETE /identity/v3/projects/e69dd59fb6064e728604b4a2ab2130b3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:05.074728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:05.076128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:05.076557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:05.076774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] PATH_INFO: `/v3/projects/36ebd94cabd1446394180f34e95b275b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:05.078075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ebd94cabd1446394180f34e95b275b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:05.080490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:05.113903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:05.144260 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ebd94cabd1446394180f34e95b275b', 'request_id': 'req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.150159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ebd94cabd1446394180f34e95b275b', 'request_id': 'req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.157354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ebd94cabd1446394180f34e95b275b', 'request_id': 'req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.172141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] The token cache is being invalidate because project 36ebd94cabd1446394180f34e95b275b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:05.172432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.173158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.174862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1170/2353] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:04 2022] DELETE /identity/v3/projects/36ebd94cabd1446394180f34e95b275b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:05.178985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:05.180359 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:05.194258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3738d03-8109-4278-a8b4-6080867e2362 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:05.221594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:05.283060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935aa68-0b6e-4703-b510-5d9cf8f94f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:05.284023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935aa68-0b6e-4703-b510-5d9cf8f94f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:05.284272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935aa68-0b6e-4703-b510-5d9cf8f94f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:05.284572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935aa68-0b6e-4703-b510-5d9cf8f94f5d admin admin] PATH_INFO: `/v3/users/ac6ef96dfcf9452cbd74c186742aac60` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:05.285854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935aa68-0b6e-4703-b510-5d9cf8f94f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6ef96dfcf9452cbd74c186742aac60)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:05.287980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935aa68-0b6e-4703-b510-5d9cf8f94f5d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:05.342136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8935aa68-0b6e-4703-b510-5d9cf8f94f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6ef96dfcf9452cbd74c186742aac60'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.343451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8935aa68-0b6e-4703-b510-5d9cf8f94f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6ef96dfcf9452cbd74c186742aac60'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.350679 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8935aa68-0b6e-4703-b510-5d9cf8f94f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6ef96dfcf9452cbd74c186742aac60'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.359287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8935aa68-0b6e-4703-b510-5d9cf8f94f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6ef96dfcf9452cbd74c186742aac60'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.359918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8935aa68-0b6e-4703-b510-5d9cf8f94f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6ef96dfcf9452cbd74c186742aac60'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.380053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1184/2354] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:05 2022] DELETE /identity/v3/users/ac6ef96dfcf9452cbd74c186742aac60 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:05.703612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:05.706098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:05.725205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be4bc-30ba-4c33-b9f5-267ea1e9e45e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:05.788868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0a177-cef3-4b23-b898-74128453f752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:05.789744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0a177-cef3-4b23-b898-74128453f752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:05.790025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0a177-cef3-4b23-b898-74128453f752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:05.790299 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0a177-cef3-4b23-b898-74128453f752 admin admin] PATH_INFO: `/v3/projects/5becb4b308fd4feeb1e8753a6a33ec30` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:05.791803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0a177-cef3-4b23-b898-74128453f752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5becb4b308fd4feeb1e8753a6a33ec30)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:05.794275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0a177-cef3-4b23-b898-74128453f752 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:05.847337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5eb0a177-cef3-4b23-b898-74128453f752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5becb4b308fd4feeb1e8753a6a33ec30', 'request_id': 'req-5eb0a177-cef3-4b23-b898-74128453f752'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.853277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5eb0a177-cef3-4b23-b898-74128453f752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5becb4b308fd4feeb1e8753a6a33ec30', 'request_id': 'req-5eb0a177-cef3-4b23-b898-74128453f752'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.860757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5eb0a177-cef3-4b23-b898-74128453f752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5becb4b308fd4feeb1e8753a6a33ec30', 'request_id': 'req-5eb0a177-cef3-4b23-b898-74128453f752'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.873948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5eb0a177-cef3-4b23-b898-74128453f752 admin admin] The token cache is being invalidate because project 5becb4b308fd4feeb1e8753a6a33ec30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:05.874235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5eb0a177-cef3-4b23-b898-74128453f752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.874900 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5eb0a177-cef3-4b23-b898-74128453f752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:05.876483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1171/2355] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:05 2022] DELETE /identity/v3/projects/5becb4b308fd4feeb1e8753a6a33ec30 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:05.881510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36818de9-17b6-4a65-a4bc-73b912723dfa None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:05.881981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36818de9-17b6-4a65-a4bc-73b912723dfa None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:05.882088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36818de9-17b6-4a65-a4bc-73b912723dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:05.900838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-36818de9-17b6-4a65-a4bc-73b912723dfa None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:05.902030 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-36818de9-17b6-4a65-a4bc-73b912723dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:05.961377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1185/2356] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:05.969088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b0558-e25d-448f-8fce-5e840cc60703 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:05.969379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b0558-e25d-448f-8fce-5e840cc60703 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:05.969656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b0558-e25d-448f-8fce-5e840cc60703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:05.989953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ca7b0558-e25d-448f-8fce-5e840cc60703 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:05.991192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ca7b0558-e25d-448f-8fce-5e840cc60703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:06.000298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1172/2357] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:06.004608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36818de9-17b6-4a65-a4bc-73b912723dfa None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.014286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36818de9-17b6-4a65-a4bc-73b912723dfa None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.018808 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c5856-831b-477f-8fe2-ff24868c3f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.019458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c5856-831b-477f-8fe2-ff24868c3f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.019746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c5856-831b-477f-8fe2-ff24868c3f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.020026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c5856-831b-477f-8fe2-ff24868c3f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.020746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c5856-831b-477f-8fe2-ff24868c3f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:06.021055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c5856-831b-477f-8fe2-ff24868c3f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.022653 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c5856-831b-477f-8fe2-ff24868c3f8a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.034167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1186/2358] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:06.038438 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b0558-e25d-448f-8fce-5e840cc60703 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.048296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b0558-e25d-448f-8fce-5e840cc60703 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.052926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c218a-5aa8-4cb3-9b6a-0c13ebc70260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.053562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c218a-5aa8-4cb3-9b6a-0c13ebc70260 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.053847 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c218a-5aa8-4cb3-9b6a-0c13ebc70260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.054122 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c218a-5aa8-4cb3-9b6a-0c13ebc70260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.054845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c218a-5aa8-4cb3-9b6a-0c13ebc70260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.056727 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c218a-5aa8-4cb3-9b6a-0c13ebc70260 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.082267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1173/2359] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:06 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:06.086282 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c5856-831b-477f-8fe2-ff24868c3f8a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.096334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c5856-831b-477f-8fe2-ff24868c3f8a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.124107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:06.157935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da27c0-92bd-4d2e-a6c5-62629152409a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.158652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da27c0-92bd-4d2e-a6c5-62629152409a admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.158945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da27c0-92bd-4d2e-a6c5-62629152409a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.159221 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da27c0-92bd-4d2e-a6c5-62629152409a admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.160047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da27c0-92bd-4d2e-a6c5-62629152409a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.161939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da27c0-92bd-4d2e-a6c5-62629152409a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.186316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1187/2360] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:06 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:06.190106 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c218a-5aa8-4cb3-9b6a-0c13ebc70260 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.201305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c218a-5aa8-4cb3-9b6a-0c13ebc70260 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.206194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bed2c-7df6-4e30-a5eb-7879f3438963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.206886 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bed2c-7df6-4e30-a5eb-7879f3438963 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.207178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bed2c-7df6-4e30-a5eb-7879f3438963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.207460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bed2c-7df6-4e30-a5eb-7879f3438963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.208194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bed2c-7df6-4e30-a5eb-7879f3438963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.209774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bed2c-7df6-4e30-a5eb-7879f3438963 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.215790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:06.223268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1174/2361] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:06.226788 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da27c0-92bd-4d2e-a6c5-62629152409a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.237681 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da27c0-92bd-4d2e-a6c5-62629152409a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.242432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a1490-90a8-4e79-95e0-7c00fc807e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.243215 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a1490-90a8-4e79-95e0-7c00fc807e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.243452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a1490-90a8-4e79-95e0-7c00fc807e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.243855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a1490-90a8-4e79-95e0-7c00fc807e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.244729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a1490-90a8-4e79-95e0-7c00fc807e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.246525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a1490-90a8-4e79-95e0-7c00fc807e6c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.260474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1188/2362] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:06.261504 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bed2c-7df6-4e30-a5eb-7879f3438963 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.272844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bed2c-7df6-4e30-a5eb-7879f3438963 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.277460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf2687-5a8d-4f0b-9a22-f269033605b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.279257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf2687-5a8d-4f0b-9a22-f269033605b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.279507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf2687-5a8d-4f0b-9a22-f269033605b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.279785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf2687-5a8d-4f0b-9a22-f269033605b0 admin admin] PATH_INFO: `/v3/projects/9bea36b3fa33484c9536452cf6b4ef0b/users/1208db874e4c4586aa1ee7a7e6df7c62/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.294844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf2687-5a8d-4f0b-9a22-f269033605b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bea36b3fa33484c9536452cf6b4ef0b, user_id=1208db874e4c4586aa1ee7a7e6df7c62, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.297867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf2687-5a8d-4f0b-9a22-f269033605b0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.311554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1175/2363] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:06 2022] PUT /identity/v3/projects/9bea36b3fa33484c9536452cf6b4ef0b/users/1208db874e4c4586aa1ee7a7e6df7c62/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:06.321613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c83678-4d05-4c58-911e-5451787eb389 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.321910 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c83678-4d05-4c58-911e-5451787eb389 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.322191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c83678-4d05-4c58-911e-5451787eb389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.349773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-15c83678-4d05-4c58-911e-5451787eb389 None None] MFA Rules not processed for user `1208db874e4c4586aa1ee7a7e6df7c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:06.351149 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-15c83678-4d05-4c58-911e-5451787eb389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:06.423421 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1189/2364] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:06.427767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf2687-5a8d-4f0b-9a22-f269033605b0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.482116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c83678-4d05-4c58-911e-5451787eb389 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.483530 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-15c83678-4d05-4c58-911e-5451787eb389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:06.492263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf2687-5a8d-4f0b-9a22-f269033605b0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.497409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c83678-4d05-4c58-911e-5451787eb389 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.497752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58bae0-d1c4-4962-b738-6ec19a836246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.498417 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58bae0-d1c4-4962-b738-6ec19a836246 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.498704 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58bae0-d1c4-4962-b738-6ec19a836246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.498982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58bae0-d1c4-4962-b738-6ec19a836246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.499670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58bae0-d1c4-4962-b738-6ec19a836246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.501566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58bae0-d1c4-4962-b738-6ec19a836246 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.502344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572df08-d504-470b-b1af-01945c4a0819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.503236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572df08-d504-470b-b1af-01945c4a0819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.503544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572df08-d504-470b-b1af-01945c4a0819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.503821 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572df08-d504-470b-b1af-01945c4a0819 admin admin] PATH_INFO: `/v3/users/02a1b1b7381f4d0e9629938031165c4f` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.505007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572df08-d504-470b-b1af-01945c4a0819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a1b1b7381f4d0e9629938031165c4f)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.506930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572df08-d504-470b-b1af-01945c4a0819 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.530404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1176/2365] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:06 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:06.531485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58bae0-d1c4-4962-b738-6ec19a836246 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.556332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b572df08-d504-470b-b1af-01945c4a0819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a1b1b7381f4d0e9629938031165c4f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:06.557004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b572df08-d504-470b-b1af-01945c4a0819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a1b1b7381f4d0e9629938031165c4f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:06.564857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b572df08-d504-470b-b1af-01945c4a0819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a1b1b7381f4d0e9629938031165c4f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:06.572792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b572df08-d504-470b-b1af-01945c4a0819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a1b1b7381f4d0e9629938031165c4f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:06.573437 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b572df08-d504-470b-b1af-01945c4a0819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a1b1b7381f4d0e9629938031165c4f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:06.592150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1190/2366] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:06 2022] DELETE /identity/v3/users/02a1b1b7381f4d0e9629938031165c4f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:06.596622 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7a362-36b4-4798-8256-027cbbeda829 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.596876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58bae0-d1c4-4962-b738-6ec19a836246 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.597009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7a362-36b4-4798-8256-027cbbeda829 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.597165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7a362-36b4-4798-8256-027cbbeda829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.616617 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e2b7a362-36b4-4798-8256-027cbbeda829 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:06.618133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e2b7a362-36b4-4798-8256-027cbbeda829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:06.622994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:06.660270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bac50c-8032-4513-aa88-b9f0ed4a2dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.660953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bac50c-8032-4513-aa88-b9f0ed4a2dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.661246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bac50c-8032-4513-aa88-b9f0ed4a2dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.661529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bac50c-8032-4513-aa88-b9f0ed4a2dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.662228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bac50c-8032-4513-aa88-b9f0ed4a2dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.664187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bac50c-8032-4513-aa88-b9f0ed4a2dd9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.681116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:06.689591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1191/2367] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:06.689814 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1177/2368] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:06 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:06.692829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7a362-36b4-4798-8256-027cbbeda829 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.694283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e2b7a362-36b4-4798-8256-027cbbeda829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:06.699473 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bac50c-8032-4513-aa88-b9f0ed4a2dd9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.702229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-53bac50c-8032-4513-aa88-b9f0ed4a2dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:06.708396 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7a362-36b4-4798-8256-027cbbeda829 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.713365 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0b5d3-f60b-4065-b7b4-c5f9d3052ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.714040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0b5d3-f60b-4065-b7b4-c5f9d3052ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.714329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0b5d3-f60b-4065-b7b4-c5f9d3052ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.714637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0b5d3-f60b-4065-b7b4-c5f9d3052ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.715366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0b5d3-f60b-4065-b7b4-c5f9d3052ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.717541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0b5d3-f60b-4065-b7b4-c5f9d3052ddf admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.732138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1192/2369] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:06.733181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0b5d3-f60b-4065-b7b4-c5f9d3052ddf admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.743340 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0b5d3-f60b-4065-b7b4-c5f9d3052ddf admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.748209 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755191a8-0bca-4e69-8ec2-353193d4490c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.748871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755191a8-0bca-4e69-8ec2-353193d4490c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.749164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755191a8-0bca-4e69-8ec2-353193d4490c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.749443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755191a8-0bca-4e69-8ec2-353193d4490c admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.750317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755191a8-0bca-4e69-8ec2-353193d4490c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.751943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755191a8-0bca-4e69-8ec2-353193d4490c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.766327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1193/2370] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:06.768008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755191a8-0bca-4e69-8ec2-353193d4490c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:06.771133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bac50c-8032-4513-aa88-b9f0ed4a2dd9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.777283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70463b54-7143-4429-9f31-fdd0cf9991d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.777941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70463b54-7143-4429-9f31-fdd0cf9991d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.778300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70463b54-7143-4429-9f31-fdd0cf9991d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.778632 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70463b54-7143-4429-9f31-fdd0cf9991d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.784020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755191a8-0bca-4e69-8ec2-353193d4490c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:06.789016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbafbfe-7a37-48e4-b713-7188b8f3112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:06.790116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbafbfe-7a37-48e4-b713-7188b8f3112c admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.790598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbafbfe-7a37-48e4-b713-7188b8f3112c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.790883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbafbfe-7a37-48e4-b713-7188b8f3112c admin admin] PATH_INFO: `/v3/projects/0d668bea7225476a9ad0fc9ad17cf498/users/0b6ab04288484b93ab78f71024ebcfd9/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.793489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70463b54-7143-4429-9f31-fdd0cf9991d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.795512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70463b54-7143-4429-9f31-fdd0cf9991d8 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.805593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1178/2371] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:06.812408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbafbfe-7a37-48e4-b713-7188b8f3112c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d668bea7225476a9ad0fc9ad17cf498, user_id=0b6ab04288484b93ab78f71024ebcfd9, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:06.815764 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbafbfe-7a37-48e4-b713-7188b8f3112c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:06.829832 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1194/2372] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:06 2022] PUT /identity/v3/projects/0d668bea7225476a9ad0fc9ad17cf498/users/0b6ab04288484b93ab78f71024ebcfd9/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:06.841879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee911f4-d20c-40f6-9632-fb80f02bc5ff None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:06.842324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee911f4-d20c-40f6-9632-fb80f02bc5ff None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:06.842667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee911f4-d20c-40f6-9632-fb80f02bc5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:06.872081 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3ee911f4-d20c-40f6-9632-fb80f02bc5ff None None] MFA Rules not processed for user `0b6ab04288484b93ab78f71024ebcfd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:06.873306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3ee911f4-d20c-40f6-9632-fb80f02bc5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:06.941384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1179/2373] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:06.945825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbafbfe-7a37-48e4-b713-7188b8f3112c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:07.023550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbafbfe-7a37-48e4-b713-7188b8f3112c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:07.035731 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4616030-7088-42a6-8795-1e083af089f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:07.037092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616030-7088-42a6-8795-1e083af089f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:07.037497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616030-7088-42a6-8795-1e083af089f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:07.037803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616030-7088-42a6-8795-1e083af089f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:07.039290 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4616030-7088-42a6-8795-1e083af089f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:07.042446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4616030-7088-42a6-8795-1e083af089f5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:07.140353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1195/2374] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:06 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:07.144118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee911f4-d20c-40f6-9632-fb80f02bc5ff None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:07.155502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee911f4-d20c-40f6-9632-fb80f02bc5ff None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:07.170544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4616030-7088-42a6-8795-1e083af089f5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:07.172271 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c4616030-7088-42a6-8795-1e083af089f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:07.227149 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:07.229067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cba40-8b45-49fc-98e3-8909ce5d7c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:07.229927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cba40-8b45-49fc-98e3-8909ce5d7c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:07.230731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cba40-8b45-49fc-98e3-8909ce5d7c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:07.230731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cba40-8b45-49fc-98e3-8909ce5d7c4a admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:07.231216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cba40-8b45-49fc-98e3-8909ce5d7c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:07.233340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cba40-8b45-49fc-98e3-8909ce5d7c4a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:07.256652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4616030-7088-42a6-8795-1e083af089f5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:07.256843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1180/2375] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:07 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:07.260707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cba40-8b45-49fc-98e3-8909ce5d7c4a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:07.261460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:07.262323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:07.262779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:07.263269 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] PATH_INFO: `/v3/projects/d22db35fe4b64640a4d32382751f88c4` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:07.264685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22db35fe4b64640a4d32382751f88c4)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:07.266619 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:07.271747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cba40-8b45-49fc-98e3-8909ce5d7c4a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:07.278687 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebc82b-4f02-45b7-8136-2d7e76dd95d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:07.279770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebc82b-4f02-45b7-8136-2d7e76dd95d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:07.280616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebc82b-4f02-45b7-8136-2d7e76dd95d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:07.280968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebc82b-4f02-45b7-8136-2d7e76dd95d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:07.281787 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebc82b-4f02-45b7-8136-2d7e76dd95d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:07.283662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebc82b-4f02-45b7-8136-2d7e76dd95d9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:07.294838 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1181/2376] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:07.299033 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebc82b-4f02-45b7-8136-2d7e76dd95d9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:07.310388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebc82b-4f02-45b7-8136-2d7e76dd95d9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:07.315821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:07.329014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22db35fe4b64640a4d32382751f88c4', 'request_id': 'req-ab015652-8c03-4dbc-abdd-9cd5034f211f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:07.337780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22db35fe4b64640a4d32382751f88c4', 'request_id': 'req-ab015652-8c03-4dbc-abdd-9cd5034f211f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:07.346782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22db35fe4b64640a4d32382751f88c4', 'request_id': 'req-ab015652-8c03-4dbc-abdd-9cd5034f211f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:07.359525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] The token cache is being invalidate because project d22db35fe4b64640a4d32382751f88c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:07.359826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:07.360937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:07.365861 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1196/2377] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:07 2022] DELETE /identity/v3/projects/d22db35fe4b64640a4d32382751f88c4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:07.366781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:07.368437 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:07.390209 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cd725-840a-4b95-976e-1d41619006d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:07.391855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd725-840a-4b95-976e-1d41619006d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:07.392091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd725-840a-4b95-976e-1d41619006d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:07.392375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd725-840a-4b95-976e-1d41619006d4 admin admin] PATH_INFO: `/v3/projects/6bbf1a42b2a64b61921ec4ef880f755c/users/a5fb6b64f559495497b148e880f0190d/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:07.410967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cd725-840a-4b95-976e-1d41619006d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bbf1a42b2a64b61921ec4ef880f755c, user_id=a5fb6b64f559495497b148e880f0190d, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:07.413744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cd725-840a-4b95-976e-1d41619006d4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:07.429329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1182/2378] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:07 2022] PUT /identity/v3/projects/6bbf1a42b2a64b61921ec4ef880f755c/users/a5fb6b64f559495497b148e880f0190d/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:07.433347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cd725-840a-4b95-976e-1d41619006d4 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:07.436149 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-790cd725-840a-4b95-976e-1d41619006d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:07.460454 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab015652-8c03-4dbc-abdd-9cd5034f211f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:07.513269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cd725-840a-4b95-976e-1d41619006d4 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:07.518479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96aec31-2d10-4257-8e64-ad2a0e199ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:07.519158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aec31-2d10-4257-8e64-ad2a0e199ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:07.519448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aec31-2d10-4257-8e64-ad2a0e199ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:07.519731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aec31-2d10-4257-8e64-ad2a0e199ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:07.520469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aec31-2d10-4257-8e64-ad2a0e199ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:07.522970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aec31-2d10-4257-8e64-ad2a0e199ce0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:07.524959 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:07.526187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:07.526503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:07.526782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] PATH_INFO: `/v3/users/40e2fd87421b45478258675dc59156fb` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:07.527989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e2fd87421b45478258675dc59156fb)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:07.530785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:07.534195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1183/2379] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:07.538311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96aec31-2d10-4257-8e64-ad2a0e199ce0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:07.549685 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96aec31-2d10-4257-8e64-ad2a0e199ce0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:07.554699 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f473761-750e-41f9-b541-9ba3812cdefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:07.555271 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:07.555922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f473761-750e-41f9-b541-9ba3812cdefa admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:07.556218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f473761-750e-41f9-b541-9ba3812cdefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:07.556504 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f473761-750e-41f9-b541-9ba3812cdefa admin admin] PATH_INFO: `/v3/projects/6bbf1a42b2a64b61921ec4ef880f755c/users/a5fb6b64f559495497b148e880f0190d/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:07.560335 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f473761-750e-41f9-b541-9ba3812cdefa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bbf1a42b2a64b61921ec4ef880f755c, user_id=a5fb6b64f559495497b148e880f0190d, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:07.563577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f473761-750e-41f9-b541-9ba3812cdefa admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:07.576442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1184/2380] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:07 2022] PUT /identity/v3/projects/6bbf1a42b2a64b61921ec4ef880f755c/users/a5fb6b64f559495497b148e880f0190d/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:07.586927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1884c29-3231-4984-b18d-0b1fb0902ed6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:07.587226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1884c29-3231-4984-b18d-0b1fb0902ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:07.587511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1884c29-3231-4984-b18d-0b1fb0902ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:07.594977 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e2fd87421b45478258675dc59156fb'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:07.595707 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e2fd87421b45478258675dc59156fb'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:07.604093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e2fd87421b45478258675dc59156fb'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:07.617042 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e2fd87421b45478258675dc59156fb'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:07.617924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e2fd87421b45478258675dc59156fb'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:07.622506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b1884c29-3231-4984-b18d-0b1fb0902ed6 None None] MFA Rules not processed for user `a5fb6b64f559495497b148e880f0190d`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:07.623876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b1884c29-3231-4984-b18d-0b1fb0902ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:07.640539 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1197/2381] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:07 2022] DELETE /identity/v3/users/40e2fd87421b45478258675dc59156fb => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:07.708802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:07.719714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1185/2382] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:07.729375 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:07.731163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:07.820139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228abad-697d-4532-8310-dd8ea08539c6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:07.824436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e54385-d41d-4544-b9a2-16b2964e2f29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:07.825865 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e54385-d41d-4544-b9a2-16b2964e2f29 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:07.826041 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e54385-d41d-4544-b9a2-16b2964e2f29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:07.826342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e54385-d41d-4544-b9a2-16b2964e2f29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:07.897194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e54385-d41d-4544-b9a2-16b2964e2f29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:07.898819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e54385-d41d-4544-b9a2-16b2964e2f29 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:07.910669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1198/2383] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:07.978782 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1884c29-3231-4984-b18d-0b1fb0902ed6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:07.980241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b1884c29-3231-4984-b18d-0b1fb0902ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:08.065952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1884c29-3231-4984-b18d-0b1fb0902ed6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:08.131780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f05d5b-9de4-41a9-815d-0e0c3394e700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:08.132770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f05d5b-9de4-41a9-815d-0e0c3394e700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.133317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f05d5b-9de4-41a9-815d-0e0c3394e700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.133675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f05d5b-9de4-41a9-815d-0e0c3394e700 admin admin] PATH_INFO: `/v3/projects/1c393ac592d94e9b84b24c88f494f334` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.135695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f05d5b-9de4-41a9-815d-0e0c3394e700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c393ac592d94e9b84b24c88f494f334)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:08.138312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f05d5b-9de4-41a9-815d-0e0c3394e700 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:08.190040 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c7f05d5b-9de4-41a9-815d-0e0c3394e700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c393ac592d94e9b84b24c88f494f334', 'request_id': 'req-c7f05d5b-9de4-41a9-815d-0e0c3394e700'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:08.195710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c7f05d5b-9de4-41a9-815d-0e0c3394e700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c393ac592d94e9b84b24c88f494f334', 'request_id': 'req-c7f05d5b-9de4-41a9-815d-0e0c3394e700'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:08.203768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c7f05d5b-9de4-41a9-815d-0e0c3394e700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c393ac592d94e9b84b24c88f494f334', 'request_id': 'req-c7f05d5b-9de4-41a9-815d-0e0c3394e700'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:08.215873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c7f05d5b-9de4-41a9-815d-0e0c3394e700 admin admin] The token cache is being invalidate because project 1c393ac592d94e9b84b24c88f494f334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:08.216166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c7f05d5b-9de4-41a9-815d-0e0c3394e700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:08.216799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c7f05d5b-9de4-41a9-815d-0e0c3394e700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:08.218345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1186/2384] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:07 2022] DELETE /identity/v3/projects/1c393ac592d94e9b84b24c88f494f334 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:08.223458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4cd7a-39a8-49fb-b484-c61d4e353aa1 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.223954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4cd7a-39a8-49fb-b484-c61d4e353aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.224176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4cd7a-39a8-49fb-b484-c61d4e353aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.244468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-68f4cd7a-39a8-49fb-b484-c61d4e353aa1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:08.245688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-68f4cd7a-39a8-49fb-b484-c61d4e353aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:08.292614 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:08.313315 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1199/2385] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:08.321377 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5fa7e-d73e-46d9-9a03-55adba644a4d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.321853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5fa7e-d73e-46d9-9a03-55adba644a4d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.321946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5fa7e-d73e-46d9-9a03-55adba644a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.341723 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a6f5fa7e-d73e-46d9-9a03-55adba644a4d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:08.342879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a6f5fa7e-d73e-46d9-9a03-55adba644a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:08.351013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1187/2386] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:08.355486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4cd7a-39a8-49fb-b484-c61d4e353aa1 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:08.367065 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4cd7a-39a8-49fb-b484-c61d4e353aa1 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:08.372937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad02a35-b3e2-4e1b-be68-dfdad36d41b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:08.373492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad02a35-b3e2-4e1b-be68-dfdad36d41b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.373782 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad02a35-b3e2-4e1b-be68-dfdad36d41b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.374061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad02a35-b3e2-4e1b-be68-dfdad36d41b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.374832 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad02a35-b3e2-4e1b-be68-dfdad36d41b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:08.375140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad02a35-b3e2-4e1b-be68-dfdad36d41b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:08.376750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad02a35-b3e2-4e1b-be68-dfdad36d41b7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:08.392551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1200/2387] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:08.393620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5fa7e-d73e-46d9-9a03-55adba644a4d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:08.403948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5fa7e-d73e-46d9-9a03-55adba644a4d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:08.409124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87190a08-ced8-41f5-a314-c1022036f3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:08.409849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87190a08-ced8-41f5-a314-c1022036f3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.410198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87190a08-ced8-41f5-a314-c1022036f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.410573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87190a08-ced8-41f5-a314-c1022036f3d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.411509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87190a08-ced8-41f5-a314-c1022036f3d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:08.413717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87190a08-ced8-41f5-a314-c1022036f3d3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:08.448449 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1188/2388] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:08 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:08.449873 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad02a35-b3e2-4e1b-be68-dfdad36d41b7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:08.468627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad02a35-b3e2-4e1b-be68-dfdad36d41b7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:08.470392 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87190a08-ced8-41f5-a314-c1022036f3d3 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:08.472031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-87190a08-ced8-41f5-a314-c1022036f3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:08.483697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:08.538773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87190a08-ced8-41f5-a314-c1022036f3d3 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:08.539021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5f1fc-4063-42b5-b7d6-89330e129584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:08.539558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5f1fc-4063-42b5-b7d6-89330e129584 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.539850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5f1fc-4063-42b5-b7d6-89330e129584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.540135 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5f1fc-4063-42b5-b7d6-89330e129584 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.540875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5f1fc-4063-42b5-b7d6-89330e129584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:08.542802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5f1fc-4063-42b5-b7d6-89330e129584 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:08.543310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860b4f0-f9ff-49c8-9a93-b3856c59fb11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:08.544475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860b4f0-f9ff-49c8-9a93-b3856c59fb11 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.544967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860b4f0-f9ff-49c8-9a93-b3856c59fb11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.545465 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860b4f0-f9ff-49c8-9a93-b3856c59fb11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.547320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9860b4f0-f9ff-49c8-9a93-b3856c59fb11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:08.565425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1201/2389] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:08 2022] POST /identity/v3/users => generated 279 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:08.569699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5f1fc-4063-42b5-b7d6-89330e129584 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:08.581247 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5f1fc-4063-42b5-b7d6-89330e129584 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:08.586196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3aed8-1194-441b-a2a1-45ea9165000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:08.586909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3aed8-1194-441b-a2a1-45ea9165000f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.587197 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3aed8-1194-441b-a2a1-45ea9165000f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.587481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3aed8-1194-441b-a2a1-45ea9165000f admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.588211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3aed8-1194-441b-a2a1-45ea9165000f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:08.589796 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3aed8-1194-441b-a2a1-45ea9165000f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:08.601342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1202/2390] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:08.605552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3aed8-1194-441b-a2a1-45ea9165000f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:08.617479 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3aed8-1194-441b-a2a1-45ea9165000f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:08.619356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860b4f0-f9ff-49c8-9a93-b3856c59fb11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:08.620888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860b4f0-f9ff-49c8-9a93-b3856c59fb11 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:08.624069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070438f0-c26c-4ebf-9b40-2b404349481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:08.624872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070438f0-c26c-4ebf-9b40-2b404349481a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.625165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070438f0-c26c-4ebf-9b40-2b404349481a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.625479 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070438f0-c26c-4ebf-9b40-2b404349481a admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.626651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070438f0-c26c-4ebf-9b40-2b404349481a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:08.628979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070438f0-c26c-4ebf-9b40-2b404349481a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:08.632413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1189/2391] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:08.642016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1203/2392] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:08.646504 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860b4f0-f9ff-49c8-9a93-b3856c59fb11 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:08.657293 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860b4f0-f9ff-49c8-9a93-b3856c59fb11 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:08.662050 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbbec5-b940-4f1f-98c5-afeffd853e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:08.662906 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbbec5-b940-4f1f-98c5-afeffd853e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.663198 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbbec5-b940-4f1f-98c5-afeffd853e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.663479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbbec5-b940-4f1f-98c5-afeffd853e05 admin admin] PATH_INFO: `/v3/projects/669e517171b047a2903715000ab8bdf2/users/7f18cfd4b8d84e94bc9ab488b2af3ccf/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.679571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbbec5-b940-4f1f-98c5-afeffd853e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=669e517171b047a2903715000ab8bdf2, user_id=7f18cfd4b8d84e94bc9ab488b2af3ccf, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:08.682683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbbec5-b940-4f1f-98c5-afeffd853e05 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:08.699217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1190/2393] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:08 2022] PUT /identity/v3/projects/669e517171b047a2903715000ab8bdf2/users/7f18cfd4b8d84e94bc9ab488b2af3ccf/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:08.710768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85919b-62f5-4830-b2b1-88d2992c49cb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.711081 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85919b-62f5-4830-b2b1-88d2992c49cb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.711353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85919b-62f5-4830-b2b1-88d2992c49cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.741556 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5e85919b-62f5-4830-b2b1-88d2992c49cb None None] MFA Rules not processed for user `7f18cfd4b8d84e94bc9ab488b2af3ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:08.743179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5e85919b-62f5-4830-b2b1-88d2992c49cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:08.820739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1204/2394] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:08 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:08.825405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbbec5-b940-4f1f-98c5-afeffd853e05 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:08.900742 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b64f2-2a6c-4503-bfe6-f6967f2d44d5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.904113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b64f2-2a6c-4503-bfe6-f6967f2d44d5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.904377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b64f2-2a6c-4503-bfe6-f6967f2d44d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.907773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbbec5-b940-4f1f-98c5-afeffd853e05 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:08.913554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aa021-e329-465a-a01e-ebe80a8afa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:08.914215 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aa021-e329-465a-a01e-ebe80a8afa8e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:08.914554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aa021-e329-465a-a01e-ebe80a8afa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:08.914832 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aa021-e329-465a-a01e-ebe80a8afa8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:08.915717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972aa021-e329-465a-a01e-ebe80a8afa8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:08.917735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972aa021-e329-465a-a01e-ebe80a8afa8e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:08.931999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c37b64f2-2a6c-4503-bfe6-f6967f2d44d5 None None] MFA Rules not processed for user `96230dd16acb4cdfa43b892b2b747282`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:08.933211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c37b64f2-2a6c-4503-bfe6-f6967f2d44d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:08.953264 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1191/2395] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:08 2022] POST /identity/v3/projects => generated 355 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:08.957758 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aa021-e329-465a-a01e-ebe80a8afa8e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:08.969520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:08.993826 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:09.001867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1205/2396] 10.222.0.49 () {58 vars in 967 bytes} [Mon May 23 17:15:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:09.015857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b64f2-2a6c-4503-bfe6-f6967f2d44d5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:09.017296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c37b64f2-2a6c-4503-bfe6-f6967f2d44d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:09.034827 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aa021-e329-465a-a01e-ebe80a8afa8e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:09.040079 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffc63f-17a5-4c81-b825-535edb0719ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:09.040754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffc63f-17a5-4c81-b825-535edb0719ea admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:09.041071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffc63f-17a5-4c81-b825-535edb0719ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:09.041353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffc63f-17a5-4c81-b825-535edb0719ea admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:09.042057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffc63f-17a5-4c81-b825-535edb0719ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:09.044788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffc63f-17a5-4c81-b825-535edb0719ea admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:09.069616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1192/2397] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:08 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:09.072347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffc63f-17a5-4c81-b825-535edb0719ea admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:09.089612 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffc63f-17a5-4c81-b825-535edb0719ea admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:09.094810 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd3835-bacb-4040-87bd-de6d0a05346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:09.095560 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd3835-bacb-4040-87bd-de6d0a05346d admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:09.095918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd3835-bacb-4040-87bd-de6d0a05346d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:09.096263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd3835-bacb-4040-87bd-de6d0a05346d admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:09.097270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd3835-bacb-4040-87bd-de6d0a05346d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:09.098976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd3835-bacb-4040-87bd-de6d0a05346d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:09.110974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b64f2-2a6c-4503-bfe6-f6967f2d44d5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:09.111232 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1193/2398] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:09.115119 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd3835-bacb-4040-87bd-de6d0a05346d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:09.128186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd3835-bacb-4040-87bd-de6d0a05346d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:09.134623 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b578a-69f5-4f9e-bc27-dfbc043456e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:09.135521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b578a-69f5-4f9e-bc27-dfbc043456e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:09.135805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b578a-69f5-4f9e-bc27-dfbc043456e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:09.136086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b578a-69f5-4f9e-bc27-dfbc043456e6 admin admin] PATH_INFO: `/v3/projects/a31b60c3795c457eaaaad1eb8e8d5247/users/ac4d78dedcf74a479290fcdf5e4a0e53/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:09.154827 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b578a-69f5-4f9e-bc27-dfbc043456e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31b60c3795c457eaaaad1eb8e8d5247, user_id=ac4d78dedcf74a479290fcdf5e4a0e53, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:09.157720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b578a-69f5-4f9e-bc27-dfbc043456e6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:09.173682 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1194/2399] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:09 2022] PUT /identity/v3/projects/a31b60c3795c457eaaaad1eb8e8d5247/users/ac4d78dedcf74a479290fcdf5e4a0e53/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:09.177724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b578a-69f5-4f9e-bc27-dfbc043456e6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:09.193256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23994bd9-ae34-4618-9e08-148186dc8b2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f94b1abe248c3969b68e17755f113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:09.193921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23994bd9-ae34-4618-9e08-148186dc8b2f service swift] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:09.194385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23994bd9-ae34-4618-9e08-148186dc8b2f service swift] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:09.195112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23994bd9-ae34-4618-9e08-148186dc8b2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:09.253684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b578a-69f5-4f9e-bc27-dfbc043456e6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:09.258803 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7dc57-cb4f-4b29-8438-7758a4933438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:09.259552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7dc57-cb4f-4b29-8438-7758a4933438 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:09.259905 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7dc57-cb4f-4b29-8438-7758a4933438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:09.260253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7dc57-cb4f-4b29-8438-7758a4933438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:09.261052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7dc57-cb4f-4b29-8438-7758a4933438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:09.262999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23994bd9-ae34-4618-9e08-148186dc8b2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:09.263467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7dc57-cb4f-4b29-8438-7758a4933438 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:09.265026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23994bd9-ae34-4618-9e08-148186dc8b2f service swift] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:09.273107 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1206/2400] 10.222.0.49 () {60 vars in 1384 bytes} [Mon May 23 17:15:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 17:15:09.273801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1195/2401] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:09.277454 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23994bd9-ae34-4618-9e08-148186dc8b2f service swift] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:09.277680 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7dc57-cb4f-4b29-8438-7758a4933438 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:09.279427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-23994bd9-ae34-4618-9e08-148186dc8b2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:09.288904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7dc57-cb4f-4b29-8438-7758a4933438 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:09.295495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb4ded-3ff7-4973-92c7-554387ab388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:09.296720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb4ded-3ff7-4973-92c7-554387ab388b admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:09.297135 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb4ded-3ff7-4973-92c7-554387ab388b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:09.297751 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb4ded-3ff7-4973-92c7-554387ab388b admin admin] PATH_INFO: `/v3/projects/a31b60c3795c457eaaaad1eb8e8d5247/users/ac4d78dedcf74a479290fcdf5e4a0e53/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:09.300011 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb4ded-3ff7-4973-92c7-554387ab388b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31b60c3795c457eaaaad1eb8e8d5247, user_id=ac4d78dedcf74a479290fcdf5e4a0e53, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:09.302725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb4ded-3ff7-4973-92c7-554387ab388b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:09.307314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:09.320273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1196/2402] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:09 2022] PUT /identity/v3/projects/a31b60c3795c457eaaaad1eb8e8d5247/users/ac4d78dedcf74a479290fcdf5e4a0e53/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:09.333230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9383-2580-4597-b6f2-82d372c8df08 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:09.333792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9383-2580-4597-b6f2-82d372c8df08 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:09.333792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9383-2580-4597-b6f2-82d372c8df08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:09.363775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-322d9383-2580-4597-b6f2-82d372c8df08 None None] MFA Rules not processed for user `ac4d78dedcf74a479290fcdf5e4a0e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:09.365149 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-322d9383-2580-4597-b6f2-82d372c8df08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:09.371010 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23994bd9-ae34-4618-9e08-148186dc8b2f service swift] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:09.430153 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:09.451860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6246-afe3-4b6a-9844-4e8380fc668a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:09.452556 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6246-afe3-4b6a-9844-4e8380fc668a service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:09.452838 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6246-afe3-4b6a-9844-4e8380fc668a service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:09.453242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6246-afe3-4b6a-9844-4e8380fc668a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:09.455234 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-28ef6246-afe3-4b6a-9844-4e8380fc668a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:09.456877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1197/2403] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:09 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:09.471228 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d9383-2580-4597-b6f2-82d372c8df08 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:09.531760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef6246-afe3-4b6a-9844-4e8380fc668a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:09.533808 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef6246-afe3-4b6a-9844-4e8380fc668a service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:09.544787 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d9383-2580-4597-b6f2-82d372c8df08 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:09.550072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa7f10-87dd-4dbd-848e-e515309c2b9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:09.551193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa7f10-87dd-4dbd-848e-e515309c2b9a service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:09.551702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa7f10-87dd-4dbd-848e-e515309c2b9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:09.552208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa7f10-87dd-4dbd-848e-e515309c2b9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:09.555798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1207/2404] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:09.567600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa7f10-87dd-4dbd-848e-e515309c2b9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:09.569297 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa7f10-87dd-4dbd-848e-e515309c2b9a service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:09.582531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1198/2405] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:09 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:09.670011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6246-afe3-4b6a-9844-4e8380fc668a service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:09.681481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6246-afe3-4b6a-9844-4e8380fc668a service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:09.686886 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149f3ae-8d41-4aef-8e9e-b09f3bb1413f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:09.687854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149f3ae-8d41-4aef-8e9e-b09f3bb1413f service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:09.688301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149f3ae-8d41-4aef-8e9e-b09f3bb1413f service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:09.688765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149f3ae-8d41-4aef-8e9e-b09f3bb1413f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:09.763385 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:09.767867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149f3ae-8d41-4aef-8e9e-b09f3bb1413f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:09.769448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149f3ae-8d41-4aef-8e9e-b09f3bb1413f service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:09.782882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1208/2406] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:09 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:12.783139 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa7f10-87dd-4dbd-848e-e515309c2b9a service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:12.796127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa7f10-87dd-4dbd-848e-e515309c2b9a service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:12.799835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb3f98-70b6-4046-bf16-07f0fd9afd2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:12.800530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb3f98-70b6-4046-bf16-07f0fd9afd2e service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:12.800811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb3f98-70b6-4046-bf16-07f0fd9afd2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:12.801268 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb3f98-70b6-4046-bf16-07f0fd9afd2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:12.803953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-83bb3f98-70b6-4046-bf16-07f0fd9afd2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:12.883640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb3f98-70b6-4046-bf16-07f0fd9afd2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:12.885101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb3f98-70b6-4046-bf16-07f0fd9afd2e service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:12.894486 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1199/2407] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:15.019523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149f3ae-8d41-4aef-8e9e-b09f3bb1413f service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:15.020957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8149f3ae-8d41-4aef-8e9e-b09f3bb1413f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:15.088794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149f3ae-8d41-4aef-8e9e-b09f3bb1413f service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:15.094265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:15.095305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:15.095710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:15.095999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] PATH_INFO: `/v3/users/1208db874e4c4586aa1ee7a7e6df7c62` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:15.097401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1208db874e4c4586aa1ee7a7e6df7c62)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:15.099376 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:15.146741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1208db874e4c4586aa1ee7a7e6df7c62'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.147395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1208db874e4c4586aa1ee7a7e6df7c62'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.155907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1208db874e4c4586aa1ee7a7e6df7c62'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.165784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1208db874e4c4586aa1ee7a7e6df7c62'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.166803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1208db874e4c4586aa1ee7a7e6df7c62'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.185793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1209/2408] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:15 2022] DELETE /identity/v3/users/1208db874e4c4586aa1ee7a7e6df7c62 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:15.191300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9cb47-7d7d-408e-a3a4-c27a7ac9c6fb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:15.191738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9cb47-7d7d-408e-a3a4-c27a7ac9c6fb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:15.191832 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9cb47-7d7d-408e-a3a4-c27a7ac9c6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:15.210832 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c2b9cb47-7d7d-408e-a3a4-c27a7ac9c6fb None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:15.212037 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c2b9cb47-7d7d-408e-a3a4-c27a7ac9c6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:15.287610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1200/2409] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:15.314307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:15.316225 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:15.388671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f2bc1-201f-469e-825a-854fc0cbbfa6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:15.392352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae87c-9b9b-4cb6-843d-68d28e639580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:15.393005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae87c-9b9b-4cb6-843d-68d28e639580 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:15.393293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae87c-9b9b-4cb6-843d-68d28e639580 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:15.393572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae87c-9b9b-4cb6-843d-68d28e639580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:15.403090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adae87c-9b9b-4cb6-843d-68d28e639580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:15.404515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adae87c-9b9b-4cb6-843d-68d28e639580 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:15.414733 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1210/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:15.734644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9cb47-7d7d-408e-a3a4-c27a7ac9c6fb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:15.736197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c2b9cb47-7d7d-408e-a3a4-c27a7ac9c6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:15.749396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9cb47-7d7d-408e-a3a4-c27a7ac9c6fb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:15.754237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:15.755141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:15.755498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:15.755866 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] PATH_INFO: `/v3/projects/9bea36b3fa33484c9536452cf6b4ef0b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:15.757127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bea36b3fa33484c9536452cf6b4ef0b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:15.759086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:15.786934 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:15.812733 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bea36b3fa33484c9536452cf6b4ef0b', 'request_id': 'req-22cfad94-0bf2-4c09-8a92-31ab0dad8858'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.818158 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bea36b3fa33484c9536452cf6b4ef0b', 'request_id': 'req-22cfad94-0bf2-4c09-8a92-31ab0dad8858'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.824384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bea36b3fa33484c9536452cf6b4ef0b', 'request_id': 'req-22cfad94-0bf2-4c09-8a92-31ab0dad8858'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.837177 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] The token cache is being invalidate because project 9bea36b3fa33484c9536452cf6b4ef0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:15.837465 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.838087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.839638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1201/2411] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:15 2022] DELETE /identity/v3/projects/9bea36b3fa33484c9536452cf6b4ef0b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:15.843856 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae87c-9b9b-4cb6-843d-68d28e639580 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:15.853915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae87c-9b9b-4cb6-843d-68d28e639580 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:15.866989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:15.914012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:15.914927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:15.915213 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:15.915490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] PATH_INFO: `/v3/users/0b6ab04288484b93ab78f71024ebcfd9` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:15.916657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6ab04288484b93ab78f71024ebcfd9)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:15.919133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:15.964191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6ab04288484b93ab78f71024ebcfd9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.964841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6ab04288484b93ab78f71024ebcfd9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.971710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6ab04288484b93ab78f71024ebcfd9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.978901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6ab04288484b93ab78f71024ebcfd9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.979622 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6ab04288484b93ab78f71024ebcfd9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:15.998343 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1211/2412] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:15 2022] DELETE /identity/v3/users/0b6ab04288484b93ab78f71024ebcfd9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:16.270656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:16.272170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:16.285478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfad94-0bf2-4c09-8a92-31ab0dad8858 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:16.348231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:16.349098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:16.349386 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:16.349665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] PATH_INFO: `/v3/projects/0d668bea7225476a9ad0fc9ad17cf498` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:16.351094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d668bea7225476a9ad0fc9ad17cf498)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:16.353010 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:16.399453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d668bea7225476a9ad0fc9ad17cf498', 'request_id': 'req-ecc5e42d-2aa6-4722-b31b-083ba734140d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:16.405419 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d668bea7225476a9ad0fc9ad17cf498', 'request_id': 'req-ecc5e42d-2aa6-4722-b31b-083ba734140d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:16.411697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d668bea7225476a9ad0fc9ad17cf498', 'request_id': 'req-ecc5e42d-2aa6-4722-b31b-083ba734140d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:16.425210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] The token cache is being invalidate because project 0d668bea7225476a9ad0fc9ad17cf498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:16.425519 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:16.426131 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:16.427664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1202/2413] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:16 2022] DELETE /identity/v3/projects/0d668bea7225476a9ad0fc9ad17cf498 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:16.431820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:16.433265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:16.447794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e067d6-8263-4c56-9f3b-ff752aeba6ba admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:16.508090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef11d44-bc3d-46d1-b686-3873f4d135ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:16.508090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef11d44-bc3d-46d1-b686-3873f4d135ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:16.508090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef11d44-bc3d-46d1-b686-3873f4d135ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:16.508090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef11d44-bc3d-46d1-b686-3873f4d135ac admin admin] PATH_INFO: `/v3/users/a5fb6b64f559495497b148e880f0190d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:16.509206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef11d44-bc3d-46d1-b686-3873f4d135ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fb6b64f559495497b148e880f0190d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:16.511258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef11d44-bc3d-46d1-b686-3873f4d135ac admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:16.554019 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:16.564438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fef11d44-bc3d-46d1-b686-3873f4d135ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fb6b64f559495497b148e880f0190d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:16.565431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fef11d44-bc3d-46d1-b686-3873f4d135ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fb6b64f559495497b148e880f0190d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:16.581201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fef11d44-bc3d-46d1-b686-3873f4d135ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fb6b64f559495497b148e880f0190d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:16.590185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fef11d44-bc3d-46d1-b686-3873f4d135ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fb6b64f559495497b148e880f0190d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:16.591604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fef11d44-bc3d-46d1-b686-3873f4d135ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fb6b64f559495497b148e880f0190d'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:16.618765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1212/2414] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:16 2022] DELETE /identity/v3/users/a5fb6b64f559495497b148e880f0190d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:16.907969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:16.909900 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:16.925493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5e42d-2aa6-4722-b31b-083ba734140d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:16.967364 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:16.985607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:16.986503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:16.986805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:16.987064 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1 admin admin] PATH_INFO: `/v3/projects/6bbf1a42b2a64b61921ec4ef880f755c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:16.988243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bbf1a42b2a64b61921ec4ef880f755c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:16.990146 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:17.035214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bbf1a42b2a64b61921ec4ef880f755c', 'request_id': 'req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:17.040592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bbf1a42b2a64b61921ec4ef880f755c', 'request_id': 'req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:17.047373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bbf1a42b2a64b61921ec4ef880f755c', 'request_id': 'req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:17.059658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1 admin admin] The token cache is being invalidate because project 6bbf1a42b2a64b61921ec4ef880f755c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:17.060110 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:17.060735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cc782dfc-350f-4f3f-b8d0-8c20be44dea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:17.062291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1203/2415] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:16 2022] DELETE /identity/v3/projects/6bbf1a42b2a64b61921ec4ef880f755c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:17.069226 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a50742-a77f-4cf4-befa-1b480ebededc None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.069526 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a50742-a77f-4cf4-befa-1b480ebededc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.069839 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a50742-a77f-4cf4-befa-1b480ebededc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.088139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-72a50742-a77f-4cf4-befa-1b480ebededc None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:17.089378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-72a50742-a77f-4cf4-befa-1b480ebededc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:17.151881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1213/2416] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:17.162327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6847d7-3060-4091-ab46-0b65d9f5079d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.162682 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6847d7-3060-4091-ab46-0b65d9f5079d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.162965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6847d7-3060-4091-ab46-0b65d9f5079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.182217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8e6847d7-3060-4091-ab46-0b65d9f5079d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:17.183550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8e6847d7-3060-4091-ab46-0b65d9f5079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:17.191697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1204/2417] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:17.195950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a50742-a77f-4cf4-befa-1b480ebededc None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:17.206349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a50742-a77f-4cf4-befa-1b480ebededc None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:17.211786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac062-d289-42bc-ac69-8b97be0d1a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:17.212446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac062-d289-42bc-ac69-8b97be0d1a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.212732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac062-d289-42bc-ac69-8b97be0d1a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.213008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac062-d289-42bc-ac69-8b97be0d1a9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.213732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac062-d289-42bc-ac69-8b97be0d1a9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:17.214040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac062-d289-42bc-ac69-8b97be0d1a9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:17.216495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac062-d289-42bc-ac69-8b97be0d1a9d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:17.229439 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1214/2418] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:17.233675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6847d7-3060-4091-ab46-0b65d9f5079d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:17.242958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6847d7-3060-4091-ab46-0b65d9f5079d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:17.248060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42319f-0600-42ff-9f32-0a51db64000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:17.248736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42319f-0600-42ff-9f32-0a51db64000e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.249020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42319f-0600-42ff-9f32-0a51db64000e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.249413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42319f-0600-42ff-9f32-0a51db64000e admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.250114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42319f-0600-42ff-9f32-0a51db64000e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:17.252074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42319f-0600-42ff-9f32-0a51db64000e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:17.282913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1205/2419] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:17 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:17.284428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac062-d289-42bc-ac69-8b97be0d1a9d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:17.295163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac062-d289-42bc-ac69-8b97be0d1a9d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:17.352295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0e920-804f-4ccf-8f36-74fb4f92151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:17.352975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e920-804f-4ccf-8f36-74fb4f92151b admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.353265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e920-804f-4ccf-8f36-74fb4f92151b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.353547 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e920-804f-4ccf-8f36-74fb4f92151b admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.354243 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0e920-804f-4ccf-8f36-74fb4f92151b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:17.356717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0e920-804f-4ccf-8f36-74fb4f92151b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:17.380870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1215/2420] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:17 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:17.382088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42319f-0600-42ff-9f32-0a51db64000e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:17.393300 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42319f-0600-42ff-9f32-0a51db64000e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:17.397986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad4e5-0999-4819-99ed-3e7554b2069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:17.398678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad4e5-0999-4819-99ed-3e7554b2069f admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.398966 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad4e5-0999-4819-99ed-3e7554b2069f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.399243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad4e5-0999-4819-99ed-3e7554b2069f admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.399974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dad4e5-0999-4819-99ed-3e7554b2069f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:17.401558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dad4e5-0999-4819-99ed-3e7554b2069f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:17.413312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1206/2421] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:17.417386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0e920-804f-4ccf-8f36-74fb4f92151b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:17.427633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0e920-804f-4ccf-8f36-74fb4f92151b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:17.432274 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0636c9-74fc-459a-8aea-4828e29eb51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:17.433029 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0636c9-74fc-459a-8aea-4828e29eb51c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.433318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0636c9-74fc-459a-8aea-4828e29eb51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.433594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0636c9-74fc-459a-8aea-4828e29eb51c admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.434609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0636c9-74fc-459a-8aea-4828e29eb51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:17.436219 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0636c9-74fc-459a-8aea-4828e29eb51c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:17.447175 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1216/2422] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:17.451696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad4e5-0999-4819-99ed-3e7554b2069f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:17.462024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad4e5-0999-4819-99ed-3e7554b2069f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:17.467642 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef69107-fdf8-4d2e-ad11-f17b0ee1c0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:17.468530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef69107-fdf8-4d2e-ad11-f17b0ee1c0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.468927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef69107-fdf8-4d2e-ad11-f17b0ee1c0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.469208 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef69107-fdf8-4d2e-ad11-f17b0ee1c0b4 admin admin] PATH_INFO: `/v3/projects/25844e07a34c4b34925d912e4dd8905e/users/c37074ab35df4e99ae947b45692d69ee/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.484506 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef69107-fdf8-4d2e-ad11-f17b0ee1c0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25844e07a34c4b34925d912e4dd8905e, user_id=c37074ab35df4e99ae947b45692d69ee, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:17.487233 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef69107-fdf8-4d2e-ad11-f17b0ee1c0b4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:17.502102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1207/2423] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:17 2022] PUT /identity/v3/projects/25844e07a34c4b34925d912e4dd8905e/users/c37074ab35df4e99ae947b45692d69ee/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:17.513936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c8881-6beb-431f-b89f-e92ce3e92261 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.514322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c8881-6beb-431f-b89f-e92ce3e92261 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.514646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c8881-6beb-431f-b89f-e92ce3e92261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.543694 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b87c8881-6beb-431f-b89f-e92ce3e92261 None None] MFA Rules not processed for user `c37074ab35df4e99ae947b45692d69ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:17.545110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b87c8881-6beb-431f-b89f-e92ce3e92261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:17.553231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:17.615273 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1217/2424] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:17.619667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef69107-fdf8-4d2e-ad11-f17b0ee1c0b4 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:17.691700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef69107-fdf8-4d2e-ad11-f17b0ee1c0b4 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:17.696709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b0018-1dba-4594-a938-e7562a2af645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:17.697375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b0018-1dba-4594-a938-e7562a2af645 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.697657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b0018-1dba-4594-a938-e7562a2af645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.697934 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b0018-1dba-4594-a938-e7562a2af645 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.698695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b0018-1dba-4594-a938-e7562a2af645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:17.700888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b0018-1dba-4594-a938-e7562a2af645 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:17.716057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:17.732994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1208/2425] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:17 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:17.734067 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c8881-6beb-431f-b89f-e92ce3e92261 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:17.745133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c8881-6beb-431f-b89f-e92ce3e92261 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:17.828700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d27e5-f629-4934-baf8-8fef67675e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:17.829690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d27e5-f629-4934-baf8-8fef67675e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.830025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d27e5-f629-4934-baf8-8fef67675e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.830304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d27e5-f629-4934-baf8-8fef67675e4c admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.831301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d27e5-f629-4934-baf8-8fef67675e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:17.833314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d27e5-f629-4934-baf8-8fef67675e4c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:17.859054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1218/2426] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:17 2022] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:17.862742 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b0018-1dba-4594-a938-e7562a2af645 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:17.879563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b0018-1dba-4594-a938-e7562a2af645 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:17.884588 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45f2ed-fd22-42f6-9005-bf91b4a935a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:17.885273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45f2ed-fd22-42f6-9005-bf91b4a935a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.885563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45f2ed-fd22-42f6-9005-bf91b4a935a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.885841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45f2ed-fd22-42f6-9005-bf91b4a935a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.886606 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45f2ed-fd22-42f6-9005-bf91b4a935a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:17.889464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45f2ed-fd22-42f6-9005-bf91b4a935a0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:17.900477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1209/2427] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:17.904698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d27e5-f629-4934-baf8-8fef67675e4c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:17.918129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d27e5-f629-4934-baf8-8fef67675e4c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:17.925212 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3bab6-bce0-42bf-97c6-f374d8d6f414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:17.925552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3bab6-bce0-42bf-97c6-f374d8d6f414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:17.925829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3bab6-bce0-42bf-97c6-f374d8d6f414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:17.926214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3bab6-bce0-42bf-97c6-f374d8d6f414 admin admin] PATH_INFO: `/v3/projects/6d8afed92ff8404eaef55d83fe4f794c/users/f782153a350f4046bf70c01146481f6c/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:17.946323 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3bab6-bce0-42bf-97c6-f374d8d6f414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8afed92ff8404eaef55d83fe4f794c, user_id=f782153a350f4046bf70c01146481f6c, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:17.951304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3bab6-bce0-42bf-97c6-f374d8d6f414 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:17.971509 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1219/2428] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:17 2022] PUT /identity/v3/projects/6d8afed92ff8404eaef55d83fe4f794c/users/f782153a350f4046bf70c01146481f6c/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:17.975706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45f2ed-fd22-42f6-9005-bf91b4a935a0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:17.991420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45f2ed-fd22-42f6-9005-bf91b4a935a0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:18.124171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62899a0c-9d66-4edc-b950-aa33e3d50b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:18.125922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62899a0c-9d66-4edc-b950-aa33e3d50b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:18.126465 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62899a0c-9d66-4edc-b950-aa33e3d50b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:18.126950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62899a0c-9d66-4edc-b950-aa33e3d50b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:18.128118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62899a0c-9d66-4edc-b950-aa33e3d50b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:18.132402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62899a0c-9d66-4edc-b950-aa33e3d50b84 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:18.145783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1210/2429] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:18.149691 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3bab6-bce0-42bf-97c6-f374d8d6f414 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:18.161317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3bab6-bce0-42bf-97c6-f374d8d6f414 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:18.167680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112510c-54c9-4d43-a33f-d6a9daadaf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:18.169346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112510c-54c9-4d43-a33f-d6a9daadaf30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:18.169630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112510c-54c9-4d43-a33f-d6a9daadaf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:18.170667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112510c-54c9-4d43-a33f-d6a9daadaf30 admin admin] PATH_INFO: `/v3/projects/6d8afed92ff8404eaef55d83fe4f794c/users/f782153a350f4046bf70c01146481f6c/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:18.173792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112510c-54c9-4d43-a33f-d6a9daadaf30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8afed92ff8404eaef55d83fe4f794c, user_id=f782153a350f4046bf70c01146481f6c, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:18.177370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112510c-54c9-4d43-a33f-d6a9daadaf30 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:18.193240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1220/2430] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:18 2022] PUT /identity/v3/projects/6d8afed92ff8404eaef55d83fe4f794c/users/f782153a350f4046bf70c01146481f6c/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:18.206449 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bcf9c-f5db-439d-97c3-c04cbde3ab37 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:18.207301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bcf9c-f5db-439d-97c3-c04cbde3ab37 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:18.207770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bcf9c-f5db-439d-97c3-c04cbde3ab37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:18.255108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-470bcf9c-f5db-439d-97c3-c04cbde3ab37 None None] MFA Rules not processed for user `f782153a350f4046bf70c01146481f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:18.256321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-470bcf9c-f5db-439d-97c3-c04cbde3ab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:18.362189 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1211/2431] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:18.369762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112510c-54c9-4d43-a33f-d6a9daadaf30 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:18.372633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e112510c-54c9-4d43-a33f-d6a9daadaf30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:18.432909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112510c-54c9-4d43-a33f-d6a9daadaf30 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:18.437841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1017d23-79ac-42f3-a490-c0b303775e9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:18.438526 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1017d23-79ac-42f3-a490-c0b303775e9b service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:18.438813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1017d23-79ac-42f3-a490-c0b303775e9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:18.439091 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1017d23-79ac-42f3-a490-c0b303775e9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:18.448575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1017d23-79ac-42f3-a490-c0b303775e9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:18.450719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1017d23-79ac-42f3-a490-c0b303775e9b service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:18.461604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1221/2432] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:18.569576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bcf9c-f5db-439d-97c3-c04cbde3ab37 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:18.582107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bcf9c-f5db-439d-97c3-c04cbde3ab37 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:18.590331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c053-da66-49c3-90c1-d9116e47143e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:18.591346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c053-da66-49c3-90c1-d9116e47143e service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:18.591728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c053-da66-49c3-90c1-d9116e47143e service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:18.592123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c053-da66-49c3-90c1-d9116e47143e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:18.661695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80c053-da66-49c3-90c1-d9116e47143e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:18.663312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80c053-da66-49c3-90c1-d9116e47143e service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:18.675175 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1212/2433] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:21.273547 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1017d23-79ac-42f3-a490-c0b303775e9b service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:21.279765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:21.336667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1017d23-79ac-42f3-a490-c0b303775e9b service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:21.341846 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:21.342750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:21.343034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:21.343309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] PATH_INFO: `/v3/users/c37074ab35df4e99ae947b45692d69ee` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:21.344471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37074ab35df4e99ae947b45692d69ee)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:21.346390 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:21.390973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37074ab35df4e99ae947b45692d69ee'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:21.391563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37074ab35df4e99ae947b45692d69ee'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:21.398183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37074ab35df4e99ae947b45692d69ee'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:21.405338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37074ab35df4e99ae947b45692d69ee'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:21.405986 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37074ab35df4e99ae947b45692d69ee'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:21.423520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1222/2434] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:21 2022] DELETE /identity/v3/users/c37074ab35df4e99ae947b45692d69ee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:21.428160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8951-b710-428f-a463-7b57385bbfc6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:21.428633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8951-b710-428f-a463-7b57385bbfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:21.428762 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8951-b710-428f-a463-7b57385bbfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:21.434662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:21.448133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2a5e8951-b710-428f-a463-7b57385bbfc6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:21.449333 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2a5e8951-b710-428f-a463-7b57385bbfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:21.507192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1213/2435] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:21.516976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:21.518372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:21.576577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fe8ce-2961-474e-8a48-51c803fa2753 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:21.580512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef12ca-3ac6-46cd-bf87-ace2fcbc9be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:21.581158 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef12ca-3ac6-46cd-bf87-ace2fcbc9be2 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:21.581447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef12ca-3ac6-46cd-bf87-ace2fcbc9be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:21.581727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef12ca-3ac6-46cd-bf87-ace2fcbc9be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:21.591145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef12ca-3ac6-46cd-bf87-ace2fcbc9be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:21.592554 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef12ca-3ac6-46cd-bf87-ace2fcbc9be2 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:21.601910 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1223/2436] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:21.867436 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e8951-b710-428f-a463-7b57385bbfc6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:21.868859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2a5e8951-b710-428f-a463-7b57385bbfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:21.881625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e8951-b710-428f-a463-7b57385bbfc6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:21.886510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:21.887636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:21.887924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:21.888308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] PATH_INFO: `/v3/projects/25844e07a34c4b34925d912e4dd8905e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:21.890289 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=25844e07a34c4b34925d912e4dd8905e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:21.892972 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:21.960306 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25844e07a34c4b34925d912e4dd8905e', 'request_id': 'req-783270ed-67ca-4be7-a999-0127bcdcf26b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:21.967330 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25844e07a34c4b34925d912e4dd8905e', 'request_id': 'req-783270ed-67ca-4be7-a999-0127bcdcf26b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:21.978295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25844e07a34c4b34925d912e4dd8905e', 'request_id': 'req-783270ed-67ca-4be7-a999-0127bcdcf26b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:21.996324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] The token cache is being invalidate because project 25844e07a34c4b34925d912e4dd8905e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:21.996673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:21.997432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:21.999105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1214/2437] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:21 2022] DELETE /identity/v3/projects/25844e07a34c4b34925d912e4dd8905e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:22.003288 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef12ca-3ac6-46cd-bf87-ace2fcbc9be2 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:22.015210 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef12ca-3ac6-46cd-bf87-ace2fcbc9be2 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:22.043651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:22.091071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347e4e7-9ab2-4514-a6f7-6c1c14e36222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:22.091833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347e4e7-9ab2-4514-a6f7-6c1c14e36222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:22.092122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347e4e7-9ab2-4514-a6f7-6c1c14e36222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:22.092391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347e4e7-9ab2-4514-a6f7-6c1c14e36222 admin admin] PATH_INFO: `/v3/users/f782153a350f4046bf70c01146481f6c` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:22.093601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347e4e7-9ab2-4514-a6f7-6c1c14e36222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f782153a350f4046bf70c01146481f6c)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:22.095697 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347e4e7-9ab2-4514-a6f7-6c1c14e36222 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:22.157978 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6347e4e7-9ab2-4514-a6f7-6c1c14e36222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f782153a350f4046bf70c01146481f6c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:22.158694 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6347e4e7-9ab2-4514-a6f7-6c1c14e36222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f782153a350f4046bf70c01146481f6c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:22.166776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6347e4e7-9ab2-4514-a6f7-6c1c14e36222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f782153a350f4046bf70c01146481f6c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:22.175174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6347e4e7-9ab2-4514-a6f7-6c1c14e36222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f782153a350f4046bf70c01146481f6c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:22.175962 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6347e4e7-9ab2-4514-a6f7-6c1c14e36222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f782153a350f4046bf70c01146481f6c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:22.196133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1224/2438] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:22 2022] DELETE /identity/v3/users/f782153a350f4046bf70c01146481f6c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:22.483538 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:22.485017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:22.498423 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783270ed-67ca-4be7-a999-0127bcdcf26b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:22.556096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5aed-1028-42e3-842d-bdff61243d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:22.556952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5aed-1028-42e3-842d-bdff61243d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:22.557236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5aed-1028-42e3-842d-bdff61243d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:22.557509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5aed-1028-42e3-842d-bdff61243d09 admin admin] PATH_INFO: `/v3/projects/6d8afed92ff8404eaef55d83fe4f794c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:22.558730 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c5aed-1028-42e3-842d-bdff61243d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8afed92ff8404eaef55d83fe4f794c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:22.560648 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c5aed-1028-42e3-842d-bdff61243d09 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:22.592650 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:22.609078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a68c5aed-1028-42e3-842d-bdff61243d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8afed92ff8404eaef55d83fe4f794c', 'request_id': 'req-a68c5aed-1028-42e3-842d-bdff61243d09'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:22.616286 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a68c5aed-1028-42e3-842d-bdff61243d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8afed92ff8404eaef55d83fe4f794c', 'request_id': 'req-a68c5aed-1028-42e3-842d-bdff61243d09'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:22.622784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a68c5aed-1028-42e3-842d-bdff61243d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8afed92ff8404eaef55d83fe4f794c', 'request_id': 'req-a68c5aed-1028-42e3-842d-bdff61243d09'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:22.634953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a68c5aed-1028-42e3-842d-bdff61243d09 admin admin] The token cache is being invalidate because project 6d8afed92ff8404eaef55d83fe4f794c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:22.635244 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a68c5aed-1028-42e3-842d-bdff61243d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:22.635911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a68c5aed-1028-42e3-842d-bdff61243d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:22.638280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1215/2439] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:22 2022] DELETE /identity/v3/projects/6d8afed92ff8404eaef55d83fe4f794c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:22.643451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9c4d2-fe55-42ab-b4c3-c7912759ca82 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:22.643909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9c4d2-fe55-42ab-b4c3-c7912759ca82 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:22.644021 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9c4d2-fe55-42ab-b4c3-c7912759ca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:22.662570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-12d9c4d2-fe55-42ab-b4c3-c7912759ca82 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:22.663767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-12d9c4d2-fe55-42ab-b4c3-c7912759ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:22.722866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1225/2440] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:22.731037 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a339f-3721-4c0a-a8a7-90b90d5d88b9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:22.731483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a339f-3721-4c0a-a8a7-90b90d5d88b9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:22.731862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a339f-3721-4c0a-a8a7-90b90d5d88b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:22.750315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f79a339f-3721-4c0a-a8a7-90b90d5d88b9 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:22.751530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f79a339f-3721-4c0a-a8a7-90b90d5d88b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:22.759222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1216/2441] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:22.763857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9c4d2-fe55-42ab-b4c3-c7912759ca82 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:22.773635 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9c4d2-fe55-42ab-b4c3-c7912759ca82 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:22.779113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7940f-d242-4393-b654-5211d0df6ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:22.779780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7940f-d242-4393-b654-5211d0df6ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:22.780062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7940f-d242-4393-b654-5211d0df6ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:22.780332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7940f-d242-4393-b654-5211d0df6ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:22.781053 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7940f-d242-4393-b654-5211d0df6ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:22.781355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7940f-d242-4393-b654-5211d0df6ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:22.782957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7940f-d242-4393-b654-5211d0df6ee3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:22.794985 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1226/2442] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:15:22.799163 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a339f-3721-4c0a-a8a7-90b90d5d88b9 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:22.808160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a339f-3721-4c0a-a8a7-90b90d5d88b9 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:22.813526 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a7bd-8e94-4d3d-9339-8c0cf7962b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:22.814166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a7bd-8e94-4d3d-9339-8c0cf7962b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:22.814489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a7bd-8e94-4d3d-9339-8c0cf7962b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:22.814769 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a7bd-8e94-4d3d-9339-8c0cf7962b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:22.815458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9a7bd-8e94-4d3d-9339-8c0cf7962b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:22.817374 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9a7bd-8e94-4d3d-9339-8c0cf7962b01 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:22.843664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1217/2443] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:22 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:22.847733 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7940f-d242-4393-b654-5211d0df6ee3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:22.857950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7940f-d242-4393-b654-5211d0df6ee3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:22.890072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:22.919418 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afa17e-1030-4594-95c1-f097173b21fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:22.920098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afa17e-1030-4594-95c1-f097173b21fa admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:22.920386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afa17e-1030-4594-95c1-f097173b21fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:22.920669 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afa17e-1030-4594-95c1-f097173b21fa admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:22.921361 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afa17e-1030-4594-95c1-f097173b21fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:22.923308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afa17e-1030-4594-95c1-f097173b21fa admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:22.942544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1227/2444] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:22 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:22.946858 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a7bd-8e94-4d3d-9339-8c0cf7962b01 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:22.958051 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a7bd-8e94-4d3d-9339-8c0cf7962b01 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:22.962613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987b4da-7930-42be-8f08-6862ea4efcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:22.963264 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987b4da-7930-42be-8f08-6862ea4efcce admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:22.963551 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987b4da-7930-42be-8f08-6862ea4efcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:22.963827 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987b4da-7930-42be-8f08-6862ea4efcce admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:22.964576 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987b4da-7930-42be-8f08-6862ea4efcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:22.966383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987b4da-7930-42be-8f08-6862ea4efcce admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:22.976384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1218/2445] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:22.980238 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afa17e-1030-4594-95c1-f097173b21fa admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:22.990464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afa17e-1030-4594-95c1-f097173b21fa admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:22.995061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51780763-51f3-4fb3-92d1-77ff86733ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:22.995720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51780763-51f3-4fb3-92d1-77ff86733ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:22.996008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51780763-51f3-4fb3-92d1-77ff86733ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:22.996799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51780763-51f3-4fb3-92d1-77ff86733ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:22.997725 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51780763-51f3-4fb3-92d1-77ff86733ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:22.999344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51780763-51f3-4fb3-92d1-77ff86733ed5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:23.009232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1228/2446] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:23.013770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987b4da-7930-42be-8f08-6862ea4efcce admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:23.023558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987b4da-7930-42be-8f08-6862ea4efcce admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:23.028152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e2f0-c448-4fae-806a-24afd36bbcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:23.029013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e2f0-c448-4fae-806a-24afd36bbcac admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:23.029297 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e2f0-c448-4fae-806a-24afd36bbcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:23.029573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e2f0-c448-4fae-806a-24afd36bbcac admin admin] PATH_INFO: `/v3/projects/9fcb414adaf24e1f97ede0f37683832f/users/fd53a5d3160f410c9936ef424e184a63/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:23.043898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76e2f0-c448-4fae-806a-24afd36bbcac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fcb414adaf24e1f97ede0f37683832f, user_id=fd53a5d3160f410c9936ef424e184a63, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:23.046598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76e2f0-c448-4fae-806a-24afd36bbcac admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:23.058647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1219/2447] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:23 2022] PUT /identity/v3/projects/9fcb414adaf24e1f97ede0f37683832f/users/fd53a5d3160f410c9936ef424e184a63/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:23.069285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc6bcf-2c06-4a6c-8bbe-2c6e715adbb7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:23.069580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc6bcf-2c06-4a6c-8bbe-2c6e715adbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:23.069862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc6bcf-2c06-4a6c-8bbe-2c6e715adbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:23.096435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a3cc6bcf-2c06-4a6c-8bbe-2c6e715adbb7 None None] MFA Rules not processed for user `fd53a5d3160f410c9936ef424e184a63`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:23.097624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a3cc6bcf-2c06-4a6c-8bbe-2c6e715adbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:23.160379 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1229/2448] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:23.164815 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e2f0-c448-4fae-806a-24afd36bbcac admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:23.234616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e2f0-c448-4fae-806a-24afd36bbcac admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:23.236986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74b9c4-ea4b-4bc6-90ba-558eeeaebb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:23.237737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74b9c4-ea4b-4bc6-90ba-558eeeaebb8e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:23.238034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74b9c4-ea4b-4bc6-90ba-558eeeaebb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:23.238313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74b9c4-ea4b-4bc6-90ba-558eeeaebb8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:23.239051 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74b9c4-ea4b-4bc6-90ba-558eeeaebb8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:23.240963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74b9c4-ea4b-4bc6-90ba-558eeeaebb8e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:23.272362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1220/2449] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:23 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:23.273545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc6bcf-2c06-4a6c-8bbe-2c6e715adbb7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:23.277347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74b9c4-ea4b-4bc6-90ba-558eeeaebb8e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:23.279524 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cb74b9c4-ea4b-4bc6-90ba-558eeeaebb8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:23.284994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc6bcf-2c06-4a6c-8bbe-2c6e715adbb7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:23.328926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:23.348773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a1c60-efe5-4aff-8822-6b3f46f6e453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:23.349453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a1c60-efe5-4aff-8822-6b3f46f6e453 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:23.349590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74b9c4-ea4b-4bc6-90ba-558eeeaebb8e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:23.349739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a1c60-efe5-4aff-8822-6b3f46f6e453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:23.350015 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a1c60-efe5-4aff-8822-6b3f46f6e453 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:23.350811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a1c60-efe5-4aff-8822-6b3f46f6e453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:23.352747 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a1c60-efe5-4aff-8822-6b3f46f6e453 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:23.353467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4c392-111a-4810-90f7-3763e6d05fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:23.354118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4c392-111a-4810-90f7-3763e6d05fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:23.354435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4c392-111a-4810-90f7-3763e6d05fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:23.354720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4c392-111a-4810-90f7-3763e6d05fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:23.357331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e7c4c392-111a-4810-90f7-3763e6d05fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:23.372532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4c392-111a-4810-90f7-3763e6d05fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:23.374307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4c392-111a-4810-90f7-3763e6d05fb5 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:23.377465 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1230/2450] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:23 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:23.381508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a1c60-efe5-4aff-8822-6b3f46f6e453 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:23.390609 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1221/2451] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:23.392913 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a1c60-efe5-4aff-8822-6b3f46f6e453 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:23.398461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26637856-0f11-429b-9244-cf03e6b5bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:23.399581 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26637856-0f11-429b-9244-cf03e6b5bb35 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:23.399872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26637856-0f11-429b-9244-cf03e6b5bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:23.400147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26637856-0f11-429b-9244-cf03e6b5bb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:23.400886 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26637856-0f11-429b-9244-cf03e6b5bb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:23.402531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26637856-0f11-429b-9244-cf03e6b5bb35 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:23.416518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1231/2452] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:23.421056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4c392-111a-4810-90f7-3763e6d05fb5 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:23.438594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4c392-111a-4810-90f7-3763e6d05fb5 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:23.438594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254f66c-af22-4836-9759-679c6b0e265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:23.438594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f66c-af22-4836-9759-679c6b0e265d admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:23.438594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f66c-af22-4836-9759-679c6b0e265d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:23.438929 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f66c-af22-4836-9759-679c6b0e265d admin admin] PATH_INFO: `/v3/projects/2a9281a8453a44c1aaf04ebd936e3794/users/43910ef81b574f58a47263c622fb18b0/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:23.457167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254f66c-af22-4836-9759-679c6b0e265d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9281a8453a44c1aaf04ebd936e3794, user_id=43910ef81b574f58a47263c622fb18b0, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:23.459922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254f66c-af22-4836-9759-679c6b0e265d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:23.477223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1222/2453] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:23 2022] PUT /identity/v3/projects/2a9281a8453a44c1aaf04ebd936e3794/users/43910ef81b574f58a47263c622fb18b0/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:23.481742 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26637856-0f11-429b-9244-cf03e6b5bb35 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:23.501029 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26637856-0f11-429b-9244-cf03e6b5bb35 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:23.530955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:23.584583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf108df6-ecaa-4d06-b40c-56a293be82c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:23.585327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf108df6-ecaa-4d06-b40c-56a293be82c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:23.585695 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf108df6-ecaa-4d06-b40c-56a293be82c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:23.586023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf108df6-ecaa-4d06-b40c-56a293be82c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:23.586871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf108df6-ecaa-4d06-b40c-56a293be82c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:23.588518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf108df6-ecaa-4d06-b40c-56a293be82c1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:23.599848 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1232/2454] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:23.604006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254f66c-af22-4836-9759-679c6b0e265d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:23.615589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254f66c-af22-4836-9759-679c6b0e265d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:23.620872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13da0d-82f6-44ff-a182-317f61ee6d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:23.621980 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13da0d-82f6-44ff-a182-317f61ee6d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:23.622263 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13da0d-82f6-44ff-a182-317f61ee6d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:23.622666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13da0d-82f6-44ff-a182-317f61ee6d21 admin admin] PATH_INFO: `/v3/projects/2a9281a8453a44c1aaf04ebd936e3794/users/43910ef81b574f58a47263c622fb18b0/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:23.624709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13da0d-82f6-44ff-a182-317f61ee6d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9281a8453a44c1aaf04ebd936e3794, user_id=43910ef81b574f58a47263c622fb18b0, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:23.627405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13da0d-82f6-44ff-a182-317f61ee6d21 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:23.639738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1223/2455] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:23 2022] PUT /identity/v3/projects/2a9281a8453a44c1aaf04ebd936e3794/users/43910ef81b574f58a47263c622fb18b0/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:23.650843 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82ee56-9a0e-48e4-a43b-c88b18b04b10 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:23.651692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82ee56-9a0e-48e4-a43b-c88b18b04b10 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:23.652150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82ee56-9a0e-48e4-a43b-c88b18b04b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:23.686653 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ac82ee56-9a0e-48e4-a43b-c88b18b04b10 None None] MFA Rules not processed for user `43910ef81b574f58a47263c622fb18b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:23.687878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ac82ee56-9a0e-48e4-a43b-c88b18b04b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:23.772978 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1233/2456] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:23.785822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13da0d-82f6-44ff-a182-317f61ee6d21 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:23.787805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5a13da0d-82f6-44ff-a182-317f61ee6d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:23.851650 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13da0d-82f6-44ff-a182-317f61ee6d21 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:23.855399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09367d6-7c91-4716-878e-a3d8a4cbe658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:23.856182 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09367d6-7c91-4716-878e-a3d8a4cbe658 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:23.856564 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09367d6-7c91-4716-878e-a3d8a4cbe658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:23.856854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09367d6-7c91-4716-878e-a3d8a4cbe658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:23.866166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09367d6-7c91-4716-878e-a3d8a4cbe658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:23.867961 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09367d6-7c91-4716-878e-a3d8a4cbe658 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:23.878798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1224/2457] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:23.973447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82ee56-9a0e-48e4-a43b-c88b18b04b10 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:23.984161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82ee56-9a0e-48e4-a43b-c88b18b04b10 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:23.987905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32549a8b-2578-4a48-8b22-3cd81ebf8865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:23.988603 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32549a8b-2578-4a48-8b22-3cd81ebf8865 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:23.988898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32549a8b-2578-4a48-8b22-3cd81ebf8865 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:23.989180 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32549a8b-2578-4a48-8b22-3cd81ebf8865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:24.059481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32549a8b-2578-4a48-8b22-3cd81ebf8865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:24.060887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32549a8b-2578-4a48-8b22-3cd81ebf8865 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:24.071474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1234/2458] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:24.350431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09367d6-7c91-4716-878e-a3d8a4cbe658 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:24.413445 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09367d6-7c91-4716-878e-a3d8a4cbe658 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:24.418002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:24.418985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:24.419308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:24.419653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] PATH_INFO: `/v3/users/fd53a5d3160f410c9936ef424e184a63` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:24.421020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd53a5d3160f410c9936ef424e184a63)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:24.423144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:24.474071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd53a5d3160f410c9936ef424e184a63'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:24.475242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:24.489299 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd53a5d3160f410c9936ef424e184a63'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:24.490034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd53a5d3160f410c9936ef424e184a63'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:24.498929 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd53a5d3160f410c9936ef424e184a63'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:24.499537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd53a5d3160f410c9936ef424e184a63'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:24.511924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1225/2459] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:24 2022] DELETE /identity/v3/users/fd53a5d3160f410c9936ef424e184a63 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:24.516604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae56b1-fc13-42d0-b2b5-80fae3b1c522 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:24.516891 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae56b1-fc13-42d0-b2b5-80fae3b1c522 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:24.517166 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae56b1-fc13-42d0-b2b5-80fae3b1c522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:24.535969 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-69ae56b1-fc13-42d0-b2b5-80fae3b1c522 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:24.537167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-69ae56b1-fc13-42d0-b2b5-80fae3b1c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:24.572925 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:24.603031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1235/2460] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:24.613818 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:24.615341 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:24.679740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9da1-a252-45a6-84af-a5be37d862cd admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:24.683436 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7df1fa-0649-4410-91c2-cab2d6366257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:24.684142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7df1fa-0649-4410-91c2-cab2d6366257 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:24.684428 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7df1fa-0649-4410-91c2-cab2d6366257 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:24.684778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7df1fa-0649-4410-91c2-cab2d6366257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:24.696226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7df1fa-0649-4410-91c2-cab2d6366257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:24.697823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7df1fa-0649-4410-91c2-cab2d6366257 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:24.709926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1226/2461] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:25.108186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae56b1-fc13-42d0-b2b5-80fae3b1c522 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:25.109900 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-69ae56b1-fc13-42d0-b2b5-80fae3b1c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:25.122949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae56b1-fc13-42d0-b2b5-80fae3b1c522 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:25.127555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae7dea-1f3e-4573-bb5f-2511721f7796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:25.128427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae7dea-1f3e-4573-bb5f-2511721f7796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:25.128708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae7dea-1f3e-4573-bb5f-2511721f7796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:25.128983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae7dea-1f3e-4573-bb5f-2511721f7796 admin admin] PATH_INFO: `/v3/users/7f18cfd4b8d84e94bc9ab488b2af3ccf` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:25.130190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae7dea-1f3e-4573-bb5f-2511721f7796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f18cfd4b8d84e94bc9ab488b2af3ccf)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:25.132272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae7dea-1f3e-4573-bb5f-2511721f7796 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:25.186807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5dae7dea-1f3e-4573-bb5f-2511721f7796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f18cfd4b8d84e94bc9ab488b2af3ccf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.187600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5dae7dea-1f3e-4573-bb5f-2511721f7796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f18cfd4b8d84e94bc9ab488b2af3ccf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.196796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7df1fa-0649-4410-91c2-cab2d6366257 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:25.198298 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5dae7dea-1f3e-4573-bb5f-2511721f7796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f18cfd4b8d84e94bc9ab488b2af3ccf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.198460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8a7df1fa-0649-4410-91c2-cab2d6366257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:25.208278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5dae7dea-1f3e-4573-bb5f-2511721f7796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f18cfd4b8d84e94bc9ab488b2af3ccf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.209088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5dae7dea-1f3e-4573-bb5f-2511721f7796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f18cfd4b8d84e94bc9ab488b2af3ccf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.226604 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7df1fa-0649-4410-91c2-cab2d6366257 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:25.236262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:25.238677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:25.238836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1236/2462] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:25 2022] DELETE /identity/v3/users/7f18cfd4b8d84e94bc9ab488b2af3ccf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:25.239105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:25.239447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] PATH_INFO: `/v3/projects/9fcb414adaf24e1f97ede0f37683832f` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:25.240464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d97c0-2b4c-4510-a8ab-03e278996df1 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:25.240833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d97c0-2b4c-4510-a8ab-03e278996df1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:25.241005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fcb414adaf24e1f97ede0f37683832f)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:25.241253 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d97c0-2b4c-4510-a8ab-03e278996df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:25.243643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:25.262406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-336d97c0-2b4c-4510-a8ab-03e278996df1 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:25.263540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-336d97c0-2b4c-4510-a8ab-03e278996df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:25.301755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fcb414adaf24e1f97ede0f37683832f', 'request_id': 'req-67d43e05-d4bb-477e-8e24-4741271636e4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.308504 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fcb414adaf24e1f97ede0f37683832f', 'request_id': 'req-67d43e05-d4bb-477e-8e24-4741271636e4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.315521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fcb414adaf24e1f97ede0f37683832f', 'request_id': 'req-67d43e05-d4bb-477e-8e24-4741271636e4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.344451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] The token cache is being invalidate because project 9fcb414adaf24e1f97ede0f37683832f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:25.344939 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.346426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.347545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1237/2463] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:25.349681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1227/2464] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:25 2022] DELETE /identity/v3/projects/9fcb414adaf24e1f97ede0f37683832f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:25.356314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d97c0-2b4c-4510-a8ab-03e278996df1 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:25.358159 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-336d97c0-2b4c-4510-a8ab-03e278996df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:25.362400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:25.365066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:25.373724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d97c0-2b4c-4510-a8ab-03e278996df1 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:25.456543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d43e05-d4bb-477e-8e24-4741271636e4 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:25.460695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5596a-4034-430d-aa82-b6c71a4f57f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:25.461482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5596a-4034-430d-aa82-b6c71a4f57f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:25.461870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5596a-4034-430d-aa82-b6c71a4f57f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:25.462451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5596a-4034-430d-aa82-b6c71a4f57f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:25.465125 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-07b5596a-4034-430d-aa82-b6c71a4f57f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:25.470685 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:25.472335 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:25.496580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:25.497741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:25.498257 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:25.498803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] PATH_INFO: `/v3/users/43910ef81b574f58a47263c622fb18b0` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:25.500264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43910ef81b574f58a47263c622fb18b0)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:25.502411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:25.571944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43910ef81b574f58a47263c622fb18b0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.573796 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43910ef81b574f58a47263c622fb18b0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.583244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43910ef81b574f58a47263c622fb18b0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.587051 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5596a-4034-430d-aa82-b6c71a4f57f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:25.589013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5596a-4034-430d-aa82-b6c71a4f57f9 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:25.592959 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43910ef81b574f58a47263c622fb18b0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.593786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43910ef81b574f58a47263c622fb18b0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:25.601724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1228/2465] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:25.630003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1238/2466] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:25 2022] DELETE /identity/v3/users/43910ef81b574f58a47263c622fb18b0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:25.951740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5596a-4034-430d-aa82-b6c71a4f57f9 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:25.953783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-07b5596a-4034-430d-aa82-b6c71a4f57f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:25.973344 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5596a-4034-430d-aa82-b6c71a4f57f9 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:26.044913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:26.045777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:26.046058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:26.046329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] PATH_INFO: `/v3/projects/669e517171b047a2903715000ab8bdf2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:26.047603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] RBAC: Authorizing `identity:delete_project(project_id=669e517171b047a2903715000ab8bdf2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:26.049511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:26.104068 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669e517171b047a2903715000ab8bdf2', 'request_id': 'req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.110796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669e517171b047a2903715000ab8bdf2', 'request_id': 'req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.117991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669e517171b047a2903715000ab8bdf2', 'request_id': 'req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.134654 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] The token cache is being invalidate because project 669e517171b047a2903715000ab8bdf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:26.134955 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.135512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.137949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1229/2467] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:25 2022] DELETE /identity/v3/projects/669e517171b047a2903715000ab8bdf2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:26.141929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:26.143551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:26.156545 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02afb1f-45ee-40c6-bbd2-37ccfd953137 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:26.218751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112387d-2df2-4a46-bff7-65e74485102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:26.219638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112387d-2df2-4a46-bff7-65e74485102f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:26.219921 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112387d-2df2-4a46-bff7-65e74485102f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:26.220196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112387d-2df2-4a46-bff7-65e74485102f admin admin] PATH_INFO: `/v3/users/ac4d78dedcf74a479290fcdf5e4a0e53` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:26.221500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112387d-2df2-4a46-bff7-65e74485102f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4d78dedcf74a479290fcdf5e4a0e53)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:26.223786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112387d-2df2-4a46-bff7-65e74485102f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:26.255252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:26.257573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:26.276885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e37c7-8174-4bff-853f-bbeb5aa6a2de admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:26.291024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b112387d-2df2-4a46-bff7-65e74485102f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4d78dedcf74a479290fcdf5e4a0e53'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.291880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b112387d-2df2-4a46-bff7-65e74485102f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4d78dedcf74a479290fcdf5e4a0e53'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.301657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b112387d-2df2-4a46-bff7-65e74485102f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4d78dedcf74a479290fcdf5e4a0e53'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.306186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dc9eb-32c8-4cce-bba0-13414c485ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:26.310340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dc9eb-32c8-4cce-bba0-13414c485ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:26.310892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dc9eb-32c8-4cce-bba0-13414c485ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:26.311444 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dc9eb-32c8-4cce-bba0-13414c485ae1 admin admin] PATH_INFO: `/v3/projects/2a9281a8453a44c1aaf04ebd936e3794` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:26.312911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dc9eb-32c8-4cce-bba0-13414c485ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9281a8453a44c1aaf04ebd936e3794)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:26.315191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dc9eb-32c8-4cce-bba0-13414c485ae1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:26.323535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b112387d-2df2-4a46-bff7-65e74485102f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4d78dedcf74a479290fcdf5e4a0e53'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.324835 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b112387d-2df2-4a46-bff7-65e74485102f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4d78dedcf74a479290fcdf5e4a0e53'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.337431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:26.351716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1239/2468] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:26 2022] DELETE /identity/v3/users/ac4d78dedcf74a479290fcdf5e4a0e53 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:26.370463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:26.393895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d24dc9eb-32c8-4cce-bba0-13414c485ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9281a8453a44c1aaf04ebd936e3794', 'request_id': 'req-d24dc9eb-32c8-4cce-bba0-13414c485ae1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.399459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d24dc9eb-32c8-4cce-bba0-13414c485ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9281a8453a44c1aaf04ebd936e3794', 'request_id': 'req-d24dc9eb-32c8-4cce-bba0-13414c485ae1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.408482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d24dc9eb-32c8-4cce-bba0-13414c485ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9281a8453a44c1aaf04ebd936e3794', 'request_id': 'req-d24dc9eb-32c8-4cce-bba0-13414c485ae1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.427953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d24dc9eb-32c8-4cce-bba0-13414c485ae1 admin admin] The token cache is being invalidate because project 2a9281a8453a44c1aaf04ebd936e3794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:26.428251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d24dc9eb-32c8-4cce-bba0-13414c485ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.428893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d24dc9eb-32c8-4cce-bba0-13414c485ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:26.430463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1230/2469] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:26 2022] DELETE /identity/v3/projects/2a9281a8453a44c1aaf04ebd936e3794 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:26.435567 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488bb3-bf15-4488-9220-79a295b46b4c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:26.436141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488bb3-bf15-4488-9220-79a295b46b4c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:26.436598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488bb3-bf15-4488-9220-79a295b46b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:26.457286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-af488bb3-bf15-4488-9220-79a295b46b4c None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:26.458573 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-af488bb3-bf15-4488-9220-79a295b46b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:26.528287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1240/2470] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:26.536972 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d98349-716a-49f8-9be8-c5ac824f5f27 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:26.537235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d98349-716a-49f8-9be8-c5ac824f5f27 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:26.537598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d98349-716a-49f8-9be8-c5ac824f5f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:26.558459 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-23d98349-716a-49f8-9be8-c5ac824f5f27 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:26.560968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-23d98349-716a-49f8-9be8-c5ac824f5f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:26.572805 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1231/2471] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:26.578074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af488bb3-bf15-4488-9220-79a295b46b4c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:26.589304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af488bb3-bf15-4488-9220-79a295b46b4c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:26.594707 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637562e-235d-4193-8852-43bab61d2c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:26.595461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637562e-235d-4193-8852-43bab61d2c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:26.595813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637562e-235d-4193-8852-43bab61d2c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:26.596164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637562e-235d-4193-8852-43bab61d2c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:26.597653 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637562e-235d-4193-8852-43bab61d2c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:26.597864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637562e-235d-4193-8852-43bab61d2c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:26.599583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637562e-235d-4193-8852-43bab61d2c61 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:26.617403 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1241/2472] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:26.619519 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d98349-716a-49f8-9be8-c5ac824f5f27 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:26.631244 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d98349-716a-49f8-9be8-c5ac824f5f27 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:26.648871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5fc2-b5a3-463f-bff6-2f99712b4d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:26.649575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5fc2-b5a3-463f-bff6-2f99712b4d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:26.649870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5fc2-b5a3-463f-bff6-2f99712b4d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:26.650835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5fc2-b5a3-463f-bff6-2f99712b4d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:26.650835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac5fc2-b5a3-463f-bff6-2f99712b4d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:26.653052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac5fc2-b5a3-463f-bff6-2f99712b4d7f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:26.687794 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1232/2473] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:26 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:26.688948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637562e-235d-4193-8852-43bab61d2c61 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:26.700490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637562e-235d-4193-8852-43bab61d2c61 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:26.783221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5fc2-b5a3-463f-bff6-2f99712b4d7f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:26.786410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-68ac5fc2-b5a3-463f-bff6-2f99712b4d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:26.802142 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2da54-ec21-4f0e-ac84-00a7e238d935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:26.803526 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2da54-ec21-4f0e-ac84-00a7e238d935 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:26.803526 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2da54-ec21-4f0e-ac84-00a7e238d935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:26.803751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2da54-ec21-4f0e-ac84-00a7e238d935 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:26.804715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2da54-ec21-4f0e-ac84-00a7e238d935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:26.807663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2da54-ec21-4f0e-ac84-00a7e238d935 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:26.859716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1242/2474] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:26 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:26.861202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2da54-ec21-4f0e-ac84-00a7e238d935 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:26.874692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2da54-ec21-4f0e-ac84-00a7e238d935 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:26.884179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5fc2-b5a3-463f-bff6-2f99712b4d7f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:26.885176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7012b21-f5c0-457d-a2eb-5313a9ecda65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:26.886171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012b21-f5c0-457d-a2eb-5313a9ecda65 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:26.886558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012b21-f5c0-457d-a2eb-5313a9ecda65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:26.887850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012b21-f5c0-457d-a2eb-5313a9ecda65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:26.888974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7012b21-f5c0-457d-a2eb-5313a9ecda65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:26.891025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd00e3-423a-456d-be05-1a86274d5379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:26.891177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7012b21-f5c0-457d-a2eb-5313a9ecda65 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:26.892084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd00e3-423a-456d-be05-1a86274d5379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:26.892427 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd00e3-423a-456d-be05-1a86274d5379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:26.892772 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd00e3-423a-456d-be05-1a86274d5379 admin admin] PATH_INFO: `/v3/projects/a31b60c3795c457eaaaad1eb8e8d5247` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:26.895159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd00e3-423a-456d-be05-1a86274d5379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31b60c3795c457eaaaad1eb8e8d5247)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:26.897318 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd00e3-423a-456d-be05-1a86274d5379 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:26.903908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1243/2475] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:26.915279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7012b21-f5c0-457d-a2eb-5313a9ecda65 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:26.929640 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7012b21-f5c0-457d-a2eb-5313a9ecda65 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:26.938470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5110f1e-6dd2-47a1-986d-291f40a17f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:26.939424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5110f1e-6dd2-47a1-986d-291f40a17f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:26.939948 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5110f1e-6dd2-47a1-986d-291f40a17f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:26.940527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5110f1e-6dd2-47a1-986d-291f40a17f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:26.942148 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5110f1e-6dd2-47a1-986d-291f40a17f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:26.943853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5110f1e-6dd2-47a1-986d-291f40a17f5e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:26.962329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1244/2476] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:26.963927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5110f1e-6dd2-47a1-986d-291f40a17f5e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:26.977511 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5110f1e-6dd2-47a1-986d-291f40a17f5e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:26.991764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-37cd00e3-423a-456d-be05-1a86274d5379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31b60c3795c457eaaaad1eb8e8d5247', 'request_id': 'req-37cd00e3-423a-456d-be05-1a86274d5379'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.004338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-37cd00e3-423a-456d-be05-1a86274d5379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31b60c3795c457eaaaad1eb8e8d5247', 'request_id': 'req-37cd00e3-423a-456d-be05-1a86274d5379'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.015397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-37cd00e3-423a-456d-be05-1a86274d5379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31b60c3795c457eaaaad1eb8e8d5247', 'request_id': 'req-37cd00e3-423a-456d-be05-1a86274d5379'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.032982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-37cd00e3-423a-456d-be05-1a86274d5379 admin admin] The token cache is being invalidate because project a31b60c3795c457eaaaad1eb8e8d5247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:27.033301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-37cd00e3-423a-456d-be05-1a86274d5379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.033986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-37cd00e3-423a-456d-be05-1a86274d5379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.035962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1233/2477] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:26 2022] DELETE /identity/v3/projects/a31b60c3795c457eaaaad1eb8e8d5247 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:27.041236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ecb98-8e0a-492e-9d1f-f06f21b936ab None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.041529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ecb98-8e0a-492e-9d1f-f06f21b936ab None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.041982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ecb98-8e0a-492e-9d1f-f06f21b936ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.066550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:27.092542 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-fd6ecb98-8e0a-492e-9d1f-f06f21b936ab None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:27.093935 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fd6ecb98-8e0a-492e-9d1f-f06f21b936ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:27.096297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851a5d3-dae5-4ea7-9233-232df4e5fb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:27.098327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a5d3-dae5-4ea7-9233-232df4e5fb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.098926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a5d3-dae5-4ea7-9233-232df4e5fb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.100372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a5d3-dae5-4ea7-9233-232df4e5fb70 admin admin] PATH_INFO: `/v3/projects/529544ae80bf4c39aa86ac22d4ed0d30/users/5a33a26def77498785e3f3554c2fc80d/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.105108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1234/2478] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:27.115328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486143-59c1-493a-ba06-3ace25a2ba34 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.115833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486143-59c1-493a-ba06-3ace25a2ba34 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.116214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486143-59c1-493a-ba06-3ace25a2ba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.129583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851a5d3-dae5-4ea7-9233-232df4e5fb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529544ae80bf4c39aa86ac22d4ed0d30, user_id=5a33a26def77498785e3f3554c2fc80d, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:27.132825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851a5d3-dae5-4ea7-9233-232df4e5fb70 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:27.140537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-24486143-59c1-493a-ba06-3ace25a2ba34 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:27.142048 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-24486143-59c1-493a-ba06-3ace25a2ba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:27.162551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1245/2479] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:26 2022] PUT /identity/v3/projects/529544ae80bf4c39aa86ac22d4ed0d30/users/5a33a26def77498785e3f3554c2fc80d/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:27.163057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1235/2480] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:27.163172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851a5d3-dae5-4ea7-9233-232df4e5fb70 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:27.164790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c05be-b870-4630-ba76-33947572ee49 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.165083 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c05be-b870-4630-ba76-33947572ee49 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.165370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c05be-b870-4630-ba76-33947572ee49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.177770 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:27.222469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9a8c05be-b870-4630-ba76-33947572ee49 None None] MFA Rules not processed for user `5a33a26def77498785e3f3554c2fc80d`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:27.223874 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9a8c05be-b870-4630-ba76-33947572ee49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:27.294428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851a5d3-dae5-4ea7-9233-232df4e5fb70 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:27.308226 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2afe27-1962-4ff3-b1d0-e7006052aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:27.310146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2afe27-1962-4ff3-b1d0-e7006052aadf admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.310580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2afe27-1962-4ff3-b1d0-e7006052aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.310958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2afe27-1962-4ff3-b1d0-e7006052aadf admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.312075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2afe27-1962-4ff3-b1d0-e7006052aadf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:27.312829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2afe27-1962-4ff3-b1d0-e7006052aadf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:27.315771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2afe27-1962-4ff3-b1d0-e7006052aadf admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:27.335008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1246/2481] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:27.336665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2afe27-1962-4ff3-b1d0-e7006052aadf admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:27.337715 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1236/2482] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:27.351991 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c05be-b870-4630-ba76-33947572ee49 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:27.353236 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2afe27-1962-4ff3-b1d0-e7006052aadf admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:27.353809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9a8c05be-b870-4630-ba76-33947572ee49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:27.360229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac085560-8bfb-4289-b21e-6d5ee97b11eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:27.360958 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac085560-8bfb-4289-b21e-6d5ee97b11eb admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.361379 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac085560-8bfb-4289-b21e-6d5ee97b11eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.361728 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac085560-8bfb-4289-b21e-6d5ee97b11eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.362332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac085560-8bfb-4289-b21e-6d5ee97b11eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:27.364594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac085560-8bfb-4289-b21e-6d5ee97b11eb admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:27.401476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1247/2483] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:27 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:27.406322 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac085560-8bfb-4289-b21e-6d5ee97b11eb admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:27.452423 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c05be-b870-4630-ba76-33947572ee49 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:27.484452 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac085560-8bfb-4289-b21e-6d5ee97b11eb admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:27.490564 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c4c9f-d427-4e7f-aa71-c430d60422ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:27.491542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c4c9f-d427-4e7f-aa71-c430d60422ae admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.491831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c4c9f-d427-4e7f-aa71-c430d60422ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.492112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c4c9f-d427-4e7f-aa71-c430d60422ae admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.493298 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c4c9f-d427-4e7f-aa71-c430d60422ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:27.495160 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c4c9f-d427-4e7f-aa71-c430d60422ae admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:27.518645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08209761-47d7-44c7-8c8f-675c6a9cc178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:27.519421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08209761-47d7-44c7-8c8f-675c6a9cc178 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.519726 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08209761-47d7-44c7-8c8f-675c6a9cc178 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.519945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08209761-47d7-44c7-8c8f-675c6a9cc178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.538456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1248/2484] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:27 2022] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:27.542438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c4c9f-d427-4e7f-aa71-c430d60422ae admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:27.544976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8b5c4c9f-d427-4e7f-aa71-c430d60422ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:27.562177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c4c9f-d427-4e7f-aa71-c430d60422ae admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:27.568819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:27.569720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.570175 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.570680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] PATH_INFO: `/v3/users/ed81799983c143eaa48a6a184c0eaf21` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.572340 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed81799983c143eaa48a6a184c0eaf21)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:27.574416 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:27.588451 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08209761-47d7-44c7-8c8f-675c6a9cc178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:27.590531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08209761-47d7-44c7-8c8f-675c6a9cc178 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:27.600934 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1237/2485] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:15:27.603541 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08209761-47d7-44c7-8c8f-675c6a9cc178 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:27.609178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:27.618396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08209761-47d7-44c7-8c8f-675c6a9cc178 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:27.618816 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:27.628201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04570477-956f-41cb-ba2a-48afb7c32631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:27.629133 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04570477-956f-41cb-ba2a-48afb7c32631 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.629415 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04570477-956f-41cb-ba2a-48afb7c32631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.629693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04570477-956f-41cb-ba2a-48afb7c32631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.630547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04570477-956f-41cb-ba2a-48afb7c32631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:27.632426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04570477-956f-41cb-ba2a-48afb7c32631 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:27.643203 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1238/2486] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:27.643981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed81799983c143eaa48a6a184c0eaf21'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.644113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04570477-956f-41cb-ba2a-48afb7c32631 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:27.644724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed81799983c143eaa48a6a184c0eaf21'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.645700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-04570477-956f-41cb-ba2a-48afb7c32631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:27.653543 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed81799983c143eaa48a6a184c0eaf21'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.659794 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04570477-956f-41cb-ba2a-48afb7c32631 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:27.661930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed81799983c143eaa48a6a184c0eaf21'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.662714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed81799983c143eaa48a6a184c0eaf21'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.664795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:27.665596 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.665881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.666186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] PATH_INFO: `/v3/users/5a33a26def77498785e3f3554c2fc80d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.667406 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a33a26def77498785e3f3554c2fc80d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:27.669526 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:27.680787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1249/2487] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:27 2022] DELETE /identity/v3/users/ed81799983c143eaa48a6a184c0eaf21 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:27.681512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:27.683047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:27.730311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a33a26def77498785e3f3554c2fc80d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.751347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a33a26def77498785e3f3554c2fc80d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.752286 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a33a26def77498785e3f3554c2fc80d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.760022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9d052-50b8-4379-b2fe-19803eb9a58b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:27.761156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a33a26def77498785e3f3554c2fc80d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.762531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a33a26def77498785e3f3554c2fc80d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:27.765728 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd46748-2ee4-46a6-8dd2-07f6de895b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:27.766442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd46748-2ee4-46a6-8dd2-07f6de895b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.766730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd46748-2ee4-46a6-8dd2-07f6de895b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.767008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd46748-2ee4-46a6-8dd2-07f6de895b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.767730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd46748-2ee4-46a6-8dd2-07f6de895b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:27.769329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd46748-2ee4-46a6-8dd2-07f6de895b8d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:27.784213 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1250/2488] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:27.785716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1239/2489] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:27 2022] DELETE /identity/v3/users/5a33a26def77498785e3f3554c2fc80d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:27.790184 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:27.790346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489b99c-9137-4464-896f-f1c966ee366f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.790756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489b99c-9137-4464-896f-f1c966ee366f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.791151 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489b99c-9137-4464-896f-f1c966ee366f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.791656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:27.812570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3489b99c-9137-4464-896f-f1c966ee366f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:27.813779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3489b99c-9137-4464-896f-f1c966ee366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:27.874188 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e6f9a-bd4b-4d7d-a12d-f8fc37679345 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:27.879504 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59e063-dce5-411b-8e22-c539d96e35b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:27.880478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59e063-dce5-411b-8e22-c539d96e35b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:27.880689 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59e063-dce5-411b-8e22-c539d96e35b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:27.881012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59e063-dce5-411b-8e22-c539d96e35b5 admin admin] PATH_INFO: `/v3/projects/e83f3521dbd7435d9e750e49f8f87974/users/c82335c084464c76804b525a88a2c843/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:27.899493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59e063-dce5-411b-8e22-c539d96e35b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83f3521dbd7435d9e750e49f8f87974, user_id=c82335c084464c76804b525a88a2c843, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:27.903528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59e063-dce5-411b-8e22-c539d96e35b5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:27.911643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1251/2490] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:27.915692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489b99c-9137-4464-896f-f1c966ee366f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:27.917181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3489b99c-9137-4464-896f-f1c966ee366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:27.930709 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1240/2491] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:27 2022] PUT /identity/v3/projects/e83f3521dbd7435d9e750e49f8f87974/users/c82335c084464c76804b525a88a2c843/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:27.939474 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59e063-dce5-411b-8e22-c539d96e35b5 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:27.942103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489b99c-9137-4464-896f-f1c966ee366f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:27.942659 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8f59e063-dce5-411b-8e22-c539d96e35b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:27.990829 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:28.012514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be79cd1-216c-4155-b4e0-158e0d5c17b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.013573 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79cd1-216c-4155-b4e0-158e0d5c17b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.013926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79cd1-216c-4155-b4e0-158e0d5c17b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.014272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79cd1-216c-4155-b4e0-158e0d5c17b8 admin admin] PATH_INFO: `/v3/projects/5d074c8378db455baab9f18f191e3b07` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.015345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:28.015789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be79cd1-216c-4155-b4e0-158e0d5c17b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d074c8378db455baab9f18f191e3b07)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.017756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be79cd1-216c-4155-b4e0-158e0d5c17b8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.021199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59e063-dce5-411b-8e22-c539d96e35b5 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.026047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26eac1-1a9d-4478-9b2b-551bec471169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.027029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26eac1-1a9d-4478-9b2b-551bec471169 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.028331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26eac1-1a9d-4478-9b2b-551bec471169 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.028630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26eac1-1a9d-4478-9b2b-551bec471169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.038859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26eac1-1a9d-4478-9b2b-551bec471169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.040297 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26eac1-1a9d-4478-9b2b-551bec471169 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.050648 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1241/2492] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:28.051810 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b11238-057d-4c4a-ac11-eb7fe170064f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.052086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b11238-057d-4c4a-ac11-eb7fe170064f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.052368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b11238-057d-4c4a-ac11-eb7fe170064f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.068505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5be79cd1-216c-4155-b4e0-158e0d5c17b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d074c8378db455baab9f18f191e3b07', 'request_id': 'req-5be79cd1-216c-4155-b4e0-158e0d5c17b8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:28.079936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5be79cd1-216c-4155-b4e0-158e0d5c17b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d074c8378db455baab9f18f191e3b07', 'request_id': 'req-5be79cd1-216c-4155-b4e0-158e0d5c17b8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:28.085809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-60b11238-057d-4c4a-ac11-eb7fe170064f None None] MFA Rules not processed for user `c82335c084464c76804b525a88a2c843`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:28.087471 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-60b11238-057d-4c4a-ac11-eb7fe170064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:28.088573 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5be79cd1-216c-4155-b4e0-158e0d5c17b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d074c8378db455baab9f18f191e3b07', 'request_id': 'req-5be79cd1-216c-4155-b4e0-158e0d5c17b8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:28.103185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5be79cd1-216c-4155-b4e0-158e0d5c17b8 admin admin] The token cache is being invalidate because project 5d074c8378db455baab9f18f191e3b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:28.103697 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5be79cd1-216c-4155-b4e0-158e0d5c17b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:28.104280 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5be79cd1-216c-4155-b4e0-158e0d5c17b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:28.106652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1252/2493] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:27 2022] DELETE /identity/v3/projects/5d074c8378db455baab9f18f191e3b07 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:28.111776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351005-1298-4f2c-bd9a-e720bfd3d600 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.112225 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351005-1298-4f2c-bd9a-e720bfd3d600 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.112576 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351005-1298-4f2c-bd9a-e720bfd3d600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.140300 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-60351005-1298-4f2c-bd9a-e720bfd3d600 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:28.142102 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-60351005-1298-4f2c-bd9a-e720bfd3d600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:28.169967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1242/2494] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:28.174321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b11238-057d-4c4a-ac11-eb7fe170064f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.175763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-60b11238-057d-4c4a-ac11-eb7fe170064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:28.206390 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1253/2495] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:28.214684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cb6ff-8727-4831-961d-435ff9977728 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.220461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cb6ff-8727-4831-961d-435ff9977728 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.220461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cb6ff-8727-4831-961d-435ff9977728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.241683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-db7cb6ff-8727-4831-961d-435ff9977728 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:28.243014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-db7cb6ff-8727-4831-961d-435ff9977728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:28.253454 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1254/2496] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:28.254881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b11238-057d-4c4a-ac11-eb7fe170064f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.257686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cb6ff-8727-4831-961d-435ff9977728 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.260490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856b1a1-2500-4679-ac37-83e60f87788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.261362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856b1a1-2500-4679-ac37-83e60f87788d admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.262378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856b1a1-2500-4679-ac37-83e60f87788d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.262886 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856b1a1-2500-4679-ac37-83e60f87788d admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.263710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856b1a1-2500-4679-ac37-83e60f87788d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.266347 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856b1a1-2500-4679-ac37-83e60f87788d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.268871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cb6ff-8727-4831-961d-435ff9977728 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.274895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157093df-d0d4-48f0-a51d-557126f01229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.275512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157093df-d0d4-48f0-a51d-557126f01229 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.275805 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157093df-d0d4-48f0-a51d-557126f01229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.276088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157093df-d0d4-48f0-a51d-557126f01229 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.276931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157093df-d0d4-48f0-a51d-557126f01229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:28.277333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157093df-d0d4-48f0-a51d-557126f01229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.279670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157093df-d0d4-48f0-a51d-557126f01229 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.293524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1255/2497] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:28.297598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157093df-d0d4-48f0-a51d-557126f01229 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.300726 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1243/2498] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:28 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:28.304943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856b1a1-2500-4679-ac37-83e60f87788d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.307760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157093df-d0d4-48f0-a51d-557126f01229 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.364808 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:28.377825 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe697f-d6ca-4c84-aa12-2bb7ef058d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.379043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe697f-d6ca-4c84-aa12-2bb7ef058d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.379657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe697f-d6ca-4c84-aa12-2bb7ef058d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.380009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe697f-d6ca-4c84-aa12-2bb7ef058d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.380795 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe697f-d6ca-4c84-aa12-2bb7ef058d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.383194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe697f-d6ca-4c84-aa12-2bb7ef058d5c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.388087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856b1a1-2500-4679-ac37-83e60f87788d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.392897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be6930-f305-483d-a424-8c432694a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.393887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be6930-f305-483d-a424-8c432694a1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.393887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be6930-f305-483d-a424-8c432694a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.394588 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be6930-f305-483d-a424-8c432694a1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.395224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be6930-f305-483d-a424-8c432694a1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.397426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be6930-f305-483d-a424-8c432694a1d1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.407456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:28.414302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1256/2499] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:28 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:28.415192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe697f-d6ca-4c84-aa12-2bb7ef058d5c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.416734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2abe697f-d6ca-4c84-aa12-2bb7ef058d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:28.422988 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1244/2500] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:28 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:28.423867 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be6930-f305-483d-a424-8c432694a1d1 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.435644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be6930-f305-483d-a424-8c432694a1d1 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.484744 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe697f-d6ca-4c84-aa12-2bb7ef058d5c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.489686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.490572 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.490853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.491124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] PATH_INFO: `/v3/projects/529544ae80bf4c39aa86ac22d4ed0d30` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.492344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=529544ae80bf4c39aa86ac22d4ed0d30)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.494228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.494610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c48a8-613d-4755-a488-d3cc6031648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.495317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c48a8-613d-4755-a488-d3cc6031648a admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.495685 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c48a8-613d-4755-a488-d3cc6031648a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.495887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c48a8-613d-4755-a488-d3cc6031648a admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.496656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c48a8-613d-4755-a488-d3cc6031648a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.498857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c48a8-613d-4755-a488-d3cc6031648a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.520416 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1245/2501] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:28 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:28.521498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c48a8-613d-4755-a488-d3cc6031648a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.532435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c48a8-613d-4755-a488-d3cc6031648a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.544766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529544ae80bf4c39aa86ac22d4ed0d30', 'request_id': 'req-f68ab967-0132-42ed-9608-6b11fde21fc6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:28.552551 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529544ae80bf4c39aa86ac22d4ed0d30', 'request_id': 'req-f68ab967-0132-42ed-9608-6b11fde21fc6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:28.561081 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529544ae80bf4c39aa86ac22d4ed0d30', 'request_id': 'req-f68ab967-0132-42ed-9608-6b11fde21fc6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:28.573258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] The token cache is being invalidate because project 529544ae80bf4c39aa86ac22d4ed0d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:28.573546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:28.575175 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:28.576982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1257/2502] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:28 2022] DELETE /identity/v3/projects/529544ae80bf4c39aa86ac22d4ed0d30 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:28.577749 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.579061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:28.592176 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa8590-119e-4965-99da-996877e0b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.592859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa8590-119e-4965-99da-996877e0b6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.593148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa8590-119e-4965-99da-996877e0b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.593436 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa8590-119e-4965-99da-996877e0b6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.594172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa8590-119e-4965-99da-996877e0b6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.595838 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa8590-119e-4965-99da-996877e0b6a9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.606090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1246/2503] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:28.609542 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc90af0-6830-4a09-846d-fe6d1d247479 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.609542 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc90af0-6830-4a09-846d-fe6d1d247479 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.609542 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc90af0-6830-4a09-846d-fe6d1d247479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.627571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5dc90af0-6830-4a09-846d-fe6d1d247479 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:28.628921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5dc90af0-6830-4a09-846d-fe6d1d247479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:28.638926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1247/2504] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:28.639873 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc90af0-6830-4a09-846d-fe6d1d247479 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.641315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5dc90af0-6830-4a09-846d-fe6d1d247479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:28.651941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ab967-0132-42ed-9608-6b11fde21fc6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.653951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc90af0-6830-4a09-846d-fe6d1d247479 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.657434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7d3ef-9a54-4ccc-b1fc-c07107f4053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.658110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d3ef-9a54-4ccc-b1fc-c07107f4053b admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.658453 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d3ef-9a54-4ccc-b1fc-c07107f4053b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.658579 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192cb7a-e94b-4882-bf30-841119b9b1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.658720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d3ef-9a54-4ccc-b1fc-c07107f4053b admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.659411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192cb7a-e94b-4882-bf30-841119b9b1f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.659529 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7d3ef-9a54-4ccc-b1fc-c07107f4053b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.659695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192cb7a-e94b-4882-bf30-841119b9b1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.659967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192cb7a-e94b-4882-bf30-841119b9b1f9 admin admin] PATH_INFO: `/v3/projects/0dd0d1e7fc1d45fda7a54b5431cef432/users/766a3a50264f43a18cfadf1b67ae252b/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.661169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7d3ef-9a54-4ccc-b1fc-c07107f4053b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.671991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1258/2505] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:28.673285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bb2ea-0bab-4675-909b-b9f5f9d7f1bc None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.673515 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bb2ea-0bab-4675-909b-b9f5f9d7f1bc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.673797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bb2ea-0bab-4675-909b-b9f5f9d7f1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.675860 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192cb7a-e94b-4882-bf30-841119b9b1f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0d1e7fc1d45fda7a54b5431cef432, user_id=766a3a50264f43a18cfadf1b67ae252b, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.678714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192cb7a-e94b-4882-bf30-841119b9b1f9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.680068 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:28.692640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1248/2506] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:28 2022] PUT /identity/v3/projects/0dd0d1e7fc1d45fda7a54b5431cef432/users/766a3a50264f43a18cfadf1b67ae252b/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:28.693219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192cb7a-e94b-4882-bf30-841119b9b1f9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.695123 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-086bb2ea-0bab-4675-909b-b9f5f9d7f1bc None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:28.697289 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-086bb2ea-0bab-4675-909b-b9f5f9d7f1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:28.744768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:28.758221 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1259/2507] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:28.759314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bb2ea-0bab-4675-909b-b9f5f9d7f1bc None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.760644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192cb7a-e94b-4882-bf30-841119b9b1f9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.766550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7aef1-e3d5-4e24-97b8-fa361e0c0767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.767229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7aef1-e3d5-4e24-97b8-fa361e0c0767 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.767563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7aef1-e3d5-4e24-97b8-fa361e0c0767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.767795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7aef1-e3d5-4e24-97b8-fa361e0c0767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.768593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7aef1-e3d5-4e24-97b8-fa361e0c0767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.769540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bb2ea-0bab-4675-909b-b9f5f9d7f1bc None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.770396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7aef1-e3d5-4e24-97b8-fa361e0c0767 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.774492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993e746-591d-44e3-a0f1-e02b88a120d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.775177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993e746-591d-44e3-a0f1-e02b88a120d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.775461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993e746-591d-44e3-a0f1-e02b88a120d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.775735 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993e746-591d-44e3-a0f1-e02b88a120d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.776460 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993e746-591d-44e3-a0f1-e02b88a120d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.778291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993e746-591d-44e3-a0f1-e02b88a120d4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.781836 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1249/2508] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:28.782049 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7aef1-e3d5-4e24-97b8-fa361e0c0767 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.788991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1260/2509] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:28.789798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993e746-591d-44e3-a0f1-e02b88a120d4 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.797611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7aef1-e3d5-4e24-97b8-fa361e0c0767 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.800078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993e746-591d-44e3-a0f1-e02b88a120d4 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.802218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7374ea-9947-4b63-b099-e631bf07ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.802903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7374ea-9947-4b63-b099-e631bf07ed1f admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.803200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7374ea-9947-4b63-b099-e631bf07ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.803479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7374ea-9947-4b63-b099-e631bf07ed1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.804210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7374ea-9947-4b63-b099-e631bf07ed1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:28.804520 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7374ea-9947-4b63-b099-e631bf07ed1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.804715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99865dc8-96a1-45ec-bc37-a2877ee14011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.805579 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99865dc8-96a1-45ec-bc37-a2877ee14011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.805864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99865dc8-96a1-45ec-bc37-a2877ee14011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.806140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99865dc8-96a1-45ec-bc37-a2877ee14011 admin admin] PATH_INFO: `/v3/projects/1574759e93c34c82b3136866a2acb575/users/348a92d63617403bb61fa9382b367b78/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.806334 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7374ea-9947-4b63-b099-e631bf07ed1f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.818830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1250/2510] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:28.819613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7374ea-9947-4b63-b099-e631bf07ed1f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.821786 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99865dc8-96a1-45ec-bc37-a2877ee14011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1574759e93c34c82b3136866a2acb575, user_id=348a92d63617403bb61fa9382b367b78, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.825196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99865dc8-96a1-45ec-bc37-a2877ee14011 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.830005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7374ea-9947-4b63-b099-e631bf07ed1f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.834821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00414d-9785-45b8-9893-824b20095e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.835691 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00414d-9785-45b8-9893-824b20095e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.835973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00414d-9785-45b8-9893-824b20095e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.836247 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00414d-9785-45b8-9893-824b20095e05 admin admin] PATH_INFO: `/v3/projects/0dd0d1e7fc1d45fda7a54b5431cef432/users/766a3a50264f43a18cfadf1b67ae252b/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.838212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00414d-9785-45b8-9893-824b20095e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0d1e7fc1d45fda7a54b5431cef432, user_id=766a3a50264f43a18cfadf1b67ae252b, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.839477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1261/2511] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:28 2022] PUT /identity/v3/projects/1574759e93c34c82b3136866a2acb575/users/348a92d63617403bb61fa9382b367b78/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:28.841124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99865dc8-96a1-45ec-bc37-a2877ee14011 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:28.841547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00414d-9785-45b8-9893-824b20095e05 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.852572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1251/2512] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:28 2022] PUT /identity/v3/projects/0dd0d1e7fc1d45fda7a54b5431cef432/users/766a3a50264f43a18cfadf1b67ae252b/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:28.862464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d94bc-1591-418f-b0c0-4dc6ddcc4d02 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.862464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d94bc-1591-418f-b0c0-4dc6ddcc4d02 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.862464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d94bc-1591-418f-b0c0-4dc6ddcc4d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.887868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3e2d94bc-1591-418f-b0c0-4dc6ddcc4d02 None None] MFA Rules not processed for user `348a92d63617403bb61fa9382b367b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:28.889081 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3e2d94bc-1591-418f-b0c0-4dc6ddcc4d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:28.909062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99865dc8-96a1-45ec-bc37-a2877ee14011 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:28.956705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1252/2513] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:28.958061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037b63a-93ad-4cf8-9856-f34a83548cd9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.958405 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037b63a-93ad-4cf8-9856-f34a83548cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.958691 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037b63a-93ad-4cf8-9856-f34a83548cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.972871 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2532e-0c9c-4afb-aee3-825ae6ab27d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:28.973535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2532e-0c9c-4afb-aee3-825ae6ab27d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:28.973824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2532e-0c9c-4afb-aee3-825ae6ab27d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:28.974102 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2532e-0c9c-4afb-aee3-825ae6ab27d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:28.974826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2532e-0c9c-4afb-aee3-825ae6ab27d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:28.976741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2532e-0c9c-4afb-aee3-825ae6ab27d6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:28.985273 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3037b63a-93ad-4cf8-9856-f34a83548cd9 None None] MFA Rules not processed for user `766a3a50264f43a18cfadf1b67ae252b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:28.986604 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3037b63a-93ad-4cf8-9856-f34a83548cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:28.996827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:29.004285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1262/2514] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:28 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:29.007201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2532e-0c9c-4afb-aee3-825ae6ab27d6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:29.009739 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bee2532e-0c9c-4afb-aee3-825ae6ab27d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:29.059086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1253/2515] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:29.063708 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037b63a-93ad-4cf8-9856-f34a83548cd9 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:29.076113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037b63a-93ad-4cf8-9856-f34a83548cd9 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:29.085557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2532e-0c9c-4afb-aee3-825ae6ab27d6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:29.092076 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea093dc6-93f3-4702-a60f-1165a0c08133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:29.092733 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea093dc6-93f3-4702-a60f-1165a0c08133 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:29.093017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea093dc6-93f3-4702-a60f-1165a0c08133 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:29.093294 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea093dc6-93f3-4702-a60f-1165a0c08133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:29.113807 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:29.140928 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fe7dc-f3c8-4b04-9428-f67ed379e610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:29.141621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fe7dc-f3c8-4b04-9428-f67ed379e610 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:29.141893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fe7dc-f3c8-4b04-9428-f67ed379e610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:29.142167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fe7dc-f3c8-4b04-9428-f67ed379e610 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:29.142895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fe7dc-f3c8-4b04-9428-f67ed379e610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:29.144817 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fe7dc-f3c8-4b04-9428-f67ed379e610 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:29.150073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea093dc6-93f3-4702-a60f-1165a0c08133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:29.151713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea093dc6-93f3-4702-a60f-1165a0c08133 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:29.161870 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1263/2516] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:29.162716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea093dc6-93f3-4702-a60f-1165a0c08133 service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:29.164022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ea093dc6-93f3-4702-a60f-1165a0c08133 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:29.167579 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1254/2517] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:29 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:29.169246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fe7dc-f3c8-4b04-9428-f67ed379e610 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:29.179820 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fe7dc-f3c8-4b04-9428-f67ed379e610 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:29.184607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193cccd-7a68-4c4d-aa14-9cc762ac5bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:29.185291 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193cccd-7a68-4c4d-aa14-9cc762ac5bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:29.185621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193cccd-7a68-4c4d-aa14-9cc762ac5bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:29.185962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193cccd-7a68-4c4d-aa14-9cc762ac5bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:29.186737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193cccd-7a68-4c4d-aa14-9cc762ac5bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:29.188337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193cccd-7a68-4c4d-aa14-9cc762ac5bd3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:29.198915 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1255/2518] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:29.203509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193cccd-7a68-4c4d-aa14-9cc762ac5bd3 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:29.214338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193cccd-7a68-4c4d-aa14-9cc762ac5bd3 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:29.220301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85497568-533f-486f-ac92-b2064c15edf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:29.221160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85497568-533f-486f-ac92-b2064c15edf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:29.221455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85497568-533f-486f-ac92-b2064c15edf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:29.221740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85497568-533f-486f-ac92-b2064c15edf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:29.222505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85497568-533f-486f-ac92-b2064c15edf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:29.223965 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea093dc6-93f3-4702-a60f-1165a0c08133 service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:29.224480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85497568-533f-486f-ac92-b2064c15edf0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:29.228127 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e635b-b50c-4f86-b12b-677c09676e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:29.228774 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e635b-b50c-4f86-b12b-677c09676e62 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:29.229059 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e635b-b50c-4f86-b12b-677c09676e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:29.229834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e635b-b50c-4f86-b12b-677c09676e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:29.238382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1256/2519] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:29.239505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85497568-533f-486f-ac92-b2064c15edf0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:29.254962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85497568-533f-486f-ac92-b2064c15edf0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:29.261381 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ab2b7-3eb8-4bbc-bbfe-fbce2d9a6baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:29.262881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ab2b7-3eb8-4bbc-bbfe-fbce2d9a6baf admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:29.263227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ab2b7-3eb8-4bbc-bbfe-fbce2d9a6baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:29.263574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ab2b7-3eb8-4bbc-bbfe-fbce2d9a6baf admin admin] PATH_INFO: `/v3/projects/5fbd4641761f44cc91e2846631d43ea8/users/499c1678fe1c446faee37b3f5e5a9986/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:29.282280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ab2b7-3eb8-4bbc-bbfe-fbce2d9a6baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbd4641761f44cc91e2846631d43ea8, user_id=499c1678fe1c446faee37b3f5e5a9986, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:29.285210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ab2b7-3eb8-4bbc-bbfe-fbce2d9a6baf admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:29.302321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:29.304323 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1257/2520] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:29 2022] PUT /identity/v3/projects/5fbd4641761f44cc91e2846631d43ea8/users/499c1678fe1c446faee37b3f5e5a9986/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:29.315178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af66fbd-b046-4070-abf0-99b5b1d50cca None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:29.315457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af66fbd-b046-4070-abf0-99b5b1d50cca None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:29.315736 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af66fbd-b046-4070-abf0-99b5b1d50cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:29.321937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e635b-b50c-4f86-b12b-677c09676e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:29.326521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e635b-b50c-4f86-b12b-677c09676e62 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:29.340849 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1264/2521] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:29.347120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9af66fbd-b046-4070-abf0-99b5b1d50cca None None] MFA Rules not processed for user `499c1678fe1c446faee37b3f5e5a9986`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:29.348515 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9af66fbd-b046-4070-abf0-99b5b1d50cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:29.397277 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e635b-b50c-4f86-b12b-677c09676e62 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:29.406753 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e635b-b50c-4f86-b12b-677c09676e62 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:29.438513 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1258/2522] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:29.455202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af66fbd-b046-4070-abf0-99b5b1d50cca None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:29.457225 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9af66fbd-b046-4070-abf0-99b5b1d50cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:29.470911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e17fb3-bead-454d-91e1-e003b7ae28f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:29.471687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e17fb3-bead-454d-91e1-e003b7ae28f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:29.472073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e17fb3-bead-454d-91e1-e003b7ae28f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:29.472387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e17fb3-bead-454d-91e1-e003b7ae28f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:29.474256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-59e17fb3-bead-454d-91e1-e003b7ae28f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:29.524893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af66fbd-b046-4070-abf0-99b5b1d50cca None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:29.534226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53277f-b679-4396-9bf7-e17db36040f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:29.536782 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53277f-b679-4396-9bf7-e17db36040f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:29.537082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53277f-b679-4396-9bf7-e17db36040f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:29.537385 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53277f-b679-4396-9bf7-e17db36040f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:29.548101 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53277f-b679-4396-9bf7-e17db36040f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:29.549550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53277f-b679-4396-9bf7-e17db36040f1 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:29.549817 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e17fb3-bead-454d-91e1-e003b7ae28f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:29.551737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e17fb3-bead-454d-91e1-e003b7ae28f7 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:29.563166 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1265/2523] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:15:29.564571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1259/2524] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:32.207741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e17fb3-bead-454d-91e1-e003b7ae28f7 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:32.266325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e17fb3-bead-454d-91e1-e003b7ae28f7 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:32.270814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:32.271673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:32.271955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:32.272229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] PATH_INFO: `/v3/users/348a92d63617403bb61fa9382b367b78` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:32.273379 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=348a92d63617403bb61fa9382b367b78)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:32.275329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:32.319474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:32.322379 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348a92d63617403bb61fa9382b367b78'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:32.323265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348a92d63617403bb61fa9382b367b78'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:32.331197 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348a92d63617403bb61fa9382b367b78'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:32.339190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348a92d63617403bb61fa9382b367b78'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:32.340552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348a92d63617403bb61fa9382b367b78'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:32.360233 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1266/2525] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:32 2022] DELETE /identity/v3/users/348a92d63617403bb61fa9382b367b78 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:32.364635 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47df3b8-2a17-4a47-8da8-0d09cddfb444 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:32.365141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47df3b8-2a17-4a47-8da8-0d09cddfb444 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:32.365239 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47df3b8-2a17-4a47-8da8-0d09cddfb444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:32.382989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e47df3b8-2a17-4a47-8da8-0d09cddfb444 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:32.384172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e47df3b8-2a17-4a47-8da8-0d09cddfb444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:32.388320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:32.448784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1260/2526] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:32.463071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:32.464707 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:32.542190 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b437e2-0619-41aa-930f-2c17ddb86bbd admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:32.552558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7311d-2ba2-47e9-a948-b442a069a191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:32.554046 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7311d-2ba2-47e9-a948-b442a069a191 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:32.554501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7311d-2ba2-47e9-a948-b442a069a191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:32.554925 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7311d-2ba2-47e9-a948-b442a069a191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:32.569732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7311d-2ba2-47e9-a948-b442a069a191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:32.571378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7311d-2ba2-47e9-a948-b442a069a191 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:32.593241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1267/2527] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:32.985698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47df3b8-2a17-4a47-8da8-0d09cddfb444 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:32.988634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e47df3b8-2a17-4a47-8da8-0d09cddfb444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:33.019871 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47df3b8-2a17-4a47-8da8-0d09cddfb444 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.025271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.026172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.026507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.026795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] PATH_INFO: `/v3/projects/1574759e93c34c82b3136866a2acb575` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.028802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1574759e93c34c82b3136866a2acb575)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.030814 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.080168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1574759e93c34c82b3136866a2acb575', 'request_id': 'req-31ae92a6-b402-4d87-bc0b-6dd64b459580'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.086285 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1574759e93c34c82b3136866a2acb575', 'request_id': 'req-31ae92a6-b402-4d87-bc0b-6dd64b459580'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.093841 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1574759e93c34c82b3136866a2acb575', 'request_id': 'req-31ae92a6-b402-4d87-bc0b-6dd64b459580'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.106303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] The token cache is being invalidate because project 1574759e93c34c82b3136866a2acb575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:33.106676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.107317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.109069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1261/2528] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:32 2022] DELETE /identity/v3/projects/1574759e93c34c82b3136866a2acb575 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:33.114609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adae6f0-939f-4088-8043-d55feb48c789 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.114906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adae6f0-939f-4088-8043-d55feb48c789 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.115189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adae6f0-939f-4088-8043-d55feb48c789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.138722 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3adae6f0-939f-4088-8043-d55feb48c789 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:33.139916 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3adae6f0-939f-4088-8043-d55feb48c789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:33.202056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1268/2529] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:33.209376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.209944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c8a5d-7d10-4948-b98c-dfde781bb4a3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.210474 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c8a5d-7d10-4948-b98c-dfde781bb4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.210766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c8a5d-7d10-4948-b98c-dfde781bb4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.211315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:33.224826 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae92a6-b402-4d87-bc0b-6dd64b459580 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.229463 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7a8c8a5d-7d10-4948-b98c-dfde781bb4a3 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:33.229859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a31fb-ca23-4e31-92e8-b2e4e3012b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.231284 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7a8c8a5d-7d10-4948-b98c-dfde781bb4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:33.231632 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a31fb-ca23-4e31-92e8-b2e4e3012b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.232004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a31fb-ca23-4e31-92e8-b2e4e3012b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.232251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a31fb-ca23-4e31-92e8-b2e4e3012b67 admin admin] PATH_INFO: `/v3/users/c82335c084464c76804b525a88a2c843` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.233516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a31fb-ca23-4e31-92e8-b2e4e3012b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82335c084464c76804b525a88a2c843)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.235508 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a31fb-ca23-4e31-92e8-b2e4e3012b67 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.242491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1269/2530] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:33.243543 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c8a5d-7d10-4948-b98c-dfde781bb4a3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.253337 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c8a5d-7d10-4948-b98c-dfde781bb4a3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.258905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca10a7-6edd-4d1b-baac-7e6082de0c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.259577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca10a7-6edd-4d1b-baac-7e6082de0c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.259868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca10a7-6edd-4d1b-baac-7e6082de0c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.260145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca10a7-6edd-4d1b-baac-7e6082de0c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.260897 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca10a7-6edd-4d1b-baac-7e6082de0c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:33.261208 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca10a7-6edd-4d1b-baac-7e6082de0c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.263510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca10a7-6edd-4d1b-baac-7e6082de0c11 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.275868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1270/2531] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:15:33.280628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca10a7-6edd-4d1b-baac-7e6082de0c11 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.289391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ee5a31fb-ca23-4e31-92e8-b2e4e3012b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82335c084464c76804b525a88a2c843'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.291266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca10a7-6edd-4d1b-baac-7e6082de0c11 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.296138 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd1ba-661e-45c3-950e-f2bae7ac4712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.296814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd1ba-661e-45c3-950e-f2bae7ac4712 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.297105 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd1ba-661e-45c3-950e-f2bae7ac4712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.297386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd1ba-661e-45c3-950e-f2bae7ac4712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.298075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcd1ba-661e-45c3-950e-f2bae7ac4712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.300086 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcd1ba-661e-45c3-950e-f2bae7ac4712 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.301984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ee5a31fb-ca23-4e31-92e8-b2e4e3012b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82335c084464c76804b525a88a2c843'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.302694 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ee5a31fb-ca23-4e31-92e8-b2e4e3012b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82335c084464c76804b525a88a2c843'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.311024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ee5a31fb-ca23-4e31-92e8-b2e4e3012b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82335c084464c76804b525a88a2c843'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.311678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ee5a31fb-ca23-4e31-92e8-b2e4e3012b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82335c084464c76804b525a88a2c843'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.325395 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1262/2532] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:33 2022] DELETE /identity/v3/users/c82335c084464c76804b525a88a2c843 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:33.328843 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1271/2533] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:33 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:33.330410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717b0bc-48f4-4063-86be-7ffc25071acb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.330710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717b0bc-48f4-4063-86be-7ffc25071acb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.330993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717b0bc-48f4-4063-86be-7ffc25071acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.333127 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd1ba-661e-45c3-950e-f2bae7ac4712 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.334781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ecfcd1ba-661e-45c3-950e-f2bae7ac4712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:33.337937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:33.349906 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e717b0bc-48f4-4063-86be-7ffc25071acb None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:33.351141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e717b0bc-48f4-4063-86be-7ffc25071acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:33.361574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:33.404964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd1ba-661e-45c3-950e-f2bae7ac4712 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.409670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdddf6-e4bc-404d-a6fd-181857dd2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.410344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdddf6-e4bc-404d-a6fd-181857dd2888 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.410662 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdddf6-e4bc-404d-a6fd-181857dd2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.410944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdddf6-e4bc-404d-a6fd-181857dd2888 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.411644 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdddf6-e4bc-404d-a6fd-181857dd2888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.411753 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1263/2534] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:33.413600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdddf6-e4bc-404d-a6fd-181857dd2888 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.421529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717b0bc-48f4-4063-86be-7ffc25071acb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.422905 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e717b0bc-48f4-4063-86be-7ffc25071acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:33.437284 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1272/2535] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:33 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:33.438831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdddf6-e4bc-404d-a6fd-181857dd2888 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.448521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdddf6-e4bc-404d-a6fd-181857dd2888 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.454094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1b888-6493-4c28-9417-5a2e09d93e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.454996 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1b888-6493-4c28-9417-5a2e09d93e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.455288 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1b888-6493-4c28-9417-5a2e09d93e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.455568 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1b888-6493-4c28-9417-5a2e09d93e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.456326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1b888-6493-4c28-9417-5a2e09d93e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.457919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1b888-6493-4c28-9417-5a2e09d93e8a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.468569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1273/2536] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:33.472446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1b888-6493-4c28-9417-5a2e09d93e8a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.482141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1b888-6493-4c28-9417-5a2e09d93e8a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.484381 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717b0bc-48f4-4063-86be-7ffc25071acb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.486922 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a43960-b306-4cb3-94bf-9f0051b19fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.487563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a43960-b306-4cb3-94bf-9f0051b19fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.487853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a43960-b306-4cb3-94bf-9f0051b19fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.487966 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31120e8-33b6-47cd-9a23-6e9f91d1d364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.488136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a43960-b306-4cb3-94bf-9f0051b19fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.488546 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31120e8-33b6-47cd-9a23-6e9f91d1d364 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.488831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31120e8-33b6-47cd-9a23-6e9f91d1d364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.488939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a43960-b306-4cb3-94bf-9f0051b19fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.489106 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31120e8-33b6-47cd-9a23-6e9f91d1d364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.490422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a43960-b306-4cb3-94bf-9f0051b19fe3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.498824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31120e8-33b6-47cd-9a23-6e9f91d1d364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.500255 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31120e8-33b6-47cd-9a23-6e9f91d1d364 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.501468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1274/2537] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:33.505936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a43960-b306-4cb3-94bf-9f0051b19fe3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.510167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1264/2538] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:15:33.516192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a43960-b306-4cb3-94bf-9f0051b19fe3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.520794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b06d5-41e3-4fd2-8d4a-f8e827057d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.521699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b06d5-41e3-4fd2-8d4a-f8e827057d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.521983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b06d5-41e3-4fd2-8d4a-f8e827057d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.522259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b06d5-41e3-4fd2-8d4a-f8e827057d35 admin admin] PATH_INFO: `/v3/projects/7a7211c5136c40999e62292954bccf97/users/c96b37ba8adf4e46bbbea53acf0870fd/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.539765 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b06d5-41e3-4fd2-8d4a-f8e827057d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7211c5136c40999e62292954bccf97, user_id=c96b37ba8adf4e46bbbea53acf0870fd, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.542451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b06d5-41e3-4fd2-8d4a-f8e827057d35 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.556500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1275/2539] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:33 2022] PUT /identity/v3/projects/7a7211c5136c40999e62292954bccf97/users/c96b37ba8adf4e46bbbea53acf0870fd/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:33.568778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae6c32-37df-4668-9068-d0416935587c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.569071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae6c32-37df-4668-9068-d0416935587c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.569350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae6c32-37df-4668-9068-d0416935587c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.596901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-77ae6c32-37df-4668-9068-d0416935587c None None] MFA Rules not processed for user `c96b37ba8adf4e46bbbea53acf0870fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:33.598111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-77ae6c32-37df-4668-9068-d0416935587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:33.672318 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1265/2540] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:33.673576 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b06d5-41e3-4fd2-8d4a-f8e827057d35 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.736749 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b06d5-41e3-4fd2-8d4a-f8e827057d35 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.741497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a0f64-fc99-407b-b78c-b6af39336b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.742160 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a0f64-fc99-407b-b78c-b6af39336b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.742476 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a0f64-fc99-407b-b78c-b6af39336b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.742762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a0f64-fc99-407b-b78c-b6af39336b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.743446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a0f64-fc99-407b-b78c-b6af39336b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.745332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a0f64-fc99-407b-b78c-b6af39336b18 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.775242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1276/2541] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:33 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:33.776345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae6c32-37df-4668-9068-d0416935587c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.788785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae6c32-37df-4668-9068-d0416935587c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.795346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a0f64-fc99-407b-b78c-b6af39336b18 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.797363 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-572a0f64-fc99-407b-b78c-b6af39336b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:33.837939 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:33.858090 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:33.862878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcde713-c3da-470c-9ece-d9b8e089775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.863649 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcde713-c3da-470c-9ece-d9b8e089775c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.863904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcde713-c3da-470c-9ece-d9b8e089775c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.864181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcde713-c3da-470c-9ece-d9b8e089775c admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.864954 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcde713-c3da-470c-9ece-d9b8e089775c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.867126 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcde713-c3da-470c-9ece-d9b8e089775c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.872135 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a0f64-fc99-407b-b78c-b6af39336b18 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.877295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.878182 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.878527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.878775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] PATH_INFO: `/v3/projects/e83f3521dbd7435d9e750e49f8f87974` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.880179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83f3521dbd7435d9e750e49f8f87974)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.882058 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.888986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1266/2542] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:33 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:33.892883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcde713-c3da-470c-9ece-d9b8e089775c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.904431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcde713-c3da-470c-9ece-d9b8e089775c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.910096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a115-a386-405e-b6dd-a2e984124bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:33.910932 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a115-a386-405e-b6dd-a2e984124bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:33.911391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a115-a386-405e-b6dd-a2e984124bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:33.911801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a115-a386-405e-b6dd-a2e984124bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:33.912509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7a115-a386-405e-b6dd-a2e984124bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:33.914139 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7a115-a386-405e-b6dd-a2e984124bfb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:33.924849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1267/2543] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:33.928963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a115-a386-405e-b6dd-a2e984124bfb admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.937285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83f3521dbd7435d9e750e49f8f87974', 'request_id': 'req-4ea6c97e-69f1-4e3a-927a-db235088679b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.940588 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a115-a386-405e-b6dd-a2e984124bfb admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:33.945689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83f3521dbd7435d9e750e49f8f87974', 'request_id': 'req-4ea6c97e-69f1-4e3a-927a-db235088679b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.957246 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83f3521dbd7435d9e750e49f8f87974', 'request_id': 'req-4ea6c97e-69f1-4e3a-927a-db235088679b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.970548 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] The token cache is being invalidate because project e83f3521dbd7435d9e750e49f8f87974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:33.970951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.971569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:33.973231 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1277/2544] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:33 2022] DELETE /identity/v3/projects/e83f3521dbd7435d9e750e49f8f87974 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:33.977169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:33.978708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:34.005899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb86b3-0d3e-4a46-803a-a4875b745e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:34.007433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb86b3-0d3e-4a46-803a-a4875b745e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:34.008852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb86b3-0d3e-4a46-803a-a4875b745e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:34.009044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb86b3-0d3e-4a46-803a-a4875b745e39 admin admin] PATH_INFO: `/v3/projects/940ec0918c8144a4a7af68d230a26a85/users/212e89d5a134496585f2b1c4601fa470/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:34.026473 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb86b3-0d3e-4a46-803a-a4875b745e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=940ec0918c8144a4a7af68d230a26a85, user_id=212e89d5a134496585f2b1c4601fa470, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:34.029677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb86b3-0d3e-4a46-803a-a4875b745e39 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:34.045666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1268/2545] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:33 2022] PUT /identity/v3/projects/940ec0918c8144a4a7af68d230a26a85/users/212e89d5a134496585f2b1c4601fa470/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:34.049497 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb86b3-0d3e-4a46-803a-a4875b745e39 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:34.051441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1ceb86b3-0d3e-4a46-803a-a4875b745e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:34.054115 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6c97e-69f1-4e3a-927a-db235088679b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:34.131420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:34.131700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb86b3-0d3e-4a46-803a-a4875b745e39 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:34.132408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:34.132758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:34.133095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] PATH_INFO: `/v3/users/766a3a50264f43a18cfadf1b67ae252b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:34.134336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=766a3a50264f43a18cfadf1b67ae252b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:34.136307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:34.138754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddae005-4bea-4c15-9850-e61ee3030175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:34.140091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddae005-4bea-4c15-9850-e61ee3030175 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:34.140382 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddae005-4bea-4c15-9850-e61ee3030175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:34.140665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddae005-4bea-4c15-9850-e61ee3030175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:34.141412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddae005-4bea-4c15-9850-e61ee3030175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:34.143144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddae005-4bea-4c15-9850-e61ee3030175 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:34.154020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1269/2546] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:34.157887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddae005-4bea-4c15-9850-e61ee3030175 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:34.172781 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddae005-4bea-4c15-9850-e61ee3030175 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:34.177324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:34.178797 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9eab1-6695-4045-bc83-a523be26a671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:34.179924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9eab1-6695-4045-bc83-a523be26a671 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:34.180492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9eab1-6695-4045-bc83-a523be26a671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:34.180701 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9eab1-6695-4045-bc83-a523be26a671 admin admin] PATH_INFO: `/v3/projects/940ec0918c8144a4a7af68d230a26a85/users/212e89d5a134496585f2b1c4601fa470/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:34.182808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9eab1-6695-4045-bc83-a523be26a671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=940ec0918c8144a4a7af68d230a26a85, user_id=212e89d5a134496585f2b1c4601fa470, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:34.186327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9eab1-6695-4045-bc83-a523be26a671 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:34.195601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766a3a50264f43a18cfadf1b67ae252b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:34.196325 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766a3a50264f43a18cfadf1b67ae252b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:34.197536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1270/2547] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:34 2022] PUT /identity/v3/projects/940ec0918c8144a4a7af68d230a26a85/users/212e89d5a134496585f2b1c4601fa470/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:34.208583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73199973-816f-4f94-b8f0-57fd9fad077d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:34.208877 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73199973-816f-4f94-b8f0-57fd9fad077d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:34.209261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73199973-816f-4f94-b8f0-57fd9fad077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:34.213924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766a3a50264f43a18cfadf1b67ae252b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:34.223684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766a3a50264f43a18cfadf1b67ae252b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:34.224482 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766a3a50264f43a18cfadf1b67ae252b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:34.237913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-73199973-816f-4f94-b8f0-57fd9fad077d None None] MFA Rules not processed for user `212e89d5a134496585f2b1c4601fa470`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:34.239319 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-73199973-816f-4f94-b8f0-57fd9fad077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:34.244968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1278/2548] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:33 2022] DELETE /identity/v3/users/766a3a50264f43a18cfadf1b67ae252b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:34.254502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:34.331454 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1271/2549] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:34.345859 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:34.347602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:34.426056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6506a-635a-4e61-925f-facc1b5fd94a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:34.429967 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3de972-0083-4cda-8081-d020f05280b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:34.436468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3de972-0083-4cda-8081-d020f05280b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:34.438162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3de972-0083-4cda-8081-d020f05280b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:34.438162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3de972-0083-4cda-8081-d020f05280b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:34.454097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3de972-0083-4cda-8081-d020f05280b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:34.457287 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3de972-0083-4cda-8081-d020f05280b5 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:34.469238 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1279/2550] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:34.557138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73199973-816f-4f94-b8f0-57fd9fad077d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:34.558913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-73199973-816f-4f94-b8f0-57fd9fad077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:34.658713 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73199973-816f-4f94-b8f0-57fd9fad077d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:34.664431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:34.665672 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:34.666108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:34.667058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b admin admin] PATH_INFO: `/v3/projects/0dd0d1e7fc1d45fda7a54b5431cef432` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:34.669307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd0d1e7fc1d45fda7a54b5431cef432)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:34.672427 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:34.728808 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd0d1e7fc1d45fda7a54b5431cef432', 'request_id': 'req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:34.740429 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd0d1e7fc1d45fda7a54b5431cef432', 'request_id': 'req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:34.748272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd0d1e7fc1d45fda7a54b5431cef432', 'request_id': 'req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:34.763303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b admin admin] The token cache is being invalidate because project 0dd0d1e7fc1d45fda7a54b5431cef432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:34.763595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:34.764325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2ba3e7d4-9553-4598-8a9f-14a0d322ca1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:34.766212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1272/2551] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:34 2022] DELETE /identity/v3/projects/0dd0d1e7fc1d45fda7a54b5431cef432 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:34.771221 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06199bd0-e6e3-4bd9-b12a-153f6c22bd33 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:34.771774 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06199bd0-e6e3-4bd9-b12a-153f6c22bd33 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:34.772255 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06199bd0-e6e3-4bd9-b12a-153f6c22bd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:34.794869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-06199bd0-e6e3-4bd9-b12a-153f6c22bd33 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:34.796489 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-06199bd0-e6e3-4bd9-b12a-153f6c22bd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:34.869118 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1280/2552] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:34.876753 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afac113-5954-452b-b722-1eb3c8044a88 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:34.877181 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afac113-5954-452b-b722-1eb3c8044a88 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:34.877468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afac113-5954-452b-b722-1eb3c8044a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:34.897167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2afac113-5954-452b-b722-1eb3c8044a88 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:34.902675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2afac113-5954-452b-b722-1eb3c8044a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:34.910964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1273/2553] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:34.913349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06199bd0-e6e3-4bd9-b12a-153f6c22bd33 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:34.924330 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afac113-5954-452b-b722-1eb3c8044a88 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:34.926353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2afac113-5954-452b-b722-1eb3c8044a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:34.935710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06199bd0-e6e3-4bd9-b12a-153f6c22bd33 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:34.941967 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f2d4-4ed8-4d11-b9de-dfa6995a9de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:34.942675 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f2d4-4ed8-4d11-b9de-dfa6995a9de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:34.942960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f2d4-4ed8-4d11-b9de-dfa6995a9de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:34.943237 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f2d4-4ed8-4d11-b9de-dfa6995a9de8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:34.943995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f2d4-4ed8-4d11-b9de-dfa6995a9de8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:34.944299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f2d4-4ed8-4d11-b9de-dfa6995a9de8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:34.945876 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f2d4-4ed8-4d11-b9de-dfa6995a9de8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:34.951402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afac113-5954-452b-b722-1eb3c8044a88 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:34.956620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbb343-9209-445e-bae2-a634df01b4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:34.957573 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbb343-9209-445e-bae2-a634df01b4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:34.957933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbb343-9209-445e-bae2-a634df01b4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:34.958281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbb343-9209-445e-bae2-a634df01b4e1 admin admin] PATH_INFO: `/v3/users/c96b37ba8adf4e46bbbea53acf0870fd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:34.962578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1281/2554] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:34.962752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbb343-9209-445e-bae2-a634df01b4e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96b37ba8adf4e46bbbea53acf0870fd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:34.962752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbb343-9209-445e-bae2-a634df01b4e1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:34.963924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f2d4-4ed8-4d11-b9de-dfa6995a9de8 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:34.974971 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f2d4-4ed8-4d11-b9de-dfa6995a9de8 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:34.982094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0660adb-aafc-4bb5-9ef5-178f9c60b40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:34.982954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0660adb-aafc-4bb5-9ef5-178f9c60b40f admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:34.983326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0660adb-aafc-4bb5-9ef5-178f9c60b40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:34.983797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0660adb-aafc-4bb5-9ef5-178f9c60b40f admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:34.984449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0660adb-aafc-4bb5-9ef5-178f9c60b40f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:34.986394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0660adb-aafc-4bb5-9ef5-178f9c60b40f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:35.005025 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:35.023702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1282/2555] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:34 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:35.028382 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0660adb-aafc-4bb5-9ef5-178f9c60b40f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:35.036235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cdfbb343-9209-445e-bae2-a634df01b4e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96b37ba8adf4e46bbbea53acf0870fd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.051708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:35.051985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cdfbb343-9209-445e-bae2-a634df01b4e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96b37ba8adf4e46bbbea53acf0870fd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.052773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cdfbb343-9209-445e-bae2-a634df01b4e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96b37ba8adf4e46bbbea53acf0870fd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.061257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cdfbb343-9209-445e-bae2-a634df01b4e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96b37ba8adf4e46bbbea53acf0870fd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.062171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cdfbb343-9209-445e-bae2-a634df01b4e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96b37ba8adf4e46bbbea53acf0870fd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.078032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1274/2556] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:34 2022] DELETE /identity/v3/users/c96b37ba8adf4e46bbbea53acf0870fd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:35.082468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a366bb0-16be-44f2-9015-f998f541c761 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.082971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a366bb0-16be-44f2-9015-f998f541c761 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.082971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a366bb0-16be-44f2-9015-f998f541c761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.103044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7a366bb0-16be-44f2-9015-f998f541c761 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:35.104269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7a366bb0-16be-44f2-9015-f998f541c761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:35.110640 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0660adb-aafc-4bb5-9ef5-178f9c60b40f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:35.166855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1275/2557] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:35.177392 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a366bb0-16be-44f2-9015-f998f541c761 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:35.179462 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7a366bb0-16be-44f2-9015-f998f541c761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:35.185022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05691c-596e-49a7-ba6d-a79d7aaa2ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:35.185923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05691c-596e-49a7-ba6d-a79d7aaa2ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.186209 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05691c-596e-49a7-ba6d-a79d7aaa2ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.186600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05691c-596e-49a7-ba6d-a79d7aaa2ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.187295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05691c-596e-49a7-ba6d-a79d7aaa2ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:35.189200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05691c-596e-49a7-ba6d-a79d7aaa2ca1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:35.218178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1283/2558] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:35 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:35.219389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05691c-596e-49a7-ba6d-a79d7aaa2ca1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:35.221163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7c05691c-596e-49a7-ba6d-a79d7aaa2ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:35.235142 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05691c-596e-49a7-ba6d-a79d7aaa2ca1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:35.240414 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d3fd7-7346-4e8d-bbea-fb4077935665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:35.241098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d3fd7-7346-4e8d-bbea-fb4077935665 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.241386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d3fd7-7346-4e8d-bbea-fb4077935665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.241662 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d3fd7-7346-4e8d-bbea-fb4077935665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.242417 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d3fd7-7346-4e8d-bbea-fb4077935665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:35.244001 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d3fd7-7346-4e8d-bbea-fb4077935665 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:35.256966 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a366bb0-16be-44f2-9015-f998f541c761 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:35.265443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a5661-47c7-42f1-bfc0-306a3d9d4714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:35.265443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a5661-47c7-42f1-bfc0-306a3d9d4714 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.265443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a5661-47c7-42f1-bfc0-306a3d9d4714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.265443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a5661-47c7-42f1-bfc0-306a3d9d4714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.265882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1284/2559] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:35.266852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d3fd7-7346-4e8d-bbea-fb4077935665 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:35.275916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a5661-47c7-42f1-bfc0-306a3d9d4714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:35.278555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a5661-47c7-42f1-bfc0-306a3d9d4714 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:35.278933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d3fd7-7346-4e8d-bbea-fb4077935665 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:35.285087 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0defb26-554d-4cf4-add0-8ff7811aaf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:35.285776 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0defb26-554d-4cf4-add0-8ff7811aaf3a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.286069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0defb26-554d-4cf4-add0-8ff7811aaf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.286353 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0defb26-554d-4cf4-add0-8ff7811aaf3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.287490 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0defb26-554d-4cf4-add0-8ff7811aaf3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:35.289760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1276/2560] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:15:35.290580 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0defb26-554d-4cf4-add0-8ff7811aaf3a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:35.307781 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1285/2561] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:35.309802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a5661-47c7-42f1-bfc0-306a3d9d4714 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:35.320510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a5661-47c7-42f1-bfc0-306a3d9d4714 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:35.326339 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a459198-4842-4a2a-81a5-96e8c8487ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:35.327602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a459198-4842-4a2a-81a5-96e8c8487ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.327958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a459198-4842-4a2a-81a5-96e8c8487ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.328307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a459198-4842-4a2a-81a5-96e8c8487ed6 admin admin] PATH_INFO: `/v3/projects/e01f6a8993af41f692d4e5ed25f0142f/users/2214afead4f647e5afe873f19f482879/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.347002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a459198-4842-4a2a-81a5-96e8c8487ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01f6a8993af41f692d4e5ed25f0142f, user_id=2214afead4f647e5afe873f19f482879, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:35.350199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a459198-4842-4a2a-81a5-96e8c8487ed6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:35.368001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1277/2562] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:35 2022] PUT /identity/v3/projects/e01f6a8993af41f692d4e5ed25f0142f/users/2214afead4f647e5afe873f19f482879/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:35.379484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a38da-e7a6-4d53-83a4-fb90ac8c488c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.379880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a38da-e7a6-4d53-83a4-fb90ac8c488c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.380295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a38da-e7a6-4d53-83a4-fb90ac8c488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.415507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9e9a38da-e7a6-4d53-83a4-fb90ac8c488c None None] MFA Rules not processed for user `2214afead4f647e5afe873f19f482879`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:35.416730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9e9a38da-e7a6-4d53-83a4-fb90ac8c488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:35.495143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1286/2563] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:35.499834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a459198-4842-4a2a-81a5-96e8c8487ed6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:35.527981 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:35.575865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a459198-4842-4a2a-81a5-96e8c8487ed6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:35.585604 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dc5dc-8e38-4733-91fb-340dfe08e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:35.586562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dc5dc-8e38-4733-91fb-340dfe08e486 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.586922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dc5dc-8e38-4733-91fb-340dfe08e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.587274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dc5dc-8e38-4733-91fb-340dfe08e486 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.588060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dc5dc-8e38-4733-91fb-340dfe08e486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:35.590227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dc5dc-8e38-4733-91fb-340dfe08e486 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:35.602184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a38da-e7a6-4d53-83a4-fb90ac8c488c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:35.603698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9e9a38da-e7a6-4d53-83a4-fb90ac8c488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:35.622996 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a38da-e7a6-4d53-83a4-fb90ac8c488c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:35.631117 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:35.632081 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.632450 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.632683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] PATH_INFO: `/v3/projects/7a7211c5136c40999e62292954bccf97` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.634156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a7211c5136c40999e62292954bccf97)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:35.637280 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:35.644001 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1278/2564] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:35 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:35.648168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dc5dc-8e38-4733-91fb-340dfe08e486 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:35.658866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:35.694291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a7211c5136c40999e62292954bccf97', 'request_id': 'req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.703407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a7211c5136c40999e62292954bccf97', 'request_id': 'req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.710889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a7211c5136c40999e62292954bccf97', 'request_id': 'req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.723074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] The token cache is being invalidate because project 7a7211c5136c40999e62292954bccf97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:35.723445 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.724161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.724967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dc5dc-8e38-4733-91fb-340dfe08e486 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:35.726034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1287/2565] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:35 2022] DELETE /identity/v3/projects/7a7211c5136c40999e62292954bccf97 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:35.729869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:35.732060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:35.789074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59cb08-d15c-4422-87db-6c612c36fa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:35.789757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59cb08-d15c-4422-87db-6c612c36fa9d admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.790036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59cb08-d15c-4422-87db-6c612c36fa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.790315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59cb08-d15c-4422-87db-6c612c36fa9d admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.791091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59cb08-d15c-4422-87db-6c612c36fa9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:35.793389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59cb08-d15c-4422-87db-6c612c36fa9d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:35.813997 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cc3b2-7846-4a17-81ff-d9b5296fd7f6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:35.815958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1279/2566] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:35 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:35.820868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59cb08-d15c-4422-87db-6c612c36fa9d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:35.822845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ed59cb08-d15c-4422-87db-6c612c36fa9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:35.823711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:35.824945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.825307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.825649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] PATH_INFO: `/v3/users/212e89d5a134496585f2b1c4601fa470` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.827001 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=212e89d5a134496585f2b1c4601fa470)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:35.828974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:35.835912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59cb08-d15c-4422-87db-6c612c36fa9d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:35.842384 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d92fc-d6b7-4704-9f50-1448eb805094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:35.843186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d92fc-d6b7-4704-9f50-1448eb805094 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.843582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d92fc-d6b7-4704-9f50-1448eb805094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.843965 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d92fc-d6b7-4704-9f50-1448eb805094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.844793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d92fc-d6b7-4704-9f50-1448eb805094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:35.846681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d92fc-d6b7-4704-9f50-1448eb805094 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:35.858498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1280/2567] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:35.863071 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d92fc-d6b7-4704-9f50-1448eb805094 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:35.876016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d92fc-d6b7-4704-9f50-1448eb805094 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:35.881229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc76d5-ed6d-49af-a538-9c6b1930bec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:35.882408 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc76d5-ed6d-49af-a538-9c6b1930bec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:35.882683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc76d5-ed6d-49af-a538-9c6b1930bec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:35.882969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc76d5-ed6d-49af-a538-9c6b1930bec1 admin admin] PATH_INFO: `/v3/projects/2abfd7ac84bf413380f13630664b04d9/users/2b1a706947a84955b211d327bdb3e358/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:35.888824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212e89d5a134496585f2b1c4601fa470'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.889522 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212e89d5a134496585f2b1c4601fa470'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.897847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212e89d5a134496585f2b1c4601fa470'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.900785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc76d5-ed6d-49af-a538-9c6b1930bec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abfd7ac84bf413380f13630664b04d9, user_id=2b1a706947a84955b211d327bdb3e358, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:35.904116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc76d5-ed6d-49af-a538-9c6b1930bec1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:35.907250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212e89d5a134496585f2b1c4601fa470'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.908683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212e89d5a134496585f2b1c4601fa470'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:35.918732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1281/2568] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:35 2022] PUT /identity/v3/projects/2abfd7ac84bf413380f13630664b04d9/users/2b1a706947a84955b211d327bdb3e358/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:35.926924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc76d5-ed6d-49af-a538-9c6b1930bec1 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:35.926924 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1acc76d5-ed6d-49af-a538-9c6b1930bec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:35.936569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:35.939889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1288/2569] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:35 2022] DELETE /identity/v3/users/212e89d5a134496585f2b1c4601fa470 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:36.008464 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc76d5-ed6d-49af-a538-9c6b1930bec1 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:36.079137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e5eb6-9aec-4682-87a1-10a146a23539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:36.080253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e5eb6-9aec-4682-87a1-10a146a23539 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.080611 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e5eb6-9aec-4682-87a1-10a146a23539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.080963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e5eb6-9aec-4682-87a1-10a146a23539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.082055 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e5eb6-9aec-4682-87a1-10a146a23539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:36.084219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e5eb6-9aec-4682-87a1-10a146a23539 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:36.106356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1282/2570] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:36.107221 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:36.117670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc65d1-e561-45ee-98ef-f4e344f9a874 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:36.124542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a81f48-31eb-4b07-bb53-f126cfcb855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:36.126301 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a81f48-31eb-4b07-bb53-f126cfcb855c admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.126936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a81f48-31eb-4b07-bb53-f126cfcb855c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.127659 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a81f48-31eb-4b07-bb53-f126cfcb855c admin admin] PATH_INFO: `/v3/projects/2abfd7ac84bf413380f13630664b04d9/users/2b1a706947a84955b211d327bdb3e358/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.130524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a81f48-31eb-4b07-bb53-f126cfcb855c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abfd7ac84bf413380f13630664b04d9, user_id=2b1a706947a84955b211d327bdb3e358, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:36.133918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a81f48-31eb-4b07-bb53-f126cfcb855c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:36.146004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1289/2571] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:36 2022] PUT /identity/v3/projects/2abfd7ac84bf413380f13630664b04d9/users/2b1a706947a84955b211d327bdb3e358/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:36.212127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcc933-cc3a-4057-9572-cca6184f6b01 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.212421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcc933-cc3a-4057-9572-cca6184f6b01 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.212704 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcc933-cc3a-4057-9572-cca6184f6b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.243111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-57bcc933-cc3a-4057-9572-cca6184f6b01 None None] MFA Rules not processed for user `2b1a706947a84955b211d327bdb3e358`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:36.244516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-57bcc933-cc3a-4057-9572-cca6184f6b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:36.251210 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a81f48-31eb-4b07-bb53-f126cfcb855c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:36.253082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-91a81f48-31eb-4b07-bb53-f126cfcb855c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:36.266197 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:36.332219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1283/2572] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:36.344697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcc933-cc3a-4057-9572-cca6184f6b01 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:36.346314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-57bcc933-cc3a-4057-9572-cca6184f6b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:36.349526 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a81f48-31eb-4b07-bb53-f126cfcb855c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:36.354480 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdc885-6edc-4e97-bc87-d930c3968aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:36.355501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdc885-6edc-4e97-bc87-d930c3968aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.355792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdc885-6edc-4e97-bc87-d930c3968aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.356071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdc885-6edc-4e97-bc87-d930c3968aa1 admin admin] PATH_INFO: `/v3/projects/940ec0918c8144a4a7af68d230a26a85` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.357318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdc885-6edc-4e97-bc87-d930c3968aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=940ec0918c8144a4a7af68d230a26a85)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:36.359359 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdc885-6edc-4e97-bc87-d930c3968aa1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:36.396633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:36.411682 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-98fdc885-6edc-4e97-bc87-d930c3968aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940ec0918c8144a4a7af68d230a26a85', 'request_id': 'req-98fdc885-6edc-4e97-bc87-d930c3968aa1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:36.416729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcc933-cc3a-4057-9572-cca6184f6b01 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:36.422055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-98fdc885-6edc-4e97-bc87-d930c3968aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940ec0918c8144a4a7af68d230a26a85', 'request_id': 'req-98fdc885-6edc-4e97-bc87-d930c3968aa1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:36.429600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-98fdc885-6edc-4e97-bc87-d930c3968aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940ec0918c8144a4a7af68d230a26a85', 'request_id': 'req-98fdc885-6edc-4e97-bc87-d930c3968aa1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:36.443069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-98fdc885-6edc-4e97-bc87-d930c3968aa1 admin admin] The token cache is being invalidate because project 940ec0918c8144a4a7af68d230a26a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:36.443364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-98fdc885-6edc-4e97-bc87-d930c3968aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:36.444078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-98fdc885-6edc-4e97-bc87-d930c3968aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:36.445893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1290/2573] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:36 2022] DELETE /identity/v3/projects/940ec0918c8144a4a7af68d230a26a85 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:36.450911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c247f29-1fa3-485b-bcbd-1fab8d249ef7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.451201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c247f29-1fa3-485b-bcbd-1fab8d249ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.451483 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c247f29-1fa3-485b-bcbd-1fab8d249ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.472690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0c247f29-1fa3-485b-bcbd-1fab8d249ef7 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:36.474317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0c247f29-1fa3-485b-bcbd-1fab8d249ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:36.478326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883d6f6-8a4a-408c-ad49-0c8a2e8c782a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:36.479223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883d6f6-8a4a-408c-ad49-0c8a2e8c782a service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.479664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883d6f6-8a4a-408c-ad49-0c8a2e8c782a service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.479943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883d6f6-8a4a-408c-ad49-0c8a2e8c782a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.482984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0883d6f6-8a4a-408c-ad49-0c8a2e8c782a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:36.546667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1291/2574] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:36.549401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3952a2-3bfb-424a-9353-3e8eb526bc46 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.549854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3952a2-3bfb-424a-9353-3e8eb526bc46 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.550601 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3952a2-3bfb-424a-9353-3e8eb526bc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.570003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4a3952a2-3bfb-424a-9353-3e8eb526bc46 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:36.571386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4a3952a2-3bfb-424a-9353-3e8eb526bc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:36.576214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883d6f6-8a4a-408c-ad49-0c8a2e8c782a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:36.577660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883d6f6-8a4a-408c-ad49-0c8a2e8c782a service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:36.583980 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1292/2575] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:36.584834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3952a2-3bfb-424a-9353-3e8eb526bc46 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:36.587735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1284/2576] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:36.593902 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3952a2-3bfb-424a-9353-3e8eb526bc46 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:36.598438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e3111-149e-4c14-a517-92a1c1e4c4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:36.599094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e3111-149e-4c14-a517-92a1c1e4c4ea admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.599377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e3111-149e-4c14-a517-92a1c1e4c4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.599656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e3111-149e-4c14-a517-92a1c1e4c4ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.600380 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e3111-149e-4c14-a517-92a1c1e4c4ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:36.600690 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e3111-149e-4c14-a517-92a1c1e4c4ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:36.602254 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e3111-149e-4c14-a517-92a1c1e4c4ea admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:36.620145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1293/2577] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:36.622082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883d6f6-8a4a-408c-ad49-0c8a2e8c782a service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:36.632956 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883d6f6-8a4a-408c-ad49-0c8a2e8c782a service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:36.639217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14793e8f-1347-4249-8ad9-a6748c878ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:36.639883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14793e8f-1347-4249-8ad9-a6748c878ecc admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.640174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14793e8f-1347-4249-8ad9-a6748c878ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.640475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14793e8f-1347-4249-8ad9-a6748c878ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.641149 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14793e8f-1347-4249-8ad9-a6748c878ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:36.643098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14793e8f-1347-4249-8ad9-a6748c878ecc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:36.675593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1285/2578] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:36 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:36.679512 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e3111-149e-4c14-a517-92a1c1e4c4ea admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:36.680717 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14793e8f-1347-4249-8ad9-a6748c878ecc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:36.681435 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-636e3111-149e-4c14-a517-92a1c1e4c4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:36.695037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e3111-149e-4c14-a517-92a1c1e4c4ea admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:36.714125 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:36.748414 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14793e8f-1347-4249-8ad9-a6748c878ecc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:36.748941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f388bba-2133-4de5-a29c-998405f86c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:36.749583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f388bba-2133-4de5-a29c-998405f86c65 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.749866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f388bba-2133-4de5-a29c-998405f86c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.750136 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f388bba-2133-4de5-a29c-998405f86c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.752132 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8f388bba-2133-4de5-a29c-998405f86c65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:36.753125 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207da13-3276-47c7-9ae0-56ce9e024697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:36.753802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207da13-3276-47c7-9ae0-56ce9e024697 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.754088 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207da13-3276-47c7-9ae0-56ce9e024697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.754419 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207da13-3276-47c7-9ae0-56ce9e024697 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.755099 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207da13-3276-47c7-9ae0-56ce9e024697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:36.757000 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207da13-3276-47c7-9ae0-56ce9e024697 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:36.779379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1286/2579] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:36 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:36.783381 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207da13-3276-47c7-9ae0-56ce9e024697 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:36.794879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207da13-3276-47c7-9ae0-56ce9e024697 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:36.799526 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dc3af-a11f-4ace-bc7e-bd25918782e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:36.800190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dc3af-a11f-4ace-bc7e-bd25918782e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.800505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dc3af-a11f-4ace-bc7e-bd25918782e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.800784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dc3af-a11f-4ace-bc7e-bd25918782e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.801505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dc3af-a11f-4ace-bc7e-bd25918782e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:36.803135 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dc3af-a11f-4ace-bc7e-bd25918782e7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:36.809166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:36.815426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1287/2580] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:36.819374 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dc3af-a11f-4ace-bc7e-bd25918782e7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:36.822425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f388bba-2133-4de5-a29c-998405f86c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:36.823880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f388bba-2133-4de5-a29c-998405f86c65 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:36.828959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dc3af-a11f-4ace-bc7e-bd25918782e7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:36.833768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887b645-722a-4b3a-95cd-acb31326998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:36.834245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1294/2581] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:15:36.834442 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887b645-722a-4b3a-95cd-acb31326998e admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.834728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887b645-722a-4b3a-95cd-acb31326998e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.835008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887b645-722a-4b3a-95cd-acb31326998e admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.835725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887b645-722a-4b3a-95cd-acb31326998e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:36.837378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887b645-722a-4b3a-95cd-acb31326998e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:36.849984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1288/2582] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:36.853129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f388bba-2133-4de5-a29c-998405f86c65 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:36.864622 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f388bba-2133-4de5-a29c-998405f86c65 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:36.869194 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f416c01-6bb5-40d9-a542-294869324d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:36.870083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f416c01-6bb5-40d9-a542-294869324d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.870352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f416c01-6bb5-40d9-a542-294869324d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.870659 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f416c01-6bb5-40d9-a542-294869324d8d admin admin] PATH_INFO: `/v3/projects/e080a606872243a4a229324849e406d1/users/6d3bf3338d424fbc9e45f83b43261777/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.886638 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f416c01-6bb5-40d9-a542-294869324d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e080a606872243a4a229324849e406d1, user_id=6d3bf3338d424fbc9e45f83b43261777, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:36.889422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f416c01-6bb5-40d9-a542-294869324d8d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:36.903171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1295/2583] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:36 2022] PUT /identity/v3/projects/e080a606872243a4a229324849e406d1/users/6d3bf3338d424fbc9e45f83b43261777/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:36.913374 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeaa7e-a23f-4c86-b59e-03d7f8779523 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:36.913780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeaa7e-a23f-4c86-b59e-03d7f8779523 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:36.914180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeaa7e-a23f-4c86-b59e-03d7f8779523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:36.941643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-04aeaa7e-a23f-4c86-b59e-03d7f8779523 None None] MFA Rules not processed for user `6d3bf3338d424fbc9e45f83b43261777`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:36.942898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-04aeaa7e-a23f-4c86-b59e-03d7f8779523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:37.012596 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1289/2584] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:37.017292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f416c01-6bb5-40d9-a542-294869324d8d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:37.084751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f416c01-6bb5-40d9-a542-294869324d8d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:37.093707 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2084ae-1a5b-4cd8-84b9-92b1b89711a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:37.094402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2084ae-1a5b-4cd8-84b9-92b1b89711a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:37.094686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2084ae-1a5b-4cd8-84b9-92b1b89711a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:37.094960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2084ae-1a5b-4cd8-84b9-92b1b89711a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:37.095648 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2084ae-1a5b-4cd8-84b9-92b1b89711a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:37.097547 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2084ae-1a5b-4cd8-84b9-92b1b89711a0 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:37.127822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1296/2585] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:37 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:37.131811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeaa7e-a23f-4c86-b59e-03d7f8779523 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:37.144042 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeaa7e-a23f-4c86-b59e-03d7f8779523 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:37.206096 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e7eb1-86a6-41a9-9948-85277e712ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:37.206795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e7eb1-86a6-41a9-9948-85277e712ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:37.207083 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e7eb1-86a6-41a9-9948-85277e712ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:37.207359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e7eb1-86a6-41a9-9948-85277e712ddf admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:37.208043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e7eb1-86a6-41a9-9948-85277e712ddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:37.209964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e7eb1-86a6-41a9-9948-85277e712ddf admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:37.228757 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1290/2586] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:37 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:37.233040 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2084ae-1a5b-4cd8-84b9-92b1b89711a0 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:37.243597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2084ae-1a5b-4cd8-84b9-92b1b89711a0 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:37.248989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d6d1-9226-41d2-8a60-0c7ebf96c9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:37.249647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d6d1-9226-41d2-8a60-0c7ebf96c9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:37.249933 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d6d1-9226-41d2-8a60-0c7ebf96c9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:37.250242 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d6d1-9226-41d2-8a60-0c7ebf96c9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:37.251037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11d6d1-9226-41d2-8a60-0c7ebf96c9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:37.252620 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11d6d1-9226-41d2-8a60-0c7ebf96c9f4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:37.264226 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1297/2587] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:37.268365 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e7eb1-86a6-41a9-9948-85277e712ddf admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:37.278600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e7eb1-86a6-41a9-9948-85277e712ddf admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:37.283194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0141a-7d61-4f5e-b94a-c9b66d9744b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:37.284074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0141a-7d61-4f5e-b94a-c9b66d9744b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:37.284362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0141a-7d61-4f5e-b94a-c9b66d9744b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:37.284640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0141a-7d61-4f5e-b94a-c9b66d9744b9 admin admin] PATH_INFO: `/v3/projects/77ac53beb4a4406f9afcd2883955151e/users/de828fd2ca144de08150847e6fefe6ed/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:37.300331 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0141a-7d61-4f5e-b94a-c9b66d9744b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ac53beb4a4406f9afcd2883955151e, user_id=de828fd2ca144de08150847e6fefe6ed, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:37.302944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0141a-7d61-4f5e-b94a-c9b66d9744b9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:37.315990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1291/2588] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:37 2022] PUT /identity/v3/projects/77ac53beb4a4406f9afcd2883955151e/users/de828fd2ca144de08150847e6fefe6ed/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:37.319852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d6d1-9226-41d2-8a60-0c7ebf96c9f4 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:37.330914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d6d1-9226-41d2-8a60-0c7ebf96c9f4 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:37.354268 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:37.397911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc066741-b403-4f49-9dc0-6b82b4b9dfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:37.398651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc066741-b403-4f49-9dc0-6b82b4b9dfcf admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:37.398936 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc066741-b403-4f49-9dc0-6b82b4b9dfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:37.399215 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc066741-b403-4f49-9dc0-6b82b4b9dfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:37.399960 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc066741-b403-4f49-9dc0-6b82b4b9dfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:37.401777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc066741-b403-4f49-9dc0-6b82b4b9dfcf admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:37.416459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1298/2589] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:37.418185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0141a-7d61-4f5e-b94a-c9b66d9744b9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:37.430236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0141a-7d61-4f5e-b94a-c9b66d9744b9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:37.435796 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aecbf-a958-4239-82c0-a07fd66184c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:37.436714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aecbf-a958-4239-82c0-a07fd66184c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:37.437002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aecbf-a958-4239-82c0-a07fd66184c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:37.437279 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aecbf-a958-4239-82c0-a07fd66184c7 admin admin] PATH_INFO: `/v3/projects/77ac53beb4a4406f9afcd2883955151e/users/de828fd2ca144de08150847e6fefe6ed/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:37.439601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130aecbf-a958-4239-82c0-a07fd66184c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ac53beb4a4406f9afcd2883955151e, user_id=de828fd2ca144de08150847e6fefe6ed, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:37.442354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130aecbf-a958-4239-82c0-a07fd66184c7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:37.455213 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1292/2590] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:37 2022] PUT /identity/v3/projects/77ac53beb4a4406f9afcd2883955151e/users/de828fd2ca144de08150847e6fefe6ed/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:37.466403 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec378e-602d-44c6-ac87-56fb5d1869b7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:37.466967 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec378e-602d-44c6-ac87-56fb5d1869b7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:37.467321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec378e-602d-44c6-ac87-56fb5d1869b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:37.496794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b6ec378e-602d-44c6-ac87-56fb5d1869b7 None None] MFA Rules not processed for user `de828fd2ca144de08150847e6fefe6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:37.498008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b6ec378e-602d-44c6-ac87-56fb5d1869b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:37.567016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1299/2591] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:37.577896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aecbf-a958-4239-82c0-a07fd66184c7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:37.580072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-130aecbf-a958-4239-82c0-a07fd66184c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:37.616029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:37.643107 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aecbf-a958-4239-82c0-a07fd66184c7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:37.646978 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a5826-9d3d-473b-a586-97deafb4520a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:37.647639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a5826-9d3d-473b-a586-97deafb4520a service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:37.647921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a5826-9d3d-473b-a586-97deafb4520a service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:37.648194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a5826-9d3d-473b-a586-97deafb4520a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:37.708969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a5826-9d3d-473b-a586-97deafb4520a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:37.710425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a5826-9d3d-473b-a586-97deafb4520a service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:37.719346 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1293/2592] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:39.852304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec378e-602d-44c6-ac87-56fb5d1869b7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:39.853802 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b6ec378e-602d-44c6-ac87-56fb5d1869b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:39.926795 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec378e-602d-44c6-ac87-56fb5d1869b7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:39.931436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:39.932320 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:39.932608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:39.932894 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] PATH_INFO: `/v3/users/499c1678fe1c446faee37b3f5e5a9986` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:39.934154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=499c1678fe1c446faee37b3f5e5a9986)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:39.936093 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:39.986730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499c1678fe1c446faee37b3f5e5a9986'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:39.987393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499c1678fe1c446faee37b3f5e5a9986'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:39.988746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:39.997359 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499c1678fe1c446faee37b3f5e5a9986'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:40.010799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499c1678fe1c446faee37b3f5e5a9986'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:40.011567 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499c1678fe1c446faee37b3f5e5a9986'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:40.029615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1300/2593] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:39 2022] DELETE /identity/v3/users/499c1678fe1c446faee37b3f5e5a9986 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:40.034148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182017c-f1bd-46c4-9f51-e5c23f3f9be9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:40.034638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182017c-f1bd-46c4-9f51-e5c23f3f9be9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:40.034732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182017c-f1bd-46c4-9f51-e5c23f3f9be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:40.053400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7182017c-f1bd-46c4-9f51-e5c23f3f9be9 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:40.054951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7182017c-f1bd-46c4-9f51-e5c23f3f9be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:40.120295 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1294/2594] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:40.127355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:40.128768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:40.190447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e67b6-bbb9-4bf0-80c5-26424dc01170 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:40.194102 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8c5d4-249a-42f7-b84a-502760d296ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:40.194777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8c5d4-249a-42f7-b84a-502760d296ca service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:40.195060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8c5d4-249a-42f7-b84a-502760d296ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:40.195332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8c5d4-249a-42f7-b84a-502760d296ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:40.204577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8c5d4-249a-42f7-b84a-502760d296ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:40.205983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8c5d4-249a-42f7-b84a-502760d296ca service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:40.215899 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1301/2595] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:40.272488 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182017c-f1bd-46c4-9f51-e5c23f3f9be9 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:40.274391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7182017c-f1bd-46c4-9f51-e5c23f3f9be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:40.355754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182017c-f1bd-46c4-9f51-e5c23f3f9be9 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:40.359961 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aea69-a028-4906-89b2-9ac4fe222abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:40.360895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aea69-a028-4906-89b2-9ac4fe222abb service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:40.361180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aea69-a028-4906-89b2-9ac4fe222abb service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:40.361487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aea69-a028-4906-89b2-9ac4fe222abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:40.363256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b58aea69-a028-4906-89b2-9ac4fe222abb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:40.415410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:40.439578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58aea69-a028-4906-89b2-9ac4fe222abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:40.441250 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58aea69-a028-4906-89b2-9ac4fe222abb service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:40.452237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1295/2596] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:40.526388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8c5d4-249a-42f7-b84a-502760d296ca service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:40.527874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0ba8c5d4-249a-42f7-b84a-502760d296ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:40.541035 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8c5d4-249a-42f7-b84a-502760d296ca service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:40.547691 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:40.548784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:40.549084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:40.549415 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260 admin admin] PATH_INFO: `/v3/projects/5fbd4641761f44cc91e2846631d43ea8` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:40.550905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbd4641761f44cc91e2846631d43ea8)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:40.552821 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:40.606406 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbd4641761f44cc91e2846631d43ea8', 'request_id': 'req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:40.613599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbd4641761f44cc91e2846631d43ea8', 'request_id': 'req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:40.620881 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbd4641761f44cc91e2846631d43ea8', 'request_id': 'req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:40.631196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260 admin admin] The token cache is being invalidate because project 5fbd4641761f44cc91e2846631d43ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:40.631486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:40.632137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-59ffe342-3ccc-40ea-8ab3-d9b2efe0a260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:40.633664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1302/2597] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:40 2022] DELETE /identity/v3/projects/5fbd4641761f44cc91e2846631d43ea8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:41.522688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aea69-a028-4906-89b2-9ac4fe222abb service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:41.524287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b58aea69-a028-4906-89b2-9ac4fe222abb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:41.537636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aea69-a028-4906-89b2-9ac4fe222abb service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:41.595006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:41.595883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:41.596168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:41.596443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] PATH_INFO: `/v3/users/2214afead4f647e5afe873f19f482879` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:41.597626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2214afead4f647e5afe873f19f482879)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:41.599577 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:41.647059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2214afead4f647e5afe873f19f482879'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:41.659693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2214afead4f647e5afe873f19f482879'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:41.660354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2214afead4f647e5afe873f19f482879'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:41.667412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2214afead4f647e5afe873f19f482879'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:41.668664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2214afead4f647e5afe873f19f482879'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:41.680756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1296/2598] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:41 2022] DELETE /identity/v3/users/2214afead4f647e5afe873f19f482879 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:41.685527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45dfc-6c4f-41bb-a644-7793e5386501 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:41.686012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45dfc-6c4f-41bb-a644-7793e5386501 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:41.686139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45dfc-6c4f-41bb-a644-7793e5386501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:41.703604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-11b45dfc-6c4f-41bb-a644-7793e5386501 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:41.705067 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-11b45dfc-6c4f-41bb-a644-7793e5386501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:41.749701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:41.765332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1303/2599] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:41.774914 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:41.776381 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:41.835210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14fe20-6658-4a94-81fe-a87bfaf8790a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:41.838990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb17c-130e-40e8-bf9f-b48371a3385a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:41.840413 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb17c-130e-40e8-bf9f-b48371a3385a service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:41.841441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb17c-130e-40e8-bf9f-b48371a3385a service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:41.841716 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb17c-130e-40e8-bf9f-b48371a3385a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:41.851881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeb17c-130e-40e8-bf9f-b48371a3385a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:41.853354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeb17c-130e-40e8-bf9f-b48371a3385a service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:41.858269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:41.866288 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1297/2600] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:42.156664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b45dfc-6c4f-41bb-a644-7793e5386501 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:42.158153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-11b45dfc-6c4f-41bb-a644-7793e5386501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:42.175534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b45dfc-6c4f-41bb-a644-7793e5386501 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:42.180533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:42.182105 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:42.182724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:42.183000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] PATH_INFO: `/v3/projects/e01f6a8993af41f692d4e5ed25f0142f` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:42.184214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e01f6a8993af41f692d4e5ed25f0142f)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:42.186097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:42.231847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e01f6a8993af41f692d4e5ed25f0142f', 'request_id': 'req-4d9badb1-0086-45ef-ac90-44c68872ac57'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.238911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e01f6a8993af41f692d4e5ed25f0142f', 'request_id': 'req-4d9badb1-0086-45ef-ac90-44c68872ac57'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.245014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e01f6a8993af41f692d4e5ed25f0142f', 'request_id': 'req-4d9badb1-0086-45ef-ac90-44c68872ac57'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.255472 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] The token cache is being invalidate because project e01f6a8993af41f692d4e5ed25f0142f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:42.255755 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.256402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.257922 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1304/2601] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:42 2022] DELETE /identity/v3/projects/e01f6a8993af41f692d4e5ed25f0142f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:42.262489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb17c-130e-40e8-bf9f-b48371a3385a service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:42.271971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb17c-130e-40e8-bf9f-b48371a3385a service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:42.367675 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aa914-1a95-4a88-8381-736e6bc5a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:42.368553 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aa914-1a95-4a88-8381-736e6bc5a169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:42.368844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aa914-1a95-4a88-8381-736e6bc5a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:42.369121 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aa914-1a95-4a88-8381-736e6bc5a169 admin admin] PATH_INFO: `/v3/users/2b1a706947a84955b211d327bdb3e358` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:42.372277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81aa914-1a95-4a88-8381-736e6bc5a169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1a706947a84955b211d327bdb3e358)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:42.374712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81aa914-1a95-4a88-8381-736e6bc5a169 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:42.424307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e81aa914-1a95-4a88-8381-736e6bc5a169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1a706947a84955b211d327bdb3e358'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.436658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e81aa914-1a95-4a88-8381-736e6bc5a169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1a706947a84955b211d327bdb3e358'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.437321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e81aa914-1a95-4a88-8381-736e6bc5a169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1a706947a84955b211d327bdb3e358'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.444536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e81aa914-1a95-4a88-8381-736e6bc5a169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1a706947a84955b211d327bdb3e358'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.445312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e81aa914-1a95-4a88-8381-736e6bc5a169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1a706947a84955b211d327bdb3e358'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.458947 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1298/2602] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:42 2022] DELETE /identity/v3/users/2b1a706947a84955b211d327bdb3e358 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:42.731683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:42.733120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:42.746646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9badb1-0086-45ef-ac90-44c68872ac57 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:42.804792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d72c4-4dd4-4e2c-8270-1766585f3eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:42.805662 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d72c4-4dd4-4e2c-8270-1766585f3eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:42.805951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d72c4-4dd4-4e2c-8270-1766585f3eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:42.806228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d72c4-4dd4-4e2c-8270-1766585f3eaa admin admin] PATH_INFO: `/v3/projects/2abfd7ac84bf413380f13630664b04d9` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:42.807443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d72c4-4dd4-4e2c-8270-1766585f3eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abfd7ac84bf413380f13630664b04d9)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:42.809349 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d72c4-4dd4-4e2c-8270-1766585f3eaa admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:42.855694 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-223d72c4-4dd4-4e2c-8270-1766585f3eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abfd7ac84bf413380f13630664b04d9', 'request_id': 'req-223d72c4-4dd4-4e2c-8270-1766585f3eaa'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.863525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-223d72c4-4dd4-4e2c-8270-1766585f3eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abfd7ac84bf413380f13630664b04d9', 'request_id': 'req-223d72c4-4dd4-4e2c-8270-1766585f3eaa'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.870823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-223d72c4-4dd4-4e2c-8270-1766585f3eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abfd7ac84bf413380f13630664b04d9', 'request_id': 'req-223d72c4-4dd4-4e2c-8270-1766585f3eaa'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.881122 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-223d72c4-4dd4-4e2c-8270-1766585f3eaa admin admin] The token cache is being invalidate because project 2abfd7ac84bf413380f13630664b04d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:42.881409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-223d72c4-4dd4-4e2c-8270-1766585f3eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.882072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-223d72c4-4dd4-4e2c-8270-1766585f3eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:42.883643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1305/2603] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:42 2022] DELETE /identity/v3/projects/2abfd7ac84bf413380f13630664b04d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:42.889149 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6930ab-f625-44ea-b88b-7a8d3552f00b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:42.889676 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6930ab-f625-44ea-b88b-7a8d3552f00b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:42.889775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6930ab-f625-44ea-b88b-7a8d3552f00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:42.908288 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9e6930ab-f625-44ea-b88b-7a8d3552f00b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:42.909493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9e6930ab-f625-44ea-b88b-7a8d3552f00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:42.974571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1299/2604] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:42.983111 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e129612-5c8e-49ad-a84d-765c18509f4b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:42.983404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e129612-5c8e-49ad-a84d-765c18509f4b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:42.983729 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e129612-5c8e-49ad-a84d-765c18509f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:42.991422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:43.013331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1e129612-5c8e-49ad-a84d-765c18509f4b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:43.014574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1e129612-5c8e-49ad-a84d-765c18509f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:43.023833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1306/2605] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:43.028557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6930ab-f625-44ea-b88b-7a8d3552f00b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:43.038750 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6930ab-f625-44ea-b88b-7a8d3552f00b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:43.044098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc6f9-b424-45f9-810c-36f5b8b59ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:43.044763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc6f9-b424-45f9-810c-36f5b8b59ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:43.045043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc6f9-b424-45f9-810c-36f5b8b59ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:43.045317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc6f9-b424-45f9-810c-36f5b8b59ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:43.046089 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cc6f9-b424-45f9-810c-36f5b8b59ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:43.046342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cc6f9-b424-45f9-810c-36f5b8b59ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:43.047968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cc6f9-b424-45f9-810c-36f5b8b59ff9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:43.062540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1300/2606] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:43.066291 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e129612-5c8e-49ad-a84d-765c18509f4b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:43.077552 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e129612-5c8e-49ad-a84d-765c18509f4b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:43.082815 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a37c12-8db2-43ba-8d00-933e0336c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:43.083486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a37c12-8db2-43ba-8d00-933e0336c1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:43.083771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a37c12-8db2-43ba-8d00-933e0336c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:43.084052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a37c12-8db2-43ba-8d00-933e0336c1e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:43.086163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a37c12-8db2-43ba-8d00-933e0336c1e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:43.088095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a37c12-8db2-43ba-8d00-933e0336c1e2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:43.127142 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1307/2607] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:43 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:43.127238 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc6f9-b424-45f9-810c-36f5b8b59ff9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:43.133591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:43.137686 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc6f9-b424-45f9-810c-36f5b8b59ff9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:43.209020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c5823-9393-4bf3-8831-dd4e16d90fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:43.209784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c5823-9393-4bf3-8831-dd4e16d90fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:43.210073 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c5823-9393-4bf3-8831-dd4e16d90fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:43.210348 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c5823-9393-4bf3-8831-dd4e16d90fbc admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:43.211114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c5823-9393-4bf3-8831-dd4e16d90fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:43.213087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c5823-9393-4bf3-8831-dd4e16d90fbc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:43.238298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1301/2608] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:43 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:43.244031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a37c12-8db2-43ba-8d00-933e0336c1e2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:43.271172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a37c12-8db2-43ba-8d00-933e0336c1e2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:43.301865 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d768e4-6c53-491f-8bee-0ff3b244f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:43.302711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d768e4-6c53-491f-8bee-0ff3b244f3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:43.302877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d768e4-6c53-491f-8bee-0ff3b244f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:43.303170 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d768e4-6c53-491f-8bee-0ff3b244f3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:43.303909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d768e4-6c53-491f-8bee-0ff3b244f3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:43.310165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d768e4-6c53-491f-8bee-0ff3b244f3dc admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:43.329590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1308/2609] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:43.333275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c5823-9393-4bf3-8831-dd4e16d90fbc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:43.344600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c5823-9393-4bf3-8831-dd4e16d90fbc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:43.349911 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a684d-e42e-4160-ae53-615b3e5d711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:43.350916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a684d-e42e-4160-ae53-615b3e5d711c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:43.351214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a684d-e42e-4160-ae53-615b3e5d711c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:43.351485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a684d-e42e-4160-ae53-615b3e5d711c admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:43.353148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a684d-e42e-4160-ae53-615b3e5d711c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:43.354008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a684d-e42e-4160-ae53-615b3e5d711c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:43.371680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d768e4-6c53-491f-8bee-0ff3b244f3dc admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:43.374492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1302/2610] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:43.383295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d768e4-6c53-491f-8bee-0ff3b244f3dc admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:43.389264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a3273-55d2-4070-a22b-0a59cad5850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:43.390192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a3273-55d2-4070-a22b-0a59cad5850a admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:43.390485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a3273-55d2-4070-a22b-0a59cad5850a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:43.390767 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a3273-55d2-4070-a22b-0a59cad5850a admin admin] PATH_INFO: `/v3/projects/783866e24f3b427aac070776d0f179e1/users/0432beb264554dac86b59e80aa9ec760/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:43.407789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a3273-55d2-4070-a22b-0a59cad5850a admin admin] RBAC: Authorizing `identity:create_grant(project_id=783866e24f3b427aac070776d0f179e1, user_id=0432beb264554dac86b59e80aa9ec760, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:43.410558 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a3273-55d2-4070-a22b-0a59cad5850a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:43.427010 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1309/2611] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:43 2022] PUT /identity/v3/projects/783866e24f3b427aac070776d0f179e1/users/0432beb264554dac86b59e80aa9ec760/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:43.437080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62e0d8-43a9-4523-8f60-7501e4e4a1a1 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:43.437379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62e0d8-43a9-4523-8f60-7501e4e4a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:43.437688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62e0d8-43a9-4523-8f60-7501e4e4a1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:43.469605 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-cb62e0d8-43a9-4523-8f60-7501e4e4a1a1 None None] MFA Rules not processed for user `0432beb264554dac86b59e80aa9ec760`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:43.471069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cb62e0d8-43a9-4523-8f60-7501e4e4a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:43.550455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1303/2612] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:43.562191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a3273-55d2-4070-a22b-0a59cad5850a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:43.564044 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0d1a3273-55d2-4070-a22b-0a59cad5850a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:43.629089 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a3273-55d2-4070-a22b-0a59cad5850a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:43.633167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe404b7-370a-4a0f-9799-0307916ecf38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:43.634089 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe404b7-370a-4a0f-9799-0307916ecf38 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:43.634611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe404b7-370a-4a0f-9799-0307916ecf38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:43.635114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe404b7-370a-4a0f-9799-0307916ecf38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:43.644165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe404b7-370a-4a0f-9799-0307916ecf38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:43.645773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe404b7-370a-4a0f-9799-0307916ecf38 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:43.655510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1310/2613] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:46.749124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62e0d8-43a9-4523-8f60-7501e4e4a1a1 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:46.821092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62e0d8-43a9-4523-8f60-7501e4e4a1a1 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:46.831129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:46.833202 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:46.833494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:46.833767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] PATH_INFO: `/v3/users/0432beb264554dac86b59e80aa9ec760` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:46.834999 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0432beb264554dac86b59e80aa9ec760)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:46.837099 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:46.854514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:46.908116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0432beb264554dac86b59e80aa9ec760'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:46.929205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0432beb264554dac86b59e80aa9ec760'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:46.929968 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0432beb264554dac86b59e80aa9ec760'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:46.943531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0432beb264554dac86b59e80aa9ec760'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:46.944735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0432beb264554dac86b59e80aa9ec760'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:46.972507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1304/2614] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:46 2022] DELETE /identity/v3/users/0432beb264554dac86b59e80aa9ec760 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:46.977448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661963fb-03b6-4a99-a673-0e1e5b2b94db None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:46.977909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661963fb-03b6-4a99-a673-0e1e5b2b94db None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:46.977993 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661963fb-03b6-4a99-a673-0e1e5b2b94db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:47.000074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-661963fb-03b6-4a99-a673-0e1e5b2b94db None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:47.001281 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-661963fb-03b6-4a99-a673-0e1e5b2b94db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:47.066633 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1311/2615] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:47.079906 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:47.081433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:47.149558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76209a5-8ed9-4ee9-9324-b982c0306af2 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:47.154048 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df56bf-cdc0-444b-a905-e07bc32e0df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:47.155044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df56bf-cdc0-444b-a905-e07bc32e0df9 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:47.155441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df56bf-cdc0-444b-a905-e07bc32e0df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:47.155728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df56bf-cdc0-444b-a905-e07bc32e0df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:47.165607 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df56bf-cdc0-444b-a905-e07bc32e0df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:47.167125 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df56bf-cdc0-444b-a905-e07bc32e0df9 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:47.177630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1305/2616] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:47.451756 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661963fb-03b6-4a99-a673-0e1e5b2b94db None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:47.453288 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-661963fb-03b6-4a99-a673-0e1e5b2b94db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:47.469338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661963fb-03b6-4a99-a673-0e1e5b2b94db None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:47.475438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:47.476478 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:47.476908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:47.477276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] PATH_INFO: `/v3/projects/783866e24f3b427aac070776d0f179e1` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:47.478535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] RBAC: Authorizing `identity:delete_project(project_id=783866e24f3b427aac070776d0f179e1)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:47.480995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:47.526052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:47.536402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783866e24f3b427aac070776d0f179e1', 'request_id': 'req-94c99af5-3cd8-4691-9068-50be06fcb30c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:47.545541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783866e24f3b427aac070776d0f179e1', 'request_id': 'req-94c99af5-3cd8-4691-9068-50be06fcb30c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:47.553022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783866e24f3b427aac070776d0f179e1', 'request_id': 'req-94c99af5-3cd8-4691-9068-50be06fcb30c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:47.564801 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] The token cache is being invalidate because project 783866e24f3b427aac070776d0f179e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:47.565176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:47.567895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:47.569651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1312/2617] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:47 2022] DELETE /identity/v3/projects/783866e24f3b427aac070776d0f179e1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:50.000564 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df56bf-cdc0-444b-a905-e07bc32e0df9 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:50.009252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df56bf-cdc0-444b-a905-e07bc32e0df9 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:50.056931 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea632fa-e743-4758-a9a3-ac83c110ce5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:50.057482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea632fa-e743-4758-a9a3-ac83c110ce5b service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:50.057766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea632fa-e743-4758-a9a3-ac83c110ce5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:50.058715 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea632fa-e743-4758-a9a3-ac83c110ce5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:50.060479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8ea632fa-e743-4758-a9a3-ac83c110ce5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:50.106722 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:50.124329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea632fa-e743-4758-a9a3-ac83c110ce5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:50.125766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea632fa-e743-4758-a9a3-ac83c110ce5b service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:50.135500 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1306/2618] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:53.190316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:53.191773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:53.193315 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea632fa-e743-4758-a9a3-ac83c110ce5b service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:53.194839 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8ea632fa-e743-4758-a9a3-ac83c110ce5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:53.206760 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c99af5-3cd8-4691-9068-50be06fcb30c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:53.211440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832b04a-f7da-49c5-8921-e70aca31b126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:53.212457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832b04a-f7da-49c5-8921-e70aca31b126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:53.212827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832b04a-f7da-49c5-8921-e70aca31b126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:53.213178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832b04a-f7da-49c5-8921-e70aca31b126 admin admin] PATH_INFO: `/v3/users/6d3bf3338d424fbc9e45f83b43261777` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:53.215360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832b04a-f7da-49c5-8921-e70aca31b126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d3bf3338d424fbc9e45f83b43261777)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:53.217423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832b04a-f7da-49c5-8921-e70aca31b126 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:53.280656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6832b04a-f7da-49c5-8921-e70aca31b126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d3bf3338d424fbc9e45f83b43261777'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.281402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6832b04a-f7da-49c5-8921-e70aca31b126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d3bf3338d424fbc9e45f83b43261777'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.283360 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea632fa-e743-4758-a9a3-ac83c110ce5b service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:53.288359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b26531-dce2-4718-97e2-1ce3e4200730 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81fb8b261e2142fcbf8d23bd010bf715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:53.288509 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6832b04a-f7da-49c5-8921-e70aca31b126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d3bf3338d424fbc9e45f83b43261777'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.289034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b26531-dce2-4718-97e2-1ce3e4200730 service placement] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:53.289317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b26531-dce2-4718-97e2-1ce3e4200730 service placement] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:53.289592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b26531-dce2-4718-97e2-1ce3e4200730 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:53.291420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-35b26531-dce2-4718-97e2-1ce3e4200730 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:53.297260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6832b04a-f7da-49c5-8921-e70aca31b126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d3bf3338d424fbc9e45f83b43261777'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.297956 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6832b04a-f7da-49c5-8921-e70aca31b126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d3bf3338d424fbc9e45f83b43261777'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.304223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b26531-dce2-4718-97e2-1ce3e4200730 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:53.305795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b26531-dce2-4718-97e2-1ce3e4200730 service placement] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:53.317213 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1307/2619] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:15:53.317390 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1313/2620] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:53 2022] DELETE /identity/v3/users/6d3bf3338d424fbc9e45f83b43261777 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:53.319886 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b26531-dce2-4718-97e2-1ce3e4200730 service placement] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:53.321271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-35b26531-dce2-4718-97e2-1ce3e4200730 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:53.321615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e04e9-69e6-4b11-a0ec-2c8d42a0368e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:53.321914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e04e9-69e6-4b11-a0ec-2c8d42a0368e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:53.322198 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e04e9-69e6-4b11-a0ec-2c8d42a0368e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:53.336222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b26531-dce2-4718-97e2-1ce3e4200730 service placement] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:53.342088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b29e04e9-69e6-4b11-a0ec-2c8d42a0368e None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:53.343059 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b29e04e9-69e6-4b11-a0ec-2c8d42a0368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:53.395747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:53.396631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:53.396941 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:53.397231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] PATH_INFO: `/v3/users/4ae911b452a04efe98022f47ae9dcbca` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:53.398454 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae911b452a04efe98022f47ae9dcbca)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:53.400390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:53.406582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1314/2621] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:53.416169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e04e9-69e6-4b11-a0ec-2c8d42a0368e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:53.418224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b29e04e9-69e6-4b11-a0ec-2c8d42a0368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:53.452661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae911b452a04efe98022f47ae9dcbca'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.464830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:53.465160 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae911b452a04efe98022f47ae9dcbca'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.465884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae911b452a04efe98022f47ae9dcbca'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.474639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae911b452a04efe98022f47ae9dcbca'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.475498 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae911b452a04efe98022f47ae9dcbca'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.480973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:53.482504 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e04e9-69e6-4b11-a0ec-2c8d42a0368e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:53.486741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d33d9a-03d8-4be2-bd3a-a616e9914049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:53.487402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d33d9a-03d8-4be2-bd3a-a616e9914049 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:53.487698 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d33d9a-03d8-4be2-bd3a-a616e9914049 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:53.488085 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d33d9a-03d8-4be2-bd3a-a616e9914049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:53.489963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-71d33d9a-03d8-4be2-bd3a-a616e9914049 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:53.492080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1308/2622] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:53 2022] DELETE /identity/v3/users/4ae911b452a04efe98022f47ae9dcbca => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:53.503137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d33d9a-03d8-4be2-bd3a-a616e9914049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:53.504535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d33d9a-03d8-4be2-bd3a-a616e9914049 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:53.515266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1315/2623] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:15:53.795919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:53.797480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:53.894177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d33d9a-03d8-4be2-bd3a-a616e9914049 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:53.895598 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-71d33d9a-03d8-4be2-bd3a-a616e9914049 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:53.906679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad56bee-43bb-4ce0-b318-94dc291cbd45 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:53.911748 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d33d9a-03d8-4be2-bd3a-a616e9914049 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:53.913729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fdb1e-d888-4eb6-b4fb-a2788e359c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:53.914712 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fdb1e-d888-4eb6-b4fb-a2788e359c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:53.914920 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fdb1e-d888-4eb6-b4fb-a2788e359c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:53.915241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fdb1e-d888-4eb6-b4fb-a2788e359c74 admin admin] PATH_INFO: `/v3/projects/47302f58f9304674983357938c169424` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:53.916447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fdb1e-d888-4eb6-b4fb-a2788e359c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47302f58f9304674983357938c169424)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:53.917813 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:53.918941 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:53.919333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:53.919540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fdb1e-d888-4eb6-b4fb-a2788e359c74 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:53.919805 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] PATH_INFO: `/v3/projects/e080a606872243a4a229324849e406d1` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:53.921239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e080a606872243a4a229324849e406d1)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:53.923705 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:53.985295 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e080a606872243a4a229324849e406d1', 'request_id': 'req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.989172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-627fdb1e-d888-4eb6-b4fb-a2788e359c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47302f58f9304674983357938c169424', 'request_id': 'req-627fdb1e-d888-4eb6-b4fb-a2788e359c74'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.995996 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e080a606872243a4a229324849e406d1', 'request_id': 'req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:53.999604 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-627fdb1e-d888-4eb6-b4fb-a2788e359c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47302f58f9304674983357938c169424', 'request_id': 'req-627fdb1e-d888-4eb6-b4fb-a2788e359c74'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.003185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e080a606872243a4a229324849e406d1', 'request_id': 'req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.008844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-627fdb1e-d888-4eb6-b4fb-a2788e359c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47302f58f9304674983357938c169424', 'request_id': 'req-627fdb1e-d888-4eb6-b4fb-a2788e359c74'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.017103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] The token cache is being invalidate because project e080a606872243a4a229324849e406d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:54.017501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.018303 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.019923 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1316/2624] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:53 2022] DELETE /identity/v3/projects/e080a606872243a4a229324849e406d1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:54.024112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.025641 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:54.027374 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-627fdb1e-d888-4eb6-b4fb-a2788e359c74 admin admin] The token cache is being invalidate because project 47302f58f9304674983357938c169424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:54.027666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-627fdb1e-d888-4eb6-b4fb-a2788e359c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.028310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-627fdb1e-d888-4eb6-b4fb-a2788e359c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.029835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1309/2625] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:53 2022] DELETE /identity/v3/projects/47302f58f9304674983357938c169424 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:54.034740 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bc87c-46f0-4a7f-9fac-92fa5e1a18b4 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.035029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bc87c-46f0-4a7f-9fac-92fa5e1a18b4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.035308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bc87c-46f0-4a7f-9fac-92fa5e1a18b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.054006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4b3bc87c-46f0-4a7f-9fac-92fa5e1a18b4 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:54.055324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4b3bc87c-46f0-4a7f-9fac-92fa5e1a18b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:54.093039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc0f8-6c22-4ac2-8418-e5fc098b9e78 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:54.119371 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1310/2626] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:54.127575 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b44ed-2726-4d6a-811d-7e4c7356806f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.127866 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b44ed-2726-4d6a-811d-7e4c7356806f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.128153 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b44ed-2726-4d6a-811d-7e4c7356806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.145783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-875b44ed-2726-4d6a-811d-7e4c7356806f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:54.147024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-875b44ed-2726-4d6a-811d-7e4c7356806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:54.153364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:54.154251 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.154575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.154879 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] PATH_INFO: `/v3/users/de828fd2ca144de08150847e6fefe6ed` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.154997 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1311/2627] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:54.156088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de828fd2ca144de08150847e6fefe6ed)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:54.158571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:54.159125 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b44ed-2726-4d6a-811d-7e4c7356806f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.169825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b44ed-2726-4d6a-811d-7e4c7356806f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:54.174223 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:54.174422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d39d4-2b92-413d-8d19-9cc53e41eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:54.175195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d39d4-2b92-413d-8d19-9cc53e41eb33 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.175370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d39d4-2b92-413d-8d19-9cc53e41eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.175694 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d39d4-2b92-413d-8d19-9cc53e41eb33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.176526 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d39d4-2b92-413d-8d19-9cc53e41eb33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:54.177458 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d39d4-2b92-413d-8d19-9cc53e41eb33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:54.178604 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d39d4-2b92-413d-8d19-9cc53e41eb33 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:54.191794 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1312/2628] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:15:54.195908 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d39d4-2b92-413d-8d19-9cc53e41eb33 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.203171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:54.208456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d39d4-2b92-413d-8d19-9cc53e41eb33 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:54.214045 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de828fd2ca144de08150847e6fefe6ed'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.214959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf6a91-3a93-46b9-a2fd-493c4b6fb5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:54.215113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de828fd2ca144de08150847e6fefe6ed'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.215696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf6a91-3a93-46b9-a2fd-493c4b6fb5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.216197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf6a91-3a93-46b9-a2fd-493c4b6fb5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.216480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf6a91-3a93-46b9-a2fd-493c4b6fb5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.217169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf6a91-3a93-46b9-a2fd-493c4b6fb5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:54.219113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf6a91-3a93-46b9-a2fd-493c4b6fb5f5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:54.221925 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de828fd2ca144de08150847e6fefe6ed'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.230027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de828fd2ca144de08150847e6fefe6ed'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.231305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de828fd2ca144de08150847e6fefe6ed'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.251836 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1313/2629] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:54 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:54.252843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf6a91-3a93-46b9-a2fd-493c4b6fb5f5 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.254230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1317/2630] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:54 2022] DELETE /identity/v3/users/de828fd2ca144de08150847e6fefe6ed => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:54.254468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3eaf6a91-3a93-46b9-a2fd-493c4b6fb5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:54.322562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf6a91-3a93-46b9-a2fd-493c4b6fb5f5 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:54.387389 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72907c-6d00-4167-968c-299cd7314f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:54.396057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72907c-6d00-4167-968c-299cd7314f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.396364 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72907c-6d00-4167-968c-299cd7314f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.396644 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72907c-6d00-4167-968c-299cd7314f5a admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.397358 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72907c-6d00-4167-968c-299cd7314f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:54.399583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72907c-6d00-4167-968c-299cd7314f5a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:54.426287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1314/2631] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:54 2022] POST /identity/v3/users => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:54.427553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.438081 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270592a8-32f7-4c0b-98e2-32789a9e7f0b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:54.443978 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46c55a-5bfb-43ef-aef2-55f94286a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:54.444503 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46c55a-5bfb-43ef-aef2-55f94286a457 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.444801 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46c55a-5bfb-43ef-aef2-55f94286a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.445166 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46c55a-5bfb-43ef-aef2-55f94286a457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.445965 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46c55a-5bfb-43ef-aef2-55f94286a457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:54.447722 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46c55a-5bfb-43ef-aef2-55f94286a457 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:54.462712 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1318/2632] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:54.464723 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72907c-6d00-4167-968c-299cd7314f5a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.475790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72907c-6d00-4167-968c-299cd7314f5a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:54.481119 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e84ec9-e309-4a8c-90c8-b17333a89042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:54.481788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e84ec9-e309-4a8c-90c8-b17333a89042 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.482075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e84ec9-e309-4a8c-90c8-b17333a89042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.482354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e84ec9-e309-4a8c-90c8-b17333a89042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.483111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e84ec9-e309-4a8c-90c8-b17333a89042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:54.484695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e84ec9-e309-4a8c-90c8-b17333a89042 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:54.498044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1315/2633] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:54.499096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46c55a-5bfb-43ef-aef2-55f94286a457 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.509227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46c55a-5bfb-43ef-aef2-55f94286a457 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:54.514250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca6ce-20ab-4bbd-936b-75155715c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:54.515240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca6ce-20ab-4bbd-936b-75155715c887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.515594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca6ce-20ab-4bbd-936b-75155715c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.515961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca6ce-20ab-4bbd-936b-75155715c887 admin admin] PATH_INFO: `/v3/projects/e564e936ab07493790a9a3d438b0ca2a/users/297156a41c3a4c27b11b8ff2868952c4/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.532230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cca6ce-20ab-4bbd-936b-75155715c887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e564e936ab07493790a9a3d438b0ca2a, user_id=297156a41c3a4c27b11b8ff2868952c4, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:54.535181 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cca6ce-20ab-4bbd-936b-75155715c887 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:54.549363 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1319/2634] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:54 2022] PUT /identity/v3/projects/e564e936ab07493790a9a3d438b0ca2a/users/297156a41c3a4c27b11b8ff2868952c4/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:54.552151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e84ec9-e309-4a8c-90c8-b17333a89042 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.555139 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e0dd6-1d16-457c-a836-4208ef95feed None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.555455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e0dd6-1d16-457c-a836-4208ef95feed None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.555780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e0dd6-1d16-457c-a836-4208ef95feed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.556046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-78e84ec9-e309-4a8c-90c8-b17333a89042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:54.578820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8b2e0dd6-1d16-457c-a836-4208ef95feed None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:54.580293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8b2e0dd6-1d16-457c-a836-4208ef95feed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:54.583193 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e84ec9-e309-4a8c-90c8-b17333a89042 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:54.645122 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:54.645642 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1320/2635] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:54.646012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.646304 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.646622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6 admin admin] PATH_INFO: `/v3/projects/77ac53beb4a4406f9afcd2883955151e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.647821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ac53beb4a4406f9afcd2883955151e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:54.649738 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:54.655778 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e0dd6-1d16-457c-a836-4208ef95feed None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.657115 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8b2e0dd6-1d16-457c-a836-4208ef95feed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:54.661547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:54.702735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ac53beb4a4406f9afcd2883955151e', 'request_id': 'req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.708396 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ac53beb4a4406f9afcd2883955151e', 'request_id': 'req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.715305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ac53beb4a4406f9afcd2883955151e', 'request_id': 'req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.723538 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e0dd6-1d16-457c-a836-4208ef95feed None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:54.732827 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6 admin admin] The token cache is being invalidate because project 77ac53beb4a4406f9afcd2883955151e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:54.733992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.733992 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-ba34e66e-0b96-46e1-a25f-756fcdcdc1f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:54.735038 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:54.736257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1316/2636] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:54 2022] DELETE /identity/v3/projects/77ac53beb4a4406f9afcd2883955151e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:54.741118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996cb8c-34ec-4103-b6cb-6d7ca55a71fb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.741414 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996cb8c-34ec-4103-b6cb-6d7ca55a71fb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.741697 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996cb8c-34ec-4103-b6cb-6d7ca55a71fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.761820 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9996cb8c-34ec-4103-b6cb-6d7ca55a71fb None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:54.763192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9996cb8c-34ec-4103-b6cb-6d7ca55a71fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:54.783098 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad551895-4b34-46de-97e8-4e4a404ca5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:54.783699 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad551895-4b34-46de-97e8-4e4a404ca5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.783982 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad551895-4b34-46de-97e8-4e4a404ca5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.784256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad551895-4b34-46de-97e8-4e4a404ca5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.786039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ad551895-4b34-46de-97e8-4e4a404ca5c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:54.841328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1317/2637] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:54.851317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad551895-4b34-46de-97e8-4e4a404ca5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:54.851589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f178e6-feb3-4eae-ab59-e5bd71b63aa4 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.851887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f178e6-feb3-4eae-ab59-e5bd71b63aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.852667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f178e6-feb3-4eae-ab59-e5bd71b63aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.852775 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad551895-4b34-46de-97e8-4e4a404ca5c0 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:54.862340 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1321/2638] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:15:54.872029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-05f178e6-feb3-4eae-ab59-e5bd71b63aa4 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:54.873237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-05f178e6-feb3-4eae-ab59-e5bd71b63aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:54.881316 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1318/2639] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:54.885306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad551895-4b34-46de-97e8-4e4a404ca5c0 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.896613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad551895-4b34-46de-97e8-4e4a404ca5c0 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:54.901402 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84510e3f-d08c-48ba-9fea-19b9e2775470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:54.903178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84510e3f-d08c-48ba-9fea-19b9e2775470 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.903576 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84510e3f-d08c-48ba-9fea-19b9e2775470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.903983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84510e3f-d08c-48ba-9fea-19b9e2775470 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.904708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84510e3f-d08c-48ba-9fea-19b9e2775470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:54.905014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84510e3f-d08c-48ba-9fea-19b9e2775470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:54.906625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84510e3f-d08c-48ba-9fea-19b9e2775470 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:54.919223 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1322/2640] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:54.923234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f178e6-feb3-4eae-ab59-e5bd71b63aa4 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.933602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f178e6-feb3-4eae-ab59-e5bd71b63aa4 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:54.939023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d4c87-a854-4d63-8fcf-f71706ecc02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:54.939690 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d4c87-a854-4d63-8fcf-f71706ecc02d admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.940052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d4c87-a854-4d63-8fcf-f71706ecc02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.940563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d4c87-a854-4d63-8fcf-f71706ecc02d admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.941294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d4c87-a854-4d63-8fcf-f71706ecc02d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:54.943267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d4c87-a854-4d63-8fcf-f71706ecc02d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:54.973267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1319/2641] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:54 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:54.977328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84510e3f-d08c-48ba-9fea-19b9e2775470 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.988717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84510e3f-d08c-48ba-9fea-19b9e2775470 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.050191 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a577e-f8de-4c4c-8c92-5225f2cc5587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.050905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a577e-f8de-4c4c-8c92-5225f2cc5587 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.051316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a577e-f8de-4c4c-8c92-5225f2cc5587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.051606 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a577e-f8de-4c4c-8c92-5225f2cc5587 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.052313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a577e-f8de-4c4c-8c92-5225f2cc5587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.054233 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a577e-f8de-4c4c-8c92-5225f2cc5587 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.075731 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1323/2642] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:54 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:55.079869 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d4c87-a854-4d63-8fcf-f71706ecc02d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.091059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d4c87-a854-4d63-8fcf-f71706ecc02d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.095710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cc3b4-66dd-414e-b34b-34380db7b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.096381 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc3b4-66dd-414e-b34b-34380db7b20c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.096723 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc3b4-66dd-414e-b34b-34380db7b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.096949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc3b4-66dd-414e-b34b-34380db7b20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.097678 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cc3b4-66dd-414e-b34b-34380db7b20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.099312 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cc3b4-66dd-414e-b34b-34380db7b20c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.110469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1320/2643] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:55.114464 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a577e-f8de-4c4c-8c92-5225f2cc5587 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.126341 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a577e-f8de-4c4c-8c92-5225f2cc5587 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.131260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217150f-dcdb-4938-abbe-e0f70d5d47c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.132002 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217150f-dcdb-4938-abbe-e0f70d5d47c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.132369 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217150f-dcdb-4938-abbe-e0f70d5d47c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.132718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217150f-dcdb-4938-abbe-e0f70d5d47c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.133519 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217150f-dcdb-4938-abbe-e0f70d5d47c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.135204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217150f-dcdb-4938-abbe-e0f70d5d47c1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.146574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1324/2644] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:55.150497 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cc3b4-66dd-414e-b34b-34380db7b20c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.161518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cc3b4-66dd-414e-b34b-34380db7b20c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.166422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362a945-ff91-4914-b894-594ab63358c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.167473 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362a945-ff91-4914-b894-594ab63358c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.167885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362a945-ff91-4914-b894-594ab63358c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.168242 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362a945-ff91-4914-b894-594ab63358c9 admin admin] PATH_INFO: `/v3/projects/d7dd46f48c5145c39ad8a461a2c5eefa/users/c2088fe5df4e445eb69835c42000b5dc/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.187701 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362a945-ff91-4914-b894-594ab63358c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7dd46f48c5145c39ad8a461a2c5eefa, user_id=c2088fe5df4e445eb69835c42000b5dc, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.190490 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362a945-ff91-4914-b894-594ab63358c9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.210033 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1321/2645] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:55 2022] PUT /identity/v3/projects/d7dd46f48c5145c39ad8a461a2c5eefa/users/c2088fe5df4e445eb69835c42000b5dc/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:55.220443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c423ec-fa8c-4231-b3de-c25c45cb2d22 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.220903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c423ec-fa8c-4231-b3de-c25c45cb2d22 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.221027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c423ec-fa8c-4231-b3de-c25c45cb2d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.250412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b1c423ec-fa8c-4231-b3de-c25c45cb2d22 None None] MFA Rules not processed for user `c2088fe5df4e445eb69835c42000b5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:55.251659 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b1c423ec-fa8c-4231-b3de-c25c45cb2d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:55.271150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:55.325389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1325/2646] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:55.330116 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362a945-ff91-4914-b894-594ab63358c9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.370915 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:55.397397 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362a945-ff91-4914-b894-594ab63358c9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.403472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fec2df-e64f-477f-8afc-e1ed37aa5ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.404249 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fec2df-e64f-477f-8afc-e1ed37aa5ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.404538 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fec2df-e64f-477f-8afc-e1ed37aa5ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.404811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fec2df-e64f-477f-8afc-e1ed37aa5ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.405500 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fec2df-e64f-477f-8afc-e1ed37aa5ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.407439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fec2df-e64f-477f-8afc-e1ed37aa5ce6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.438822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1322/2647] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:55 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:55.440468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c423ec-fa8c-4231-b3de-c25c45cb2d22 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.451853 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c423ec-fa8c-4231-b3de-c25c45cb2d22 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.501723 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9eca6-a912-4594-8105-28d6856dbcbd None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.502018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9eca6-a912-4594-8105-28d6856dbcbd None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.502299 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9eca6-a912-4594-8105-28d6856dbcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.528391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5bef7-9c79-442e-86d1-0b0cffdc42a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.529372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5bef7-9c79-442e-86d1-0b0cffdc42a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.529667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5bef7-9c79-442e-86d1-0b0cffdc42a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.529947 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5bef7-9c79-442e-86d1-0b0cffdc42a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.530631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b9c9eca6-a912-4594-8105-28d6856dbcbd None None] MFA Rules not processed for user `297156a41c3a4c27b11b8ff2868952c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:55.531015 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5bef7-9c79-442e-86d1-0b0cffdc42a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.531974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b9c9eca6-a912-4594-8105-28d6856dbcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:55.533146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5bef7-9c79-442e-86d1-0b0cffdc42a9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.566314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1326/2648] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:55 2022] POST /identity/v3/users => generated 306 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:55.567344 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5bef7-9c79-442e-86d1-0b0cffdc42a9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.580412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5bef7-9c79-442e-86d1-0b0cffdc42a9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.586826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18615c15-7f3f-480d-895f-9bfab964b8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.587437 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615c15-7f3f-480d-895f-9bfab964b8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.587724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615c15-7f3f-480d-895f-9bfab964b8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.588007 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615c15-7f3f-480d-895f-9bfab964b8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.588735 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18615c15-7f3f-480d-895f-9bfab964b8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.590930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18615c15-7f3f-480d-895f-9bfab964b8d1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.601634 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1327/2649] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:55.605531 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18615c15-7f3f-480d-895f-9bfab964b8d1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.606494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1323/2650] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:55.609918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9eca6-a912-4594-8105-28d6856dbcbd None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.612074 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b9c9eca6-a912-4594-8105-28d6856dbcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:55.616378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18615c15-7f3f-480d-895f-9bfab964b8d1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.622467 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1571987-9fcc-4cd3-8de3-4ac66f8121d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.623485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1571987-9fcc-4cd3-8de3-4ac66f8121d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.623651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1571987-9fcc-4cd3-8de3-4ac66f8121d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.623937 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1571987-9fcc-4cd3-8de3-4ac66f8121d9 admin admin] PATH_INFO: `/v3/projects/b79584b2529b40808f8bd5c5ab23cd4e/users/2f9cb3b20fe04cd1b8e8315121d18298/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.630393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9eca6-a912-4594-8105-28d6856dbcbd None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.635559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6c00c-eb3c-4f2f-b1c1-daa1d3be8535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.637104 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c00c-eb3c-4f2f-b1c1-daa1d3be8535 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.637436 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c00c-eb3c-4f2f-b1c1-daa1d3be8535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.637714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c00c-eb3c-4f2f-b1c1-daa1d3be8535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.638455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6c00c-eb3c-4f2f-b1c1-daa1d3be8535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.640114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1571987-9fcc-4cd3-8de3-4ac66f8121d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79584b2529b40808f8bd5c5ab23cd4e, user_id=2f9cb3b20fe04cd1b8e8315121d18298, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.640579 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6c00c-eb3c-4f2f-b1c1-daa1d3be8535 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.642778 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1571987-9fcc-4cd3-8de3-4ac66f8121d9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.661910 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1328/2651] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:55 2022] PUT /identity/v3/projects/b79584b2529b40808f8bd5c5ab23cd4e/users/2f9cb3b20fe04cd1b8e8315121d18298/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:55.665428 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1571987-9fcc-4cd3-8de3-4ac66f8121d9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.672578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1324/2652] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:55 2022] POST /identity/v3/projects => generated 403 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:55.676827 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6c00c-eb3c-4f2f-b1c1-daa1d3be8535 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.735949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1571987-9fcc-4cd3-8de3-4ac66f8121d9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.744962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6c00c-eb3c-4f2f-b1c1-daa1d3be8535 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.751391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8f8c8-5bf4-4356-b6c1-a04067ed8bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.752080 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8f8c8-5bf4-4356-b6c1-a04067ed8bec admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.752496 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:55.752822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8f8c8-5bf4-4356-b6c1-a04067ed8bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.753111 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8f8c8-5bf4-4356-b6c1-a04067ed8bec admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.753857 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8f8c8-5bf4-4356-b6c1-a04067ed8bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.757745 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8f8c8-5bf4-4356-b6c1-a04067ed8bec admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.793329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1325/2653] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:55 2022] POST /identity/v3/users => generated 308 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:15:55.794764 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8f8c8-5bf4-4356-b6c1-a04067ed8bec admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.802347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738a3ec-11f1-4256-b4db-b9dc6c2c2650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.803050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738a3ec-11f1-4256-b4db-b9dc6c2c2650 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.803332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738a3ec-11f1-4256-b4db-b9dc6c2c2650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.803605 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738a3ec-11f1-4256-b4db-b9dc6c2c2650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.804326 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738a3ec-11f1-4256-b4db-b9dc6c2c2650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.804448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8f8c8-5bf4-4356-b6c1-a04067ed8bec admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.805930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738a3ec-11f1-4256-b4db-b9dc6c2c2650 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.809638 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad15603-2ca1-4c6e-9b92-1b4c47be2a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.810286 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad15603-2ca1-4c6e-9b92-1b4c47be2a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.810616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad15603-2ca1-4c6e-9b92-1b4c47be2a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.810901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad15603-2ca1-4c6e-9b92-1b4c47be2a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.811640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad15603-2ca1-4c6e-9b92-1b4c47be2a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.813224 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad15603-2ca1-4c6e-9b92-1b4c47be2a12 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.816646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1329/2654] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:55.820410 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738a3ec-11f1-4256-b4db-b9dc6c2c2650 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.824122 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1326/2655] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:55.828640 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad15603-2ca1-4c6e-9b92-1b4c47be2a12 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.831199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738a3ec-11f1-4256-b4db-b9dc6c2c2650 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.836240 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b953955-82b8-434f-b10e-57c2fbc5d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.837315 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b953955-82b8-434f-b10e-57c2fbc5d191 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.837578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b953955-82b8-434f-b10e-57c2fbc5d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.837979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b953955-82b8-434f-b10e-57c2fbc5d191 admin admin] PATH_INFO: `/v3/projects/b79584b2529b40808f8bd5c5ab23cd4e/users/2f9cb3b20fe04cd1b8e8315121d18298/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.838529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad15603-2ca1-4c6e-9b92-1b4c47be2a12 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.840144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b953955-82b8-434f-b10e-57c2fbc5d191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79584b2529b40808f8bd5c5ab23cd4e, user_id=2f9cb3b20fe04cd1b8e8315121d18298, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.842789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b953955-82b8-434f-b10e-57c2fbc5d191 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.843282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e1bab-d840-4809-9fda-649025c5366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.844156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e1bab-d840-4809-9fda-649025c5366e admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.844447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e1bab-d840-4809-9fda-649025c5366e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.844727 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e1bab-d840-4809-9fda-649025c5366e admin admin] PATH_INFO: `/v3/projects/fd43e42998c54584bcedd39a369644d3/users/f52fb3f8e33b4b9985e245fb92021fa2/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.847127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:55.855855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1330/2656] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:55 2022] PUT /identity/v3/projects/b79584b2529b40808f8bd5c5ab23cd4e/users/2f9cb3b20fe04cd1b8e8315121d18298/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:55.861375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e1bab-d840-4809-9fda-649025c5366e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd43e42998c54584bcedd39a369644d3, user_id=f52fb3f8e33b4b9985e245fb92021fa2, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.864120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e1bab-d840-4809-9fda-649025c5366e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.865722 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f71a60-ec5f-4e20-86de-d3c5b05efbef None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.866019 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f71a60-ec5f-4e20-86de-d3c5b05efbef None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.866300 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f71a60-ec5f-4e20-86de-d3c5b05efbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.880742 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1327/2657] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:55 2022] PUT /identity/v3/projects/fd43e42998c54584bcedd39a369644d3/users/f52fb3f8e33b4b9985e245fb92021fa2/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:55.884662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e1bab-d840-4809-9fda-649025c5366e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.897831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-30f71a60-ec5f-4e20-86de-d3c5b05efbef None None] MFA Rules not processed for user `2f9cb3b20fe04cd1b8e8315121d18298`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:55.899094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-30f71a60-ec5f-4e20-86de-d3c5b05efbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:55.947590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e1bab-d840-4809-9fda-649025c5366e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.953067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbb1fc-d9aa-4c0f-a1a1-a07be0c787a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.953728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbb1fc-d9aa-4c0f-a1a1-a07be0c787a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.954013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbb1fc-d9aa-4c0f-a1a1-a07be0c787a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.954633 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbb1fc-d9aa-4c0f-a1a1-a07be0c787a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.955359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbb1fc-d9aa-4c0f-a1a1-a07be0c787a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.956939 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbb1fc-d9aa-4c0f-a1a1-a07be0c787a2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.970615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1328/2658] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:55.970797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1331/2659] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:55.971459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f71a60-ec5f-4e20-86de-d3c5b05efbef None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.977930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbb1fc-d9aa-4c0f-a1a1-a07be0c787a2 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.979883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d4fbb1fc-d9aa-4c0f-a1a1-a07be0c787a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:55.981576 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f71a60-ec5f-4e20-86de-d3c5b05efbef None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.986124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77420d34-35be-4eac-8c32-bd38d6411687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.987052 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77420d34-35be-4eac-8c32-bd38d6411687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.987337 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77420d34-35be-4eac-8c32-bd38d6411687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.987615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77420d34-35be-4eac-8c32-bd38d6411687 admin admin] PATH_INFO: `/v3/projects/fd43e42998c54584bcedd39a369644d3/users/f52fb3f8e33b4b9985e245fb92021fa2/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.989584 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77420d34-35be-4eac-8c32-bd38d6411687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd43e42998c54584bcedd39a369644d3, user_id=f52fb3f8e33b4b9985e245fb92021fa2, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.992304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77420d34-35be-4eac-8c32-bd38d6411687 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:56.003794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1332/2660] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:55 2022] PUT /identity/v3/projects/fd43e42998c54584bcedd39a369644d3/users/f52fb3f8e33b4b9985e245fb92021fa2/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:56.044700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbb1fc-d9aa-4c0f-a1a1-a07be0c787a2 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:56.098974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f097ee-27af-46d5-be00-e1228e569919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:56.099627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f097ee-27af-46d5-be00-e1228e569919 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:56.099919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f097ee-27af-46d5-be00-e1228e569919 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:56.100328 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f097ee-27af-46d5-be00-e1228e569919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:56.150012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:56.166984 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f097ee-27af-46d5-be00-e1228e569919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:56.169537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f097ee-27af-46d5-be00-e1228e569919 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:56.182174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1329/2661] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:15:56.260603 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77420d34-35be-4eac-8c32-bd38d6411687 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:56.271888 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77420d34-35be-4eac-8c32-bd38d6411687 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:56.275473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8019045-9361-49f1-b86d-968641d2529c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:56.276140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8019045-9361-49f1-b86d-968641d2529c service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:56.277102 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8019045-9361-49f1-b86d-968641d2529c service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:56.277506 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8019045-9361-49f1-b86d-968641d2529c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:56.346077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8019045-9361-49f1-b86d-968641d2529c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:56.347845 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8019045-9361-49f1-b86d-968641d2529c service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:56.359013 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1333/2662] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:56.669201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7547305-9c9b-41aa-a9bd-1c19e126fd36 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:56.669769 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7547305-9c9b-41aa-a9bd-1c19e126fd36 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:56.669769 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7547305-9c9b-41aa-a9bd-1c19e126fd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:56.703147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c7547305-9c9b-41aa-a9bd-1c19e126fd36 None None] MFA Rules not processed for user `f52fb3f8e33b4b9985e245fb92021fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:56.704663 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c7547305-9c9b-41aa-a9bd-1c19e126fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:56.790298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1330/2663] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:57.244058 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8019045-9361-49f1-b86d-968641d2529c service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:57.246120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d8019045-9361-49f1-b86d-968641d2529c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:57.260664 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:57.329676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8019045-9361-49f1-b86d-968641d2529c service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:57.334807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830bb3e-4544-460b-ad65-fbb00bc9f8e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81fb8b261e2142fcbf8d23bd010bf715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:57.335491 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830bb3e-4544-460b-ad65-fbb00bc9f8e2 service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:57.335780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830bb3e-4544-460b-ad65-fbb00bc9f8e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:57.336059 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830bb3e-4544-460b-ad65-fbb00bc9f8e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:57.337855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8830bb3e-4544-460b-ad65-fbb00bc9f8e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:57.353239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830bb3e-4544-460b-ad65-fbb00bc9f8e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:57.355237 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830bb3e-4544-460b-ad65-fbb00bc9f8e2 service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:57.365916 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1334/2664] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:15:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:58.072532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7547305-9c9b-41aa-a9bd-1c19e126fd36 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:58.136767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7547305-9c9b-41aa-a9bd-1c19e126fd36 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:58.141361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:58.142251 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:58.142566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:58.142844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] PATH_INFO: `/v3/users/297156a41c3a4c27b11b8ff2868952c4` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:58.144015 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] RBAC: Authorizing `identity:delete_user(user_id=297156a41c3a4c27b11b8ff2868952c4)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:58.145922 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:58.191809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297156a41c3a4c27b11b8ff2868952c4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.203557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297156a41c3a4c27b11b8ff2868952c4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.204220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297156a41c3a4c27b11b8ff2868952c4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.217043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297156a41c3a4c27b11b8ff2868952c4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.217583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297156a41c3a4c27b11b8ff2868952c4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.218879 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:58.233677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1331/2665] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:58 2022] DELETE /identity/v3/users/297156a41c3a4c27b11b8ff2868952c4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:58.420473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830bb3e-4544-460b-ad65-fbb00bc9f8e2 service placement] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:58.430918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830bb3e-4544-460b-ad65-fbb00bc9f8e2 service placement] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:58.489632 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:58.490432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:58.490778 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:58.491009 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] PATH_INFO: `/v3/projects/e564e936ab07493790a9a3d438b0ca2a` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:58.492189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e564e936ab07493790a9a3d438b0ca2a)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:58.494083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:58.540734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e564e936ab07493790a9a3d438b0ca2a', 'request_id': 'req-b8d37da4-3991-489d-bea4-05bec0f9cb11'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.548001 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e564e936ab07493790a9a3d438b0ca2a', 'request_id': 'req-b8d37da4-3991-489d-bea4-05bec0f9cb11'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.554266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e564e936ab07493790a9a3d438b0ca2a', 'request_id': 'req-b8d37da4-3991-489d-bea4-05bec0f9cb11'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.565075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] The token cache is being invalidate because project e564e936ab07493790a9a3d438b0ca2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:58.565366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.566000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.567549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1335/2666] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:58 2022] DELETE /identity/v3/projects/e564e936ab07493790a9a3d438b0ca2a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:58.571511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:58.572919 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:58.587287 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffc77c-adae-4bc9-8c1a-03a7f804bede admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:58.652066 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c8c02-523a-4fd8-840c-29056e07de5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:58.652973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c8c02-523a-4fd8-840c-29056e07de5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:58.653257 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c8c02-523a-4fd8-840c-29056e07de5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:58.653534 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c8c02-523a-4fd8-840c-29056e07de5d admin admin] PATH_INFO: `/v3/users/f52fb3f8e33b4b9985e245fb92021fa2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:58.654959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c8c02-523a-4fd8-840c-29056e07de5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52fb3f8e33b4b9985e245fb92021fa2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:58.656882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c8c02-523a-4fd8-840c-29056e07de5d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:58.704811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f65c8c02-523a-4fd8-840c-29056e07de5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52fb3f8e33b4b9985e245fb92021fa2'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.716760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f65c8c02-523a-4fd8-840c-29056e07de5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52fb3f8e33b4b9985e245fb92021fa2'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.717426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f65c8c02-523a-4fd8-840c-29056e07de5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52fb3f8e33b4b9985e245fb92021fa2'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.724499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f65c8c02-523a-4fd8-840c-29056e07de5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52fb3f8e33b4b9985e245fb92021fa2'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.725123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f65c8c02-523a-4fd8-840c-29056e07de5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52fb3f8e33b4b9985e245fb92021fa2'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:58.737851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1332/2667] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:15:58 2022] DELETE /identity/v3/users/f52fb3f8e33b4b9985e245fb92021fa2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:58.907670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:58.909159 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:58.924153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37da4-3991-489d-bea4-05bec0f9cb11 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:58.957039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:58.986955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27518474-f65b-4df1-b605-614018c9a8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:58.987822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27518474-f65b-4df1-b605-614018c9a8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:58.988114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27518474-f65b-4df1-b605-614018c9a8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:58.988391 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27518474-f65b-4df1-b605-614018c9a8ca admin admin] PATH_INFO: `/v3/projects/fd43e42998c54584bcedd39a369644d3` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:58.989569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27518474-f65b-4df1-b605-614018c9a8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd43e42998c54584bcedd39a369644d3)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:58.992077 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27518474-f65b-4df1-b605-614018c9a8ca admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.037494 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-27518474-f65b-4df1-b605-614018c9a8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd43e42998c54584bcedd39a369644d3', 'request_id': 'req-27518474-f65b-4df1-b605-614018c9a8ca'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:59.045919 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-27518474-f65b-4df1-b605-614018c9a8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd43e42998c54584bcedd39a369644d3', 'request_id': 'req-27518474-f65b-4df1-b605-614018c9a8ca'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:59.052628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-27518474-f65b-4df1-b605-614018c9a8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd43e42998c54584bcedd39a369644d3', 'request_id': 'req-27518474-f65b-4df1-b605-614018c9a8ca'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:59.064427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-27518474-f65b-4df1-b605-614018c9a8ca admin admin] The token cache is being invalidate because project fd43e42998c54584bcedd39a369644d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:15:59.064714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-27518474-f65b-4df1-b605-614018c9a8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:59.065364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-27518474-f65b-4df1-b605-614018c9a8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:15:59.066930 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1336/2668] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:15:58 2022] DELETE /identity/v3/projects/fd43e42998c54584bcedd39a369644d3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:15:59.071973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1840f-d063-4c85-aba8-53d3bbef72c3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.072265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1840f-d063-4c85-aba8-53d3bbef72c3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.072545 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1840f-d063-4c85-aba8-53d3bbef72c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.092503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9db1840f-d063-4c85-aba8-53d3bbef72c3 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:59.093876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9db1840f-d063-4c85-aba8-53d3bbef72c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:59.156171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1333/2669] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:59.163803 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b7a30-c306-41ba-8a99-8fad842c60f3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.164095 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b7a30-c306-41ba-8a99-8fad842c60f3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.164368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b7a30-c306-41ba-8a99-8fad842c60f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.182667 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-624b7a30-c306-41ba-8a99-8fad842c60f3 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:59.184279 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-624b7a30-c306-41ba-8a99-8fad842c60f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:59.192348 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1337/2670] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:59.196570 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1840f-d063-4c85-aba8-53d3bbef72c3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.208755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1840f-d063-4c85-aba8-53d3bbef72c3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:59.212556 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a909e-d770-4837-b587-cf2ef9281af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:59.213222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a909e-d770-4837-b587-cf2ef9281af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.213514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a909e-d770-4837-b587-cf2ef9281af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.214379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a909e-d770-4837-b587-cf2ef9281af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.215214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a909e-d770-4837-b587-cf2ef9281af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:15:59.215582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a909e-d770-4837-b587-cf2ef9281af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:59.217237 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a909e-d770-4837-b587-cf2ef9281af6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.219791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:59.235220 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1334/2671] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:59.236156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b7a30-c306-41ba-8a99-8fad842c60f3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.245694 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b7a30-c306-41ba-8a99-8fad842c60f3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:59.250608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831379b1-2f9b-4ff7-a5a9-a6856ace6608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:59.251267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831379b1-2f9b-4ff7-a5a9-a6856ace6608 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.251609 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831379b1-2f9b-4ff7-a5a9-a6856ace6608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.251893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831379b1-2f9b-4ff7-a5a9-a6856ace6608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.252587 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831379b1-2f9b-4ff7-a5a9-a6856ace6608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:59.254521 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831379b1-2f9b-4ff7-a5a9-a6856ace6608 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.285893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1338/2672] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:59 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:59.288996 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a909e-d770-4837-b587-cf2ef9281af6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.299698 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a909e-d770-4837-b587-cf2ef9281af6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:59.357005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90120f13-ad4e-44a1-9824-8b001ad01cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:59.357668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120f13-ad4e-44a1-9824-8b001ad01cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.357954 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120f13-ad4e-44a1-9824-8b001ad01cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.358227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120f13-ad4e-44a1-9824-8b001ad01cbe admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.358940 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90120f13-ad4e-44a1-9824-8b001ad01cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:59.360834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90120f13-ad4e-44a1-9824-8b001ad01cbe admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.381510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1335/2673] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:59 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:59.385872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831379b1-2f9b-4ff7-a5a9-a6856ace6608 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.396347 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831379b1-2f9b-4ff7-a5a9-a6856ace6608 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:59.401071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2dd3-f061-4924-ad8c-b1b65c3a6f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:59.401864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2dd3-f061-4924-ad8c-b1b65c3a6f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.402151 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2dd3-f061-4924-ad8c-b1b65c3a6f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.402463 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2dd3-f061-4924-ad8c-b1b65c3a6f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.403187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2dd3-f061-4924-ad8c-b1b65c3a6f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:59.404773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2dd3-f061-4924-ad8c-b1b65c3a6f94 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.419275 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1339/2674] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:59.420706 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90120f13-ad4e-44a1-9824-8b001ad01cbe admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.431356 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90120f13-ad4e-44a1-9824-8b001ad01cbe admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:59.437818 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301797a-a8f9-455a-821f-57d71086abf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:59.438617 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301797a-a8f9-455a-821f-57d71086abf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.438935 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301797a-a8f9-455a-821f-57d71086abf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.439215 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301797a-a8f9-455a-821f-57d71086abf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.439948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301797a-a8f9-455a-821f-57d71086abf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:59.441630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301797a-a8f9-455a-821f-57d71086abf0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.456508 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1336/2675] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:15:59.457762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2dd3-f061-4924-ad8c-b1b65c3a6f94 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.468099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2dd3-f061-4924-ad8c-b1b65c3a6f94 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:59.472876 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee076773-4569-465b-8375-dc8dbbbd2ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:59.473761 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee076773-4569-465b-8375-dc8dbbbd2ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.474047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee076773-4569-465b-8375-dc8dbbbd2ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.474324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee076773-4569-465b-8375-dc8dbbbd2ab1 admin admin] PATH_INFO: `/v3/projects/6d475de7cb614e5baba95fd6bb7a7e10/users/b58b5fff02624031afca79130946a3e9/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.490039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee076773-4569-465b-8375-dc8dbbbd2ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d475de7cb614e5baba95fd6bb7a7e10, user_id=b58b5fff02624031afca79130946a3e9, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:59.492726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee076773-4569-465b-8375-dc8dbbbd2ab1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.506648 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1340/2676] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:59 2022] PUT /identity/v3/projects/6d475de7cb614e5baba95fd6bb7a7e10/users/b58b5fff02624031afca79130946a3e9/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:59.519063 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934d8d4-f7a2-4486-accb-a21f10d1b208 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.519365 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934d8d4-f7a2-4486-accb-a21f10d1b208 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.519656 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934d8d4-f7a2-4486-accb-a21f10d1b208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.546819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c934d8d4-f7a2-4486-accb-a21f10d1b208 None None] MFA Rules not processed for user `b58b5fff02624031afca79130946a3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:59.548024 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c934d8d4-f7a2-4486-accb-a21f10d1b208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:59.613571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1337/2677] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:15:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:59.618557 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee076773-4569-465b-8375-dc8dbbbd2ab1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.680395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee076773-4569-465b-8375-dc8dbbbd2ab1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:59.685265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d79c5-1dc7-4f87-bcfb-60366e72303b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:59.685917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d79c5-1dc7-4f87-bcfb-60366e72303b admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.686202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d79c5-1dc7-4f87-bcfb-60366e72303b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.686511 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d79c5-1dc7-4f87-bcfb-60366e72303b admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.687203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d79c5-1dc7-4f87-bcfb-60366e72303b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:59.689072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d79c5-1dc7-4f87-bcfb-60366e72303b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.692258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:59.716523 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1341/2678] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:15:59 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:59.720887 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934d8d4-f7a2-4486-accb-a21f10d1b208 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.732329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934d8d4-f7a2-4486-accb-a21f10d1b208 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:59.787554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d5326-98f6-4d15-a0e6-27f150aed223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:59.788235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d5326-98f6-4d15-a0e6-27f150aed223 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.788517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d5326-98f6-4d15-a0e6-27f150aed223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.788794 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d5326-98f6-4d15-a0e6-27f150aed223 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.789521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d5326-98f6-4d15-a0e6-27f150aed223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:59.791470 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d5326-98f6-4d15-a0e6-27f150aed223 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.801174 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:59.812730 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1338/2679] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:15:59 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:15:59.816724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d79c5-1dc7-4f87-bcfb-60366e72303b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.827026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d79c5-1dc7-4f87-bcfb-60366e72303b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:59.831784 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9527bea-215c-43b1-9160-ae2d32e83856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:59.832438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9527bea-215c-43b1-9160-ae2d32e83856 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.832724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9527bea-215c-43b1-9160-ae2d32e83856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.833001 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9527bea-215c-43b1-9160-ae2d32e83856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.833721 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9527bea-215c-43b1-9160-ae2d32e83856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:59.835313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9527bea-215c-43b1-9160-ae2d32e83856 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.846830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1342/2680] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:59.850885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d5326-98f6-4d15-a0e6-27f150aed223 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.861540 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d5326-98f6-4d15-a0e6-27f150aed223 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:59.866048 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531042-f6b8-4397-ad76-3f844cffb3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:59.866952 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531042-f6b8-4397-ad76-3f844cffb3d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.867238 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531042-f6b8-4397-ad76-3f844cffb3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.867515 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531042-f6b8-4397-ad76-3f844cffb3d9 admin admin] PATH_INFO: `/v3/projects/0e6aa1216e4c4e0f99e9ab985cbd5377/users/999f232816f345c9a2f1aedfbd8bb159/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.883605 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531042-f6b8-4397-ad76-3f844cffb3d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6aa1216e4c4e0f99e9ab985cbd5377, user_id=999f232816f345c9a2f1aedfbd8bb159, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:59.886823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531042-f6b8-4397-ad76-3f844cffb3d9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.899550 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1339/2681] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:59 2022] PUT /identity/v3/projects/0e6aa1216e4c4e0f99e9ab985cbd5377/users/999f232816f345c9a2f1aedfbd8bb159/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:15:59.904265 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9527bea-215c-43b1-9160-ae2d32e83856 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.914019 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9527bea-215c-43b1-9160-ae2d32e83856 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:59.968943 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dea19d-4fc0-46d3-9e7d-f8dd98ae7e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:59.969647 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dea19d-4fc0-46d3-9e7d-f8dd98ae7e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.969927 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dea19d-4fc0-46d3-9e7d-f8dd98ae7e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.970199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dea19d-4fc0-46d3-9e7d-f8dd98ae7e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.970942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dea19d-4fc0-46d3-9e7d-f8dd98ae7e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:59.972570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dea19d-4fc0-46d3-9e7d-f8dd98ae7e91 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.983220 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1343/2682] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:15:59.988157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531042-f6b8-4397-ad76-3f844cffb3d9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.998851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531042-f6b8-4397-ad76-3f844cffb3d9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:00.003434 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415bd18-c624-4a5e-a9d0-1ec282e520bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:00.004321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415bd18-c624-4a5e-a9d0-1ec282e520bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:00.004616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415bd18-c624-4a5e-a9d0-1ec282e520bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:00.004902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415bd18-c624-4a5e-a9d0-1ec282e520bc admin admin] PATH_INFO: `/v3/projects/0e6aa1216e4c4e0f99e9ab985cbd5377/users/999f232816f345c9a2f1aedfbd8bb159/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:00.006859 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415bd18-c624-4a5e-a9d0-1ec282e520bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6aa1216e4c4e0f99e9ab985cbd5377, user_id=999f232816f345c9a2f1aedfbd8bb159, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:00.009476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415bd18-c624-4a5e-a9d0-1ec282e520bc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:00.020239 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1340/2683] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:15:59 2022] PUT /identity/v3/projects/0e6aa1216e4c4e0f99e9ab985cbd5377/users/999f232816f345c9a2f1aedfbd8bb159/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:00.031354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304dec-0663-4d41-b8fb-5e9b6663151a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:00.031644 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304dec-0663-4d41-b8fb-5e9b6663151a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:00.031922 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304dec-0663-4d41-b8fb-5e9b6663151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:00.057499 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-14304dec-0663-4d41-b8fb-5e9b6663151a None None] MFA Rules not processed for user `999f232816f345c9a2f1aedfbd8bb159`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:00.058665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-14304dec-0663-4d41-b8fb-5e9b6663151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:00.125246 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1344/2684] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:00.136845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415bd18-c624-4a5e-a9d0-1ec282e520bc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:00.138617 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5415bd18-c624-4a5e-a9d0-1ec282e520bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:00.194138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415bd18-c624-4a5e-a9d0-1ec282e520bc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:00.197735 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2a33e-1393-4c03-bedd-f3c2a3768bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:00.198881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2a33e-1393-4c03-bedd-f3c2a3768bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:00.199309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2a33e-1393-4c03-bedd-f3c2a3768bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:00.199595 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2a33e-1393-4c03-bedd-f3c2a3768bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:00.208737 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2a33e-1393-4c03-bedd-f3c2a3768bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:00.210161 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2a33e-1393-4c03-bedd-f3c2a3768bc1 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:00.221169 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1341/2685] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:00.490630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14304dec-0663-4d41-b8fb-5e9b6663151a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:00.492014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-14304dec-0663-4d41-b8fb-5e9b6663151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:00.557655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:00.567762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14304dec-0663-4d41-b8fb-5e9b6663151a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:00.573161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afd276-75dd-45da-bcf7-2e8d8150dc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:00.574049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afd276-75dd-45da-bcf7-2e8d8150dc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:00.574327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afd276-75dd-45da-bcf7-2e8d8150dc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:00.574711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afd276-75dd-45da-bcf7-2e8d8150dc29 admin admin] PATH_INFO: `/v3/users/c2088fe5df4e445eb69835c42000b5dc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:00.576487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afd276-75dd-45da-bcf7-2e8d8150dc29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2088fe5df4e445eb69835c42000b5dc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:00.579043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afd276-75dd-45da-bcf7-2e8d8150dc29 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:00.631026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-07afd276-75dd-45da-bcf7-2e8d8150dc29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2088fe5df4e445eb69835c42000b5dc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:00.631749 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-07afd276-75dd-45da-bcf7-2e8d8150dc29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2088fe5df4e445eb69835c42000b5dc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:00.632486 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2a33e-1393-4c03-bedd-f3c2a3768bc1 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:00.639561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-07afd276-75dd-45da-bcf7-2e8d8150dc29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2088fe5df4e445eb69835c42000b5dc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:00.643634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2a33e-1393-4c03-bedd-f3c2a3768bc1 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:00.647785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-07afd276-75dd-45da-bcf7-2e8d8150dc29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2088fe5df4e445eb69835c42000b5dc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:00.648404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-07afd276-75dd-45da-bcf7-2e8d8150dc29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2088fe5df4e445eb69835c42000b5dc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:00.649012 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d304a-174a-459d-a25e-30a9470cb952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:00.649950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d304a-174a-459d-a25e-30a9470cb952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:00.650305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d304a-174a-459d-a25e-30a9470cb952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:00.650809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d304a-174a-459d-a25e-30a9470cb952 admin admin] PATH_INFO: `/v3/users/b58b5fff02624031afca79130946a3e9` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:00.652140 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d304a-174a-459d-a25e-30a9470cb952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58b5fff02624031afca79130946a3e9)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:00.654127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d304a-174a-459d-a25e-30a9470cb952 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:00.666079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1345/2686] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:00 2022] DELETE /identity/v3/users/c2088fe5df4e445eb69835c42000b5dc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:00.671132 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfa539-a658-47f3-94b9-cf7030f44624 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:00.671423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfa539-a658-47f3-94b9-cf7030f44624 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:00.671702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfa539-a658-47f3-94b9-cf7030f44624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:00.691466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-bbdfa539-a658-47f3-94b9-cf7030f44624 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:00.692966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bbdfa539-a658-47f3-94b9-cf7030f44624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:00.706563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-719d304a-174a-459d-a25e-30a9470cb952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58b5fff02624031afca79130946a3e9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:00.718329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-719d304a-174a-459d-a25e-30a9470cb952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58b5fff02624031afca79130946a3e9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:00.719093 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-719d304a-174a-459d-a25e-30a9470cb952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58b5fff02624031afca79130946a3e9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:00.726378 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-719d304a-174a-459d-a25e-30a9470cb952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58b5fff02624031afca79130946a3e9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:00.727059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-719d304a-174a-459d-a25e-30a9470cb952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58b5fff02624031afca79130946a3e9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:00.740893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1342/2687] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:00 2022] DELETE /identity/v3/users/b58b5fff02624031afca79130946a3e9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:16:00.745236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1f7cf-5d2d-4e9a-97ec-85f5ac7c7807 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:00.745527 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1f7cf-5d2d-4e9a-97ec-85f5ac7c7807 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:00.745807 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1f7cf-5d2d-4e9a-97ec-85f5ac7c7807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:00.754820 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1346/2688] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:16:00.764746 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfa539-a658-47f3-94b9-cf7030f44624 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:00.766167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bbdfa539-a658-47f3-94b9-cf7030f44624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:00.766943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f6a1f7cf-5d2d-4e9a-97ec-85f5ac7c7807 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:00.768105 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f6a1f7cf-5d2d-4e9a-97ec-85f5ac7c7807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:00.801926 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:00.831719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfa539-a658-47f3-94b9-cf7030f44624 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:00.838912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1343/2689] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:16:00.848974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1f7cf-5d2d-4e9a-97ec-85f5ac7c7807 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:00.862686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:00.884398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b57df3-913f-468f-82cc-1a18ae16fd6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:00.885082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b57df3-913f-468f-82cc-1a18ae16fd6f service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:00.885368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b57df3-913f-468f-82cc-1a18ae16fd6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:00.886162 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b57df3-913f-468f-82cc-1a18ae16fd6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:00.895312 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b57df3-913f-468f-82cc-1a18ae16fd6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:00.896718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b57df3-913f-468f-82cc-1a18ae16fd6f service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:00.906268 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1347/2690] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:16:00.907790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1f7cf-5d2d-4e9a-97ec-85f5ac7c7807 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:00.911495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e6a9a-989a-4644-b633-e2d4d57e22c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:00.912145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e6a9a-989a-4644-b633-e2d4d57e22c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:00.912430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e6a9a-989a-4644-b633-e2d4d57e22c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:00.912705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e6a9a-989a-4644-b633-e2d4d57e22c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:00.922714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e6a9a-989a-4644-b633-e2d4d57e22c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:00.924141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e6a9a-989a-4644-b633-e2d4d57e22c3 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:00.934636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1344/2691] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:16:01.338978 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b57df3-913f-468f-82cc-1a18ae16fd6f service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:01.340630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-31b57df3-913f-468f-82cc-1a18ae16fd6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:01.356475 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b57df3-913f-468f-82cc-1a18ae16fd6f service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:01.364917 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:01.365914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:01.366206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:01.366516 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] PATH_INFO: `/v3/projects/d7dd46f48c5145c39ad8a461a2c5eefa` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:01.367875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7dd46f48c5145c39ad8a461a2c5eefa)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:01.369834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:01.370664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e6a9a-989a-4644-b633-e2d4d57e22c3 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:01.372454 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d64e6a9a-989a-4644-b633-e2d4d57e22c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:01.393403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e6a9a-989a-4644-b633-e2d4d57e22c3 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:01.401479 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:01.402903 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:01.403330 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:01.403798 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] PATH_INFO: `/v3/projects/6d475de7cb614e5baba95fd6bb7a7e10` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:01.405793 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d475de7cb614e5baba95fd6bb7a7e10)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:01.409425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:01.427267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7dd46f48c5145c39ad8a461a2c5eefa', 'request_id': 'req-a6df5468-ef5c-4297-8779-5b206abfde89'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.436062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7dd46f48c5145c39ad8a461a2c5eefa', 'request_id': 'req-a6df5468-ef5c-4297-8779-5b206abfde89'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.444260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7dd46f48c5145c39ad8a461a2c5eefa', 'request_id': 'req-a6df5468-ef5c-4297-8779-5b206abfde89'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.455343 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] The token cache is being invalidate because project d7dd46f48c5145c39ad8a461a2c5eefa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:01.455716 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.456318 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.458908 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1348/2692] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:01 2022] DELETE /identity/v3/projects/d7dd46f48c5145c39ad8a461a2c5eefa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:01.462070 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d475de7cb614e5baba95fd6bb7a7e10', 'request_id': 'req-817c977c-1b4d-4fd0-864b-15742d9ab254'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.462732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:01.465026 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:01.468090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d475de7cb614e5baba95fd6bb7a7e10', 'request_id': 'req-817c977c-1b4d-4fd0-864b-15742d9ab254'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.474324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d475de7cb614e5baba95fd6bb7a7e10', 'request_id': 'req-817c977c-1b4d-4fd0-864b-15742d9ab254'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.487934 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] The token cache is being invalidate because project 6d475de7cb614e5baba95fd6bb7a7e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:01.488226 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.488875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.490931 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1345/2693] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:01 2022] DELETE /identity/v3/projects/6d475de7cb614e5baba95fd6bb7a7e10 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:01.494622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:01.496515 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:01.534926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5468-ef5c-4297-8779-5b206abfde89 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:01.558781 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:01.563099 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c977c-1b4d-4fd0-864b-15742d9ab254 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:01.568980 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:01.570309 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:01.570531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:01.570995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] PATH_INFO: `/v3/users/999f232816f345c9a2f1aedfbd8bb159` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:01.572441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999f232816f345c9a2f1aedfbd8bb159)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:01.574543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:01.594562 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:01.595448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:01.595735 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:01.596017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] PATH_INFO: `/v3/users/2f9cb3b20fe04cd1b8e8315121d18298` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:01.597213 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9cb3b20fe04cd1b8e8315121d18298)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:01.599313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:01.604110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:01.624333 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999f232816f345c9a2f1aedfbd8bb159'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.638835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999f232816f345c9a2f1aedfbd8bb159'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.640264 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999f232816f345c9a2f1aedfbd8bb159'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.648112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999f232816f345c9a2f1aedfbd8bb159'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.648744 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999f232816f345c9a2f1aedfbd8bb159'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.653005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9cb3b20fe04cd1b8e8315121d18298'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.653671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9cb3b20fe04cd1b8e8315121d18298'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.660571 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9cb3b20fe04cd1b8e8315121d18298'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.663155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1346/2694] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:01 2022] DELETE /identity/v3/users/999f232816f345c9a2f1aedfbd8bb159 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:16:01.668656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9cb3b20fe04cd1b8e8315121d18298'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.669383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9cb3b20fe04cd1b8e8315121d18298'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:01.688224 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1349/2695] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:01 2022] DELETE /identity/v3/users/2f9cb3b20fe04cd1b8e8315121d18298 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:16:02.111196 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.112626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:02.138875 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.139806 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:02.209231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77bd1b-1e84-4701-8489-b0c63357de60 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.212939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1250d90-b0eb-49ba-bd51-dd1e42acf7ca admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.213961 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07b87-ee11-452a-9ef8-b52638f7b840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.214993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07b87-ee11-452a-9ef8-b52638f7b840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.215308 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07b87-ee11-452a-9ef8-b52638f7b840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.215589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07b87-ee11-452a-9ef8-b52638f7b840 admin admin] PATH_INFO: `/v3/projects/0e6aa1216e4c4e0f99e9ab985cbd5377` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.216795 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df07b87-ee11-452a-9ef8-b52638f7b840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6aa1216e4c4e0f99e9ab985cbd5377)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.217526 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b966dff-dd5b-415b-9801-32284bcd62f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.218410 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b966dff-dd5b-415b-9801-32284bcd62f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.218700 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b966dff-dd5b-415b-9801-32284bcd62f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.218799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df07b87-ee11-452a-9ef8-b52638f7b840 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.218981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b966dff-dd5b-415b-9801-32284bcd62f6 admin admin] PATH_INFO: `/v3/projects/b79584b2529b40808f8bd5c5ab23cd4e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.220179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b966dff-dd5b-415b-9801-32284bcd62f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79584b2529b40808f8bd5c5ab23cd4e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.222048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b966dff-dd5b-415b-9801-32284bcd62f6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.268600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8df07b87-ee11-452a-9ef8-b52638f7b840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6aa1216e4c4e0f99e9ab985cbd5377', 'request_id': 'req-8df07b87-ee11-452a-9ef8-b52638f7b840'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:02.269206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7b966dff-dd5b-415b-9801-32284bcd62f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79584b2529b40808f8bd5c5ab23cd4e', 'request_id': 'req-7b966dff-dd5b-415b-9801-32284bcd62f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:02.274222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8df07b87-ee11-452a-9ef8-b52638f7b840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6aa1216e4c4e0f99e9ab985cbd5377', 'request_id': 'req-8df07b87-ee11-452a-9ef8-b52638f7b840'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:02.277498 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7b966dff-dd5b-415b-9801-32284bcd62f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79584b2529b40808f8bd5c5ab23cd4e', 'request_id': 'req-7b966dff-dd5b-415b-9801-32284bcd62f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:02.285132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8df07b87-ee11-452a-9ef8-b52638f7b840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6aa1216e4c4e0f99e9ab985cbd5377', 'request_id': 'req-8df07b87-ee11-452a-9ef8-b52638f7b840'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:02.286615 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7b966dff-dd5b-415b-9801-32284bcd62f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79584b2529b40808f8bd5c5ab23cd4e', 'request_id': 'req-7b966dff-dd5b-415b-9801-32284bcd62f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:02.299872 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8df07b87-ee11-452a-9ef8-b52638f7b840 admin admin] The token cache is being invalidate because project 0e6aa1216e4c4e0f99e9ab985cbd5377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:02.300166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8df07b87-ee11-452a-9ef8-b52638f7b840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:02.300611 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7b966dff-dd5b-415b-9801-32284bcd62f6 admin admin] The token cache is being invalidate because project b79584b2529b40808f8bd5c5ab23cd4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:02.300875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8df07b87-ee11-452a-9ef8-b52638f7b840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:02.300974 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7b966dff-dd5b-415b-9801-32284bcd62f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:02.301837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7b966dff-dd5b-415b-9801-32284bcd62f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:02.302478 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1347/2696] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:02 2022] DELETE /identity/v3/projects/0e6aa1216e4c4e0f99e9ab985cbd5377 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:02.304350 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1350/2697] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:02 2022] DELETE /identity/v3/projects/b79584b2529b40808f8bd5c5ab23cd4e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:16:02.308013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a81e35-e26c-4d4e-8935-07a535b196aa None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.308340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a81e35-e26c-4d4e-8935-07a535b196aa None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.308626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a81e35-e26c-4d4e-8935-07a535b196aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.312008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f089b-a6dc-4d9f-ba24-ba475d662fcc None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.312366 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f089b-a6dc-4d9f-ba24-ba475d662fcc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.312582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f089b-a6dc-4d9f-ba24-ba475d662fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.322590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:02.328400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-88a81e35-e26c-4d4e-8935-07a535b196aa None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:02.330763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-88a81e35-e26c-4d4e-8935-07a535b196aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:02.331880 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a78f089b-a6dc-4d9f-ba24-ba475d662fcc None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:02.332954 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a78f089b-a6dc-4d9f-ba24-ba475d662fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:02.341525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:02.394773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1348/2698] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:16:02.399426 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1351/2699] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:16:02.402321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4c66b-3b31-4f62-ada9-ba28dec1089b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.402648 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4c66b-3b31-4f62-ada9-ba28dec1089b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.402927 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4c66b-3b31-4f62-ada9-ba28dec1089b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.406886 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0f44b-e4c5-4fd5-9c77-5e6d60b25eff None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.407184 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0f44b-e4c5-4fd5-9c77-5e6d60b25eff None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.407466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0f44b-e4c5-4fd5-9c77-5e6d60b25eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.422172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-95f4c66b-3b31-4f62-ada9-ba28dec1089b None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:02.423532 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-95f4c66b-3b31-4f62-ada9-ba28dec1089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:02.426124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-95a0f44b-e4c5-4fd5-9c77-5e6d60b25eff None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:02.427327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-95a0f44b-e4c5-4fd5-9c77-5e6d60b25eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:02.431918 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1349/2700] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:16:02.438877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1352/2701] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:16:02.439036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4c66b-3b31-4f62-ada9-ba28dec1089b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.439827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0f44b-e4c5-4fd5-9c77-5e6d60b25eff None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.447760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4c66b-3b31-4f62-ada9-ba28dec1089b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.449119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0f44b-e4c5-4fd5-9c77-5e6d60b25eff None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.453049 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1b149-f7cd-444e-b57f-3d556f749eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.453728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1b149-f7cd-444e-b57f-3d556f749eef admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.454013 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1b149-f7cd-444e-b57f-3d556f749eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.454151 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a052bc7-1ef4-458c-a915-86d8802c8a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.454581 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1b149-f7cd-444e-b57f-3d556f749eef admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.455108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052bc7-1ef4-458c-a915-86d8802c8a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.455313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1b149-f7cd-444e-b57f-3d556f749eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:16:02.455427 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052bc7-1ef4-458c-a915-86d8802c8a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.455625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1b149-f7cd-444e-b57f-3d556f749eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.455725 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052bc7-1ef4-458c-a915-86d8802c8a16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.456364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a052bc7-1ef4-458c-a915-86d8802c8a16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:16:02.456670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a052bc7-1ef4-458c-a915-86d8802c8a16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.457275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1b149-f7cd-444e-b57f-3d556f749eef admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.458228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a052bc7-1ef4-458c-a915-86d8802c8a16 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.469187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1350/2702] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:16:02.475387 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1353/2703] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:16:02.475521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1b149-f7cd-444e-b57f-3d556f749eef admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.476304 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a052bc7-1ef4-458c-a915-86d8802c8a16 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.483699 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1b149-f7cd-444e-b57f-3d556f749eef admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.486732 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a052bc7-1ef4-458c-a915-86d8802c8a16 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.488326 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b242e70-0145-4f59-a6ec-9b1367722f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.488964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b242e70-0145-4f59-a6ec-9b1367722f5d admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.489280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b242e70-0145-4f59-a6ec-9b1367722f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.489558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b242e70-0145-4f59-a6ec-9b1367722f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.490234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b242e70-0145-4f59-a6ec-9b1367722f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.491613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9660d-51ba-4eed-b76c-93bed141f8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.492147 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b242e70-0145-4f59-a6ec-9b1367722f5d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.492260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9660d-51ba-4eed-b76c-93bed141f8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.492550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9660d-51ba-4eed-b76c-93bed141f8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.492828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9660d-51ba-4eed-b76c-93bed141f8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.493506 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9660d-51ba-4eed-b76c-93bed141f8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.496225 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9660d-51ba-4eed-b76c-93bed141f8d4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.522791 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1351/2704] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:16:02.523155 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1354/2705] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:16:02.523785 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b242e70-0145-4f59-a6ec-9b1367722f5d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.527602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9660d-51ba-4eed-b76c-93bed141f8d4 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.587568 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b242e70-0145-4f59-a6ec-9b1367722f5d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.593182 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c214e-917a-4fd9-bcdf-b057e0157404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.593854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c214e-917a-4fd9-bcdf-b057e0157404 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.594141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c214e-917a-4fd9-bcdf-b057e0157404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.594441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c214e-917a-4fd9-bcdf-b057e0157404 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.595135 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c214e-917a-4fd9-bcdf-b057e0157404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.596886 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9660d-51ba-4eed-b76c-93bed141f8d4 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.597361 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c214e-917a-4fd9-bcdf-b057e0157404 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.601821 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107c17c-f0a9-43f0-9cc1-bcb825912bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.602561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107c17c-f0a9-43f0-9cc1-bcb825912bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.603168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107c17c-f0a9-43f0-9cc1-bcb825912bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.603458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107c17c-f0a9-43f0-9cc1-bcb825912bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.604163 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107c17c-f0a9-43f0-9cc1-bcb825912bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.606672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107c17c-f0a9-43f0-9cc1-bcb825912bb0 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.617502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1352/2706] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:02.621830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c214e-917a-4fd9-bcdf-b057e0157404 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.631488 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c214e-917a-4fd9-bcdf-b057e0157404 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.635145 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1355/2707] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:16:02.635975 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107c17c-f0a9-43f0-9cc1-bcb825912bb0 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.636345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abcd7d-ec29-4316-95aa-a544054afa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.636980 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abcd7d-ec29-4316-95aa-a544054afa08 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.637267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abcd7d-ec29-4316-95aa-a544054afa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.637547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abcd7d-ec29-4316-95aa-a544054afa08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.638269 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abcd7d-ec29-4316-95aa-a544054afa08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.639892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abcd7d-ec29-4316-95aa-a544054afa08 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.645560 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107c17c-f0a9-43f0-9cc1-bcb825912bb0 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.649851 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1353/2708] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:16:02.653630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771e5f6-7c66-4c59-a291-961c6c7d82a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.653630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771e5f6-7c66-4c59-a291-961c6c7d82a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.653630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771e5f6-7c66-4c59-a291-961c6c7d82a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.653630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771e5f6-7c66-4c59-a291-961c6c7d82a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.654020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771e5f6-7c66-4c59-a291-961c6c7d82a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.654193 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771e5f6-7c66-4c59-a291-961c6c7d82a6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.654510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abcd7d-ec29-4316-95aa-a544054afa08 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.664113 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abcd7d-ec29-4316-95aa-a544054afa08 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.668317 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1356/2709] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:16:02.669383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771e5f6-7c66-4c59-a291-961c6c7d82a6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.672601 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aec2eb-737c-4b63-9ca1-50cc57b7465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.673260 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aec2eb-737c-4b63-9ca1-50cc57b7465e admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.673551 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aec2eb-737c-4b63-9ca1-50cc57b7465e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.673858 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aec2eb-737c-4b63-9ca1-50cc57b7465e admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.674618 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aec2eb-737c-4b63-9ca1-50cc57b7465e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.676214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aec2eb-737c-4b63-9ca1-50cc57b7465e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.678976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771e5f6-7c66-4c59-a291-961c6c7d82a6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.683968 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac6ed2-6678-4d16-89a9-d269b34e4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.684630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac6ed2-6678-4d16-89a9-d269b34e4625 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.684913 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac6ed2-6678-4d16-89a9-d269b34e4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.685195 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac6ed2-6678-4d16-89a9-d269b34e4625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.685920 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac6ed2-6678-4d16-89a9-d269b34e4625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.687187 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1354/2710] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:02.687597 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac6ed2-6678-4d16-89a9-d269b34e4625 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.691171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aec2eb-737c-4b63-9ca1-50cc57b7465e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.701573 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1357/2711] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:16:02.701750 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aec2eb-737c-4b63-9ca1-50cc57b7465e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.702740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac6ed2-6678-4d16-89a9-d269b34e4625 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.706325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a94860-1623-4da0-b8ac-c945e7ede952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.707231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a94860-1623-4da0-b8ac-c945e7ede952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.707516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a94860-1623-4da0-b8ac-c945e7ede952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.707895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a94860-1623-4da0-b8ac-c945e7ede952 admin admin] PATH_INFO: `/v3/projects/673655910b4d4d629d36f96106627b44/users/1358e5ad613340da8612d3817185f1e6/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.714233 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac6ed2-6678-4d16-89a9-d269b34e4625 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.719625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d956e2-6937-485e-8c1c-daa68875ba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.720500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d956e2-6937-485e-8c1c-daa68875ba35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.720787 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d956e2-6937-485e-8c1c-daa68875ba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.721074 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d956e2-6937-485e-8c1c-daa68875ba35 admin admin] PATH_INFO: `/v3/projects/4d1a8e1107564c37beee80ff39028bcd/users/226e5cd305874d7faf2bb6c7132376b6/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.723000 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a94860-1623-4da0-b8ac-c945e7ede952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=673655910b4d4d629d36f96106627b44, user_id=1358e5ad613340da8612d3817185f1e6, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.725668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a94860-1623-4da0-b8ac-c945e7ede952 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.737723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d956e2-6937-485e-8c1c-daa68875ba35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1a8e1107564c37beee80ff39028bcd, user_id=226e5cd305874d7faf2bb6c7132376b6, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.739499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1355/2712] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:02 2022] PUT /identity/v3/projects/673655910b4d4d629d36f96106627b44/users/1358e5ad613340da8612d3817185f1e6/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:16:02.740634 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d956e2-6937-485e-8c1c-daa68875ba35 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.750027 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579e32e-449e-4975-ae5f-3bc52b095e20 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.750325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579e32e-449e-4975-ae5f-3bc52b095e20 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.750653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579e32e-449e-4975-ae5f-3bc52b095e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.754133 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1358/2713] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:02 2022] PUT /identity/v3/projects/4d1a8e1107564c37beee80ff39028bcd/users/226e5cd305874d7faf2bb6c7132376b6/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:02.765092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa64a03-67ae-4ed4-bdd0-7796a19c9c20 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.765389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa64a03-67ae-4ed4-bdd0-7796a19c9c20 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.765677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa64a03-67ae-4ed4-bdd0-7796a19c9c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.768489 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:02.779995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6579e32e-449e-4975-ae5f-3bc52b095e20 None None] MFA Rules not processed for user `1358e5ad613340da8612d3817185f1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:02.781526 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6579e32e-449e-4975-ae5f-3bc52b095e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:02.795837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7aa64a03-67ae-4ed4-bdd0-7796a19c9c20 None None] MFA Rules not processed for user `226e5cd305874d7faf2bb6c7132376b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:02.797048 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7aa64a03-67ae-4ed4-bdd0-7796a19c9c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:02.801212 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:02.848388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1356/2714] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:16:02.852799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579e32e-449e-4975-ae5f-3bc52b095e20 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.866771 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1359/2715] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:16:02.871877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa64a03-67ae-4ed4-bdd0-7796a19c9c20 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.922567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579e32e-449e-4975-ae5f-3bc52b095e20 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.927400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d5bc7-5c90-4167-9fa0-534abda6aad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.928076 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d5bc7-5c90-4167-9fa0-534abda6aad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.928357 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d5bc7-5c90-4167-9fa0-534abda6aad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.928632 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d5bc7-5c90-4167-9fa0-534abda6aad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.929322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d5bc7-5c90-4167-9fa0-534abda6aad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.931253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d5bc7-5c90-4167-9fa0-534abda6aad9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.936966 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa64a03-67ae-4ed4-bdd0-7796a19c9c20 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.941713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c8d79-973b-48d3-bb25-94f889127801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.942507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c8d79-973b-48d3-bb25-94f889127801 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.942867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c8d79-973b-48d3-bb25-94f889127801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.943215 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c8d79-973b-48d3-bb25-94f889127801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.943969 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c8d79-973b-48d3-bb25-94f889127801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.945928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c8d79-973b-48d3-bb25-94f889127801 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.960499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1357/2716] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:16:02.961951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d5bc7-5c90-4167-9fa0-534abda6aad9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.971956 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1360/2717] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:16:02.976020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c8d79-973b-48d3-bb25-94f889127801 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:03.025819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d5bc7-5c90-4167-9fa0-534abda6aad9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.040171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c8d79-973b-48d3-bb25-94f889127801 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.045658 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3ca2f-43f1-47b3-9e32-4d91dc7a6a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.046346 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3ca2f-43f1-47b3-9e32-4d91dc7a6a16 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.046780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3ca2f-43f1-47b3-9e32-4d91dc7a6a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.047069 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3ca2f-43f1-47b3-9e32-4d91dc7a6a16 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.047793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3ca2f-43f1-47b3-9e32-4d91dc7a6a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.049754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3ca2f-43f1-47b3-9e32-4d91dc7a6a16 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.055279 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:03.075360 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1361/2718] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:16:03.076488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3ca2f-43f1-47b3-9e32-4d91dc7a6a16 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:03.085454 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be889286-a615-4146-941c-7b71a8341c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.086140 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be889286-a615-4146-941c-7b71a8341c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.086449 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be889286-a615-4146-941c-7b71a8341c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.086575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3ca2f-43f1-47b3-9e32-4d91dc7a6a16 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.086731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be889286-a615-4146-941c-7b71a8341c0c admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.087483 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be889286-a615-4146-941c-7b71a8341c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.089410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be889286-a615-4146-941c-7b71a8341c0c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.091544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4417a-5f70-46b4-964a-8321d0f3285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.092469 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4417a-5f70-46b4-964a-8321d0f3285e admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.092762 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4417a-5f70-46b4-964a-8321d0f3285e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.093039 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4417a-5f70-46b4-964a-8321d0f3285e admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.093792 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4417a-5f70-46b4-964a-8321d0f3285e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.095363 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4417a-5f70-46b4-964a-8321d0f3285e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.106731 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1362/2719] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:16:03.110973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4417a-5f70-46b4-964a-8321d0f3285e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:03.111865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1358/2720] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:03.115639 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be889286-a615-4146-941c-7b71a8341c0c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:03.125768 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4417a-5f70-46b4-964a-8321d0f3285e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.127739 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be889286-a615-4146-941c-7b71a8341c0c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.130589 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4f41-8bf6-4fd4-9db5-2bbf2424d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.131493 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4f41-8bf6-4fd4-9db5-2bbf2424d60d admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.131773 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4f41-8bf6-4fd4-9db5-2bbf2424d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.132045 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4f41-8bf6-4fd4-9db5-2bbf2424d60d admin admin] PATH_INFO: `/v3/projects/25017b8c89ea4e9fa5952d1efcfd330a/users/1bb557a731c641699a51da11f582ca4b/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.132363 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebc7e4-fc55-45c2-ad1e-d5c2c63c6155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.133020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebc7e4-fc55-45c2-ad1e-d5c2c63c6155 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.133307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebc7e4-fc55-45c2-ad1e-d5c2c63c6155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.133614 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebc7e4-fc55-45c2-ad1e-d5c2c63c6155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.134340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebc7e4-fc55-45c2-ad1e-d5c2c63c6155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.135278 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:03.136084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebc7e4-fc55-45c2-ad1e-d5c2c63c6155 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.149872 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b4f41-8bf6-4fd4-9db5-2bbf2424d60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=25017b8c89ea4e9fa5952d1efcfd330a, user_id=1bb557a731c641699a51da11f582ca4b, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.150421 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1359/2721] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:16:03.151303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebc7e4-fc55-45c2-ad1e-d5c2c63c6155 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:03.152951 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b4f41-8bf6-4fd4-9db5-2bbf2424d60d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.161651 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebc7e4-fc55-45c2-ad1e-d5c2c63c6155 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.166270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1363/2722] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:03 2022] PUT /identity/v3/projects/25017b8c89ea4e9fa5952d1efcfd330a/users/1bb557a731c641699a51da11f582ca4b/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:16:03.170903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4f41-8bf6-4fd4-9db5-2bbf2424d60d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:03.220848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626ced1-0554-4075-a1dc-08874dbba5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.221660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626ced1-0554-4075-a1dc-08874dbba5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.221957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626ced1-0554-4075-a1dc-08874dbba5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.222241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626ced1-0554-4075-a1dc-08874dbba5e6 admin admin] PATH_INFO: `/v3/projects/7fb57aeed8724ac9b740f94067636b69/users/656a45a5a60f4a42ae61003996143755/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.232718 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4f41-8bf6-4fd4-9db5-2bbf2424d60d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.237528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917132f-7b14-457d-9f78-028b6e42ee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.238186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917132f-7b14-457d-9f78-028b6e42ee58 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.238343 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626ced1-0554-4075-a1dc-08874dbba5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb57aeed8724ac9b740f94067636b69, user_id=656a45a5a60f4a42ae61003996143755, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.238505 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917132f-7b14-457d-9f78-028b6e42ee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.238780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917132f-7b14-457d-9f78-028b6e42ee58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.239497 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917132f-7b14-457d-9f78-028b6e42ee58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.240897 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626ced1-0554-4075-a1dc-08874dbba5e6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.241034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917132f-7b14-457d-9f78-028b6e42ee58 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.253514 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1364/2723] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:16:03.254843 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1360/2724] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:03 2022] PUT /identity/v3/projects/7fb57aeed8724ac9b740f94067636b69/users/656a45a5a60f4a42ae61003996143755/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:03.257563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917132f-7b14-457d-9f78-028b6e42ee58 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:03.258536 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626ced1-0554-4075-a1dc-08874dbba5e6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:03.267659 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917132f-7b14-457d-9f78-028b6e42ee58 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.319214 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626ced1-0554-4075-a1dc-08874dbba5e6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.323958 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3f3e3-640e-4d3e-bfce-9c3f5ff3c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.324104 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3b919-b964-4cd2-b8da-2eb25b7b0898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.324616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3f3e3-640e-4d3e-bfce-9c3f5ff3c1af admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.324898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3f3e3-640e-4d3e-bfce-9c3f5ff3c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.325017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3b919-b964-4cd2-b8da-2eb25b7b0898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.325170 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3f3e3-640e-4d3e-bfce-9c3f5ff3c1af admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.325269 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3b919-b964-4cd2-b8da-2eb25b7b0898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.325458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3b919-b964-4cd2-b8da-2eb25b7b0898 admin admin] PATH_INFO: `/v3/projects/25017b8c89ea4e9fa5952d1efcfd330a/users/1bb557a731c641699a51da11f582ca4b/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.325893 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3f3e3-640e-4d3e-bfce-9c3f5ff3c1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.327442 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3b919-b964-4cd2-b8da-2eb25b7b0898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25017b8c89ea4e9fa5952d1efcfd330a, user_id=1bb557a731c641699a51da11f582ca4b, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.327559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3f3e3-640e-4d3e-bfce-9c3f5ff3c1af admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.330292 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3b919-b964-4cd2-b8da-2eb25b7b0898 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.337431 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1361/2725] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:03.341380 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1365/2726] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:03 2022] PUT /identity/v3/projects/25017b8c89ea4e9fa5952d1efcfd330a/users/1bb557a731c641699a51da11f582ca4b/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:16:03.350828 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3f3e3-640e-4d3e-bfce-9c3f5ff3c1af admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:03.352087 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3f3e3-640e-4d3e-bfce-9c3f5ff3c1af admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.352369 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb935772-d994-4843-b4c7-fc23e3c6da18 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.352730 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb935772-d994-4843-b4c7-fc23e3c6da18 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.353088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb935772-d994-4843-b4c7-fc23e3c6da18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.378399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:03.379254 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-fb935772-d994-4843-b4c7-fc23e3c6da18 None None] MFA Rules not processed for user `1bb557a731c641699a51da11f582ca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:03.380507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fb935772-d994-4843-b4c7-fc23e3c6da18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:03.412223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af77702-d1f6-4ae4-ae80-c7fb530593e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.413117 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77702-d1f6-4ae4-ae80-c7fb530593e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.413410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77702-d1f6-4ae4-ae80-c7fb530593e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.413693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77702-d1f6-4ae4-ae80-c7fb530593e3 admin admin] PATH_INFO: `/v3/projects/7fb57aeed8724ac9b740f94067636b69/users/656a45a5a60f4a42ae61003996143755/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.415806 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af77702-d1f6-4ae4-ae80-c7fb530593e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb57aeed8724ac9b740f94067636b69, user_id=656a45a5a60f4a42ae61003996143755, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.419197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af77702-d1f6-4ae4-ae80-c7fb530593e3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.429700 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1362/2727] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:03 2022] PUT /identity/v3/projects/7fb57aeed8724ac9b740f94067636b69/users/656a45a5a60f4a42ae61003996143755/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:16:03.440079 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c3431-30af-4c4f-9712-1bc6659dae0e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.440390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c3431-30af-4c4f-9712-1bc6659dae0e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.440674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c3431-30af-4c4f-9712-1bc6659dae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.446547 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:03.454752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1366/2728] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:03.463120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb935772-d994-4843-b4c7-fc23e3c6da18 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:03.465108 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fb935772-d994-4843-b4c7-fc23e3c6da18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:03.469930 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-fd4c3431-30af-4c4f-9712-1bc6659dae0e None None] MFA Rules not processed for user `656a45a5a60f4a42ae61003996143755`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:03.471569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fd4c3431-30af-4c4f-9712-1bc6659dae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:03.523889 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb935772-d994-4843-b4c7-fc23e3c6da18 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.540724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1363/2729] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:16:03.552131 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c3431-30af-4c4f-9712-1bc6659dae0e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:03.553725 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fd4c3431-30af-4c4f-9712-1bc6659dae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:03.581169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe03420-ab3c-4cdc-b11b-71105fa36010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.581846 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe03420-ab3c-4cdc-b11b-71105fa36010 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.582130 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe03420-ab3c-4cdc-b11b-71105fa36010 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.582436 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe03420-ab3c-4cdc-b11b-71105fa36010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.640563 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c3431-30af-4c4f-9712-1bc6659dae0e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.644216 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b1712-b820-494e-bcf7-844e32b024dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.644896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b1712-b820-494e-bcf7-844e32b024dc service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.645177 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b1712-b820-494e-bcf7-844e32b024dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.645449 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b1712-b820-494e-bcf7-844e32b024dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.654763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b1712-b820-494e-bcf7-844e32b024dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.655241 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe03420-ab3c-4cdc-b11b-71105fa36010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.656189 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b1712-b820-494e-bcf7-844e32b024dc service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.656688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe03420-ab3c-4cdc-b11b-71105fa36010 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.666077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1364/2730] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:03.666467 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1367/2731] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:16:03.743756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b1712-b820-494e-bcf7-844e32b024dc service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:03.752865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b1712-b820-494e-bcf7-844e32b024dc service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:03.757800 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d1d81-8852-4719-bf90-cbf4c8a9c4fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:03.758484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d1d81-8852-4719-bf90-cbf4c8a9c4fb service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:03.758778 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d1d81-8852-4719-bf90-cbf4c8a9c4fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:03.759180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d1d81-8852-4719-bf90-cbf4c8a9c4fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:03.813083 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:03.826643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d1d81-8852-4719-bf90-cbf4c8a9c4fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:03.828127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d1d81-8852-4719-bf90-cbf4c8a9c4fb service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:03.838067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1365/2732] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:04.044032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe03420-ab3c-4cdc-b11b-71105fa36010 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:04.108071 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe03420-ab3c-4cdc-b11b-71105fa36010 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:04.112652 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:04.113527 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:04.113811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:04.114083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] PATH_INFO: `/v3/users/226e5cd305874d7faf2bb6c7132376b6` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:04.115296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=226e5cd305874d7faf2bb6c7132376b6)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:04.117209 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:04.122717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:04.164169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '226e5cd305874d7faf2bb6c7132376b6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.164830 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '226e5cd305874d7faf2bb6c7132376b6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.172429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '226e5cd305874d7faf2bb6c7132376b6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.179737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '226e5cd305874d7faf2bb6c7132376b6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.180485 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '226e5cd305874d7faf2bb6c7132376b6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.197687 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1368/2733] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:04 2022] DELETE /identity/v3/users/226e5cd305874d7faf2bb6c7132376b6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:04.202235 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d883bbd-a813-4054-a180-70a964f499de None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:04.202625 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d883bbd-a813-4054-a180-70a964f499de None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:04.202909 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d883bbd-a813-4054-a180-70a964f499de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:04.221321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6d883bbd-a813-4054-a180-70a964f499de None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:04.222614 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6d883bbd-a813-4054-a180-70a964f499de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:04.282241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1366/2734] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:04.293297 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:04.294866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:04.351940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0a768-d600-486f-9727-96c93e62c7fe admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:04.355708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc912d-204e-4747-a148-b755a5691849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:04.356356 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc912d-204e-4747-a148-b755a5691849 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:04.356645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc912d-204e-4747-a148-b755a5691849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:04.356926 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc912d-204e-4747-a148-b755a5691849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:04.365915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc912d-204e-4747-a148-b755a5691849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:04.367359 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc912d-204e-4747-a148-b755a5691849 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:04.377211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1369/2735] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:04.645898 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d883bbd-a813-4054-a180-70a964f499de None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:04.647342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6d883bbd-a813-4054-a180-70a964f499de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:04.659414 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d883bbd-a813-4054-a180-70a964f499de None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:04.664457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:04.665340 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:04.665624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:04.665905 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] PATH_INFO: `/v3/projects/4d1a8e1107564c37beee80ff39028bcd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:04.667597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1a8e1107564c37beee80ff39028bcd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:04.669508 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:04.716727 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1a8e1107564c37beee80ff39028bcd', 'request_id': 'req-31c87913-7783-4836-be99-15c9e8ff8c67'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.722494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1a8e1107564c37beee80ff39028bcd', 'request_id': 'req-31c87913-7783-4836-be99-15c9e8ff8c67'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.728704 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1a8e1107564c37beee80ff39028bcd', 'request_id': 'req-31c87913-7783-4836-be99-15c9e8ff8c67'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.740914 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] The token cache is being invalidate because project 4d1a8e1107564c37beee80ff39028bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:04.741201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.741823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.743374 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1367/2736] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:04 2022] DELETE /identity/v3/projects/4d1a8e1107564c37beee80ff39028bcd => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:04.747961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc912d-204e-4747-a148-b755a5691849 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:04.757657 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc912d-204e-4747-a148-b755a5691849 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:04.814063 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e51c5-6b35-49b9-8f6b-c8b679f7d7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:04.814972 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e51c5-6b35-49b9-8f6b-c8b679f7d7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:04.815259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e51c5-6b35-49b9-8f6b-c8b679f7d7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:04.815539 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e51c5-6b35-49b9-8f6b-c8b679f7d7fa admin admin] PATH_INFO: `/v3/users/1bb557a731c641699a51da11f582ca4b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:04.816720 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e51c5-6b35-49b9-8f6b-c8b679f7d7fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb557a731c641699a51da11f582ca4b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:04.818659 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e51c5-6b35-49b9-8f6b-c8b679f7d7fa admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:04.851907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:04.867421 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-433e51c5-6b35-49b9-8f6b-c8b679f7d7fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb557a731c641699a51da11f582ca4b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.868073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-433e51c5-6b35-49b9-8f6b-c8b679f7d7fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb557a731c641699a51da11f582ca4b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.875032 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-433e51c5-6b35-49b9-8f6b-c8b679f7d7fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb557a731c641699a51da11f582ca4b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.882201 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-433e51c5-6b35-49b9-8f6b-c8b679f7d7fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb557a731c641699a51da11f582ca4b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.882852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-433e51c5-6b35-49b9-8f6b-c8b679f7d7fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb557a731c641699a51da11f582ca4b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:04.900693 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1370/2737] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:04 2022] DELETE /identity/v3/users/1bb557a731c641699a51da11f582ca4b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:05.179511 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:05.181150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:05.202854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87913-7783-4836-be99-15c9e8ff8c67 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:05.274560 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33937b0b-1208-45b6-8c65-6c365b38709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:05.275349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33937b0b-1208-45b6-8c65-6c365b38709a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:05.275631 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33937b0b-1208-45b6-8c65-6c365b38709a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:05.275904 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33937b0b-1208-45b6-8c65-6c365b38709a admin admin] PATH_INFO: `/v3/projects/25017b8c89ea4e9fa5952d1efcfd330a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:05.277784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33937b0b-1208-45b6-8c65-6c365b38709a admin admin] RBAC: Authorizing `identity:delete_project(project_id=25017b8c89ea4e9fa5952d1efcfd330a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:05.279766 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33937b0b-1208-45b6-8c65-6c365b38709a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:05.297190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:05.335303 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-33937b0b-1208-45b6-8c65-6c365b38709a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25017b8c89ea4e9fa5952d1efcfd330a', 'request_id': 'req-33937b0b-1208-45b6-8c65-6c365b38709a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:05.342003 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-33937b0b-1208-45b6-8c65-6c365b38709a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25017b8c89ea4e9fa5952d1efcfd330a', 'request_id': 'req-33937b0b-1208-45b6-8c65-6c365b38709a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:05.348501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-33937b0b-1208-45b6-8c65-6c365b38709a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25017b8c89ea4e9fa5952d1efcfd330a', 'request_id': 'req-33937b0b-1208-45b6-8c65-6c365b38709a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:05.363284 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-33937b0b-1208-45b6-8c65-6c365b38709a admin admin] The token cache is being invalidate because project 25017b8c89ea4e9fa5952d1efcfd330a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:05.363578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-33937b0b-1208-45b6-8c65-6c365b38709a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:05.364243 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-33937b0b-1208-45b6-8c65-6c365b38709a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:05.365824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1368/2738] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:05 2022] DELETE /identity/v3/projects/25017b8c89ea4e9fa5952d1efcfd330a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:05.371544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b16c65-2cb5-422c-a9dc-f1bb9e58047d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:05.371864 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b16c65-2cb5-422c-a9dc-f1bb9e58047d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:05.372179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b16c65-2cb5-422c-a9dc-f1bb9e58047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:05.392852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f0b16c65-2cb5-422c-a9dc-f1bb9e58047d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:05.394084 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f0b16c65-2cb5-422c-a9dc-f1bb9e58047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:05.455072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1371/2739] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:16:05.463880 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f29e2-c0ad-4f9e-9db0-d5dff1adc184 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:05.464252 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f29e2-c0ad-4f9e-9db0-d5dff1adc184 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:05.464622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f29e2-c0ad-4f9e-9db0-d5dff1adc184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:05.484710 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-056f29e2-c0ad-4f9e-9db0-d5dff1adc184 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:05.486274 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-056f29e2-c0ad-4f9e-9db0-d5dff1adc184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:05.494552 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1369/2740] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:05.499014 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b16c65-2cb5-422c-a9dc-f1bb9e58047d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:05.508535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b16c65-2cb5-422c-a9dc-f1bb9e58047d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:05.513824 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb913a1-2511-4648-9406-9a35d6fcc9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:05.514513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb913a1-2511-4648-9406-9a35d6fcc9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:05.514800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb913a1-2511-4648-9406-9a35d6fcc9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:05.515076 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb913a1-2511-4648-9406-9a35d6fcc9b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:05.515797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb913a1-2511-4648-9406-9a35d6fcc9b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:16:05.516103 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb913a1-2511-4648-9406-9a35d6fcc9b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:05.517670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb913a1-2511-4648-9406-9a35d6fcc9b5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:05.530298 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1372/2741] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:16:05.534636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f29e2-c0ad-4f9e-9db0-d5dff1adc184 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:05.545406 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f29e2-c0ad-4f9e-9db0-d5dff1adc184 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:05.550201 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6404fb-4651-45de-937d-e5a7925ae81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:05.550891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6404fb-4651-45de-937d-e5a7925ae81c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:05.551178 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6404fb-4651-45de-937d-e5a7925ae81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:05.553787 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6404fb-4651-45de-937d-e5a7925ae81c admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:05.554522 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6404fb-4651-45de-937d-e5a7925ae81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:05.556434 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6404fb-4651-45de-937d-e5a7925ae81c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:05.589683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1370/2742] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:16:05 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:16:05.590950 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb913a1-2511-4648-9406-9a35d6fcc9b5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:05.600836 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb913a1-2511-4648-9406-9a35d6fcc9b5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:05.674134 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa834d-0893-4479-bce2-7908cbca7476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:05.674849 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa834d-0893-4479-bce2-7908cbca7476 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:05.675169 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa834d-0893-4479-bce2-7908cbca7476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:05.675455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa834d-0893-4479-bce2-7908cbca7476 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:05.676189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa834d-0893-4479-bce2-7908cbca7476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:05.678099 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa834d-0893-4479-bce2-7908cbca7476 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:05.698651 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1373/2743] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:16:05 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:16:05.703056 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6404fb-4651-45de-937d-e5a7925ae81c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:05.714482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6404fb-4651-45de-937d-e5a7925ae81c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:05.719213 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa6adc-4f7f-4802-94fa-a04dc09cb013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:05.719870 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa6adc-4f7f-4802-94fa-a04dc09cb013 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:05.720155 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa6adc-4f7f-4802-94fa-a04dc09cb013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:05.720432 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa6adc-4f7f-4802-94fa-a04dc09cb013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:05.721151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa6adc-4f7f-4802-94fa-a04dc09cb013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:05.722784 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa6adc-4f7f-4802-94fa-a04dc09cb013 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:05.734745 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1371/2744] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:16:05.738874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa834d-0893-4479-bce2-7908cbca7476 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:05.748981 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa834d-0893-4479-bce2-7908cbca7476 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:05.753701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de13c9-f747-4da2-b058-6998587a6d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:05.754354 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de13c9-f747-4da2-b058-6998587a6d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:05.754665 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de13c9-f747-4da2-b058-6998587a6d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:05.754940 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de13c9-f747-4da2-b058-6998587a6d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:05.755655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de13c9-f747-4da2-b058-6998587a6d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:05.757221 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de13c9-f747-4da2-b058-6998587a6d5a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:05.769400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1374/2745] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:05.775002 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa6adc-4f7f-4802-94fa-a04dc09cb013 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:05.786763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa6adc-4f7f-4802-94fa-a04dc09cb013 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:05.790951 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd825d-4174-4c12-8a60-358624b39dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:05.792485 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd825d-4174-4c12-8a60-358624b39dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:05.792783 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd825d-4174-4c12-8a60-358624b39dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:05.793044 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd825d-4174-4c12-8a60-358624b39dd8 admin admin] PATH_INFO: `/v3/projects/b46822cc6fd34285a078dc78756a293f/users/740fdc4248884dfdbc13bd50561775df/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:05.807773 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd825d-4174-4c12-8a60-358624b39dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46822cc6fd34285a078dc78756a293f, user_id=740fdc4248884dfdbc13bd50561775df, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:05.810453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd825d-4174-4c12-8a60-358624b39dd8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:05.822526 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1372/2746] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:05 2022] PUT /identity/v3/projects/b46822cc6fd34285a078dc78756a293f/users/740fdc4248884dfdbc13bd50561775df/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:05.833185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b160bc-19d4-4b6e-8eb1-d374c35a18a6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:05.833482 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b160bc-19d4-4b6e-8eb1-d374c35a18a6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:05.833793 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b160bc-19d4-4b6e-8eb1-d374c35a18a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:05.859394 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:05.862473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-22b160bc-19d4-4b6e-8eb1-d374c35a18a6 None None] MFA Rules not processed for user `740fdc4248884dfdbc13bd50561775df`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:05.864256 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-22b160bc-19d4-4b6e-8eb1-d374c35a18a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:05.929448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1375/2747] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:05.940902 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd825d-4174-4c12-8a60-358624b39dd8 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:05.942605 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-11fd825d-4174-4c12-8a60-358624b39dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:06.001123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd825d-4174-4c12-8a60-358624b39dd8 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:06.004971 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9b4ae-9591-45de-9c61-7a4225da4b2c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5b9c982724df0b88ce6ad46dc37e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:06.005627 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9b4ae-9591-45de-9c61-7a4225da4b2c service glance] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:06.005942 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9b4ae-9591-45de-9c61-7a4225da4b2c service glance] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:06.006222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9b4ae-9591-45de-9c61-7a4225da4b2c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:06.015270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9b4ae-9591-45de-9c61-7a4225da4b2c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:06.016696 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9b4ae-9591-45de-9c61-7a4225da4b2c service glance] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:06.025500 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1373/2748] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:06.778727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b160bc-19d4-4b6e-8eb1-d374c35a18a6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:06.784961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-22b160bc-19d4-4b6e-8eb1-d374c35a18a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:06.858056 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b160bc-19d4-4b6e-8eb1-d374c35a18a6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:06.862678 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:06.863561 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:06.863844 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:06.864119 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] PATH_INFO: `/v3/users/1358e5ad613340da8612d3817185f1e6` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:06.865305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1358e5ad613340da8612d3817185f1e6)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:06.867600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:06.926120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1358e5ad613340da8612d3817185f1e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:06.926931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1358e5ad613340da8612d3817185f1e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:06.933755 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1358e5ad613340da8612d3817185f1e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:06.943094 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1358e5ad613340da8612d3817185f1e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:06.943826 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1358e5ad613340da8612d3817185f1e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:06.963126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1376/2749] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:06 2022] DELETE /identity/v3/users/1358e5ad613340da8612d3817185f1e6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:06.968341 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9c071-71db-4a27-b82e-7a6212341a0d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:06.968850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9c071-71db-4a27-b82e-7a6212341a0d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:06.968948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9c071-71db-4a27-b82e-7a6212341a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:06.987608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-acf9c071-71db-4a27-b82e-7a6212341a0d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:06.988855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-acf9c071-71db-4a27-b82e-7a6212341a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:07.028517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:07.051876 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1374/2750] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:07.062389 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:07.063938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:07.091934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:07.125423 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328301f-5e2d-43f4-9123-a7108a8d5b67 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:07.129702 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cab00-3f87-4c4c-aa2e-82cafe398fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:07.130374 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cab00-3f87-4c4c-aa2e-82cafe398fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:07.130737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cab00-3f87-4c4c-aa2e-82cafe398fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:07.130946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cab00-3f87-4c4c-aa2e-82cafe398fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:07.141199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cab00-3f87-4c4c-aa2e-82cafe398fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:07.142654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cab00-3f87-4c4c-aa2e-82cafe398fa0 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:07.152519 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1377/2751] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:07.426469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9c071-71db-4a27-b82e-7a6212341a0d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:07.428139 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-acf9c071-71db-4a27-b82e-7a6212341a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:07.441815 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9c071-71db-4a27-b82e-7a6212341a0d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:07.446939 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:07.448144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:07.448440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:07.448724 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] PATH_INFO: `/v3/projects/673655910b4d4d629d36f96106627b44` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:07.450264 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=673655910b4d4d629d36f96106627b44)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:07.452173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:07.511517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673655910b4d4d629d36f96106627b44', 'request_id': 'req-5cd0b918-5c48-4c0c-9bd0-99368df98562'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:07.517299 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673655910b4d4d629d36f96106627b44', 'request_id': 'req-5cd0b918-5c48-4c0c-9bd0-99368df98562'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:07.523982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673655910b4d4d629d36f96106627b44', 'request_id': 'req-5cd0b918-5c48-4c0c-9bd0-99368df98562'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:07.537029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] The token cache is being invalidate because project 673655910b4d4d629d36f96106627b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:07.537321 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:07.537962 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:07.539528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1375/2752] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:07 2022] DELETE /identity/v3/projects/673655910b4d4d629d36f96106627b44 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:07.544082 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cab00-3f87-4c4c-aa2e-82cafe398fa0 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:07.553777 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cab00-3f87-4c4c-aa2e-82cafe398fa0 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:07.613409 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506f9ec-edc8-4636-ac3e-f1c13db99160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:07.614382 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506f9ec-edc8-4636-ac3e-f1c13db99160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:07.614722 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506f9ec-edc8-4636-ac3e-f1c13db99160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:07.615140 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506f9ec-edc8-4636-ac3e-f1c13db99160 admin admin] PATH_INFO: `/v3/users/656a45a5a60f4a42ae61003996143755` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:07.616338 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506f9ec-edc8-4636-ac3e-f1c13db99160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=656a45a5a60f4a42ae61003996143755)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:07.618501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506f9ec-edc8-4636-ac3e-f1c13db99160 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:07.663473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f506f9ec-edc8-4636-ac3e-f1c13db99160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656a45a5a60f4a42ae61003996143755'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:07.664126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f506f9ec-edc8-4636-ac3e-f1c13db99160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656a45a5a60f4a42ae61003996143755'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:07.672668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f506f9ec-edc8-4636-ac3e-f1c13db99160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656a45a5a60f4a42ae61003996143755'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:07.679944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f506f9ec-edc8-4636-ac3e-f1c13db99160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656a45a5a60f4a42ae61003996143755'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:07.680656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f506f9ec-edc8-4636-ac3e-f1c13db99160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656a45a5a60f4a42ae61003996143755'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:07.699211 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1378/2753] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:07 2022] DELETE /identity/v3/users/656a45a5a60f4a42ae61003996143755 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:07.977145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:07.978646 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:07.993457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0b918-5c48-4c0c-9bd0-99368df98562 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.053492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67eb87-5f70-48bf-8445-11bb8e3f7559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.054348 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67eb87-5f70-48bf-8445-11bb8e3f7559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.054652 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67eb87-5f70-48bf-8445-11bb8e3f7559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.054950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67eb87-5f70-48bf-8445-11bb8e3f7559 admin admin] PATH_INFO: `/v3/projects/7fb57aeed8724ac9b740f94067636b69` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.056120 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67eb87-5f70-48bf-8445-11bb8e3f7559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb57aeed8724ac9b740f94067636b69)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:08.058849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67eb87-5f70-48bf-8445-11bb8e3f7559 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:08.104825 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4b67eb87-5f70-48bf-8445-11bb8e3f7559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb57aeed8724ac9b740f94067636b69', 'request_id': 'req-4b67eb87-5f70-48bf-8445-11bb8e3f7559'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:08.111151 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4b67eb87-5f70-48bf-8445-11bb8e3f7559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb57aeed8724ac9b740f94067636b69', 'request_id': 'req-4b67eb87-5f70-48bf-8445-11bb8e3f7559'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:08.117446 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4b67eb87-5f70-48bf-8445-11bb8e3f7559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb57aeed8724ac9b740f94067636b69', 'request_id': 'req-4b67eb87-5f70-48bf-8445-11bb8e3f7559'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:08.121895 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:08.133290 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4b67eb87-5f70-48bf-8445-11bb8e3f7559 admin admin] The token cache is being invalidate because project 7fb57aeed8724ac9b740f94067636b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:08.133746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4b67eb87-5f70-48bf-8445-11bb8e3f7559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:08.134537 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4b67eb87-5f70-48bf-8445-11bb8e3f7559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:08.136790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1376/2754] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:07 2022] DELETE /identity/v3/projects/7fb57aeed8724ac9b740f94067636b69 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:08.141752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e33cf-cf8f-44d8-a115-f708faca399a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.142227 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e33cf-cf8f-44d8-a115-f708faca399a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.142332 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e33cf-cf8f-44d8-a115-f708faca399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.160935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2c5e33cf-cf8f-44d8-a115-f708faca399a None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:08.162154 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2c5e33cf-cf8f-44d8-a115-f708faca399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:08.203827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:08.223999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1379/2755] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:08.233681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e6d10-3fee-4247-8714-fc9297401314 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.233976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e6d10-3fee-4247-8714-fc9297401314 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.234261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e6d10-3fee-4247-8714-fc9297401314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.253398 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-693e6d10-3fee-4247-8714-fc9297401314 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:08.254674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-693e6d10-3fee-4247-8714-fc9297401314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:08.265588 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1377/2756] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:08.269892 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e33cf-cf8f-44d8-a115-f708faca399a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:08.280726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e33cf-cf8f-44d8-a115-f708faca399a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.285617 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685f733-ea10-4708-bf73-0dd6ea7af664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.286296 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f733-ea10-4708-bf73-0dd6ea7af664 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.286621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f733-ea10-4708-bf73-0dd6ea7af664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.286903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f733-ea10-4708-bf73-0dd6ea7af664 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.287637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685f733-ea10-4708-bf73-0dd6ea7af664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:16:08.287946 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685f733-ea10-4708-bf73-0dd6ea7af664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:08.289534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685f733-ea10-4708-bf73-0dd6ea7af664 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:08.307837 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1380/2757] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:16:08.309456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e6d10-3fee-4247-8714-fc9297401314 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:08.318882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e6d10-3fee-4247-8714-fc9297401314 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.323821 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68fe63-c261-4028-89b0-e354aa32f341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.324491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68fe63-c261-4028-89b0-e354aa32f341 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.324780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68fe63-c261-4028-89b0-e354aa32f341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.325059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68fe63-c261-4028-89b0-e354aa32f341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.325755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68fe63-c261-4028-89b0-e354aa32f341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:08.327705 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68fe63-c261-4028-89b0-e354aa32f341 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:08.357824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1378/2758] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:16:08 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:08.361811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685f733-ea10-4708-bf73-0dd6ea7af664 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:08.373357 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685f733-ea10-4708-bf73-0dd6ea7af664 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.431934 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1872a9-eaf1-4451-8be0-579fa5ebb5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.433199 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1872a9-eaf1-4451-8be0-579fa5ebb5cb admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.433778 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1872a9-eaf1-4451-8be0-579fa5ebb5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.433970 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1872a9-eaf1-4451-8be0-579fa5ebb5cb admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.434715 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1872a9-eaf1-4451-8be0-579fa5ebb5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:08.436646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1872a9-eaf1-4451-8be0-579fa5ebb5cb admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:08.456539 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1381/2759] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:16:08 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:08.460605 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68fe63-c261-4028-89b0-e354aa32f341 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:08.473569 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68fe63-c261-4028-89b0-e354aa32f341 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.478521 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31841c-bbfa-4977-997c-40c9aff802e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.480005 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31841c-bbfa-4977-997c-40c9aff802e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.480296 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31841c-bbfa-4977-997c-40c9aff802e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.480571 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31841c-bbfa-4977-997c-40c9aff802e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.481310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31841c-bbfa-4977-997c-40c9aff802e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:08.482964 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31841c-bbfa-4977-997c-40c9aff802e4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:08.493748 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1379/2760] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:08.498544 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1872a9-eaf1-4451-8be0-579fa5ebb5cb admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:08.509129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1872a9-eaf1-4451-8be0-579fa5ebb5cb admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.520333 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3e0db-feba-4817-9afd-5d9d5d5b8f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.521126 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3e0db-feba-4817-9afd-5d9d5d5b8f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.521555 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3e0db-feba-4817-9afd-5d9d5d5b8f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.521847 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3e0db-feba-4817-9afd-5d9d5d5b8f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.522734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3e0db-feba-4817-9afd-5d9d5d5b8f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:08.524600 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3e0db-feba-4817-9afd-5d9d5d5b8f36 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:08.536083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1382/2761] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:08.540404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31841c-bbfa-4977-997c-40c9aff802e4 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:08.551578 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31841c-bbfa-4977-997c-40c9aff802e4 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.556440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bb284-69d1-49a7-bc7e-53409f377b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.557950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bb284-69d1-49a7-bc7e-53409f377b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.558236 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bb284-69d1-49a7-bc7e-53409f377b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.558562 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bb284-69d1-49a7-bc7e-53409f377b2d admin admin] PATH_INFO: `/v3/projects/a9447664e82b4e76b7f35817dd596a38/users/ead4cb17c56a40eea79d464b2ea631e0/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.576007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bb284-69d1-49a7-bc7e-53409f377b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9447664e82b4e76b7f35817dd596a38, user_id=ead4cb17c56a40eea79d464b2ea631e0, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:08.578756 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bb284-69d1-49a7-bc7e-53409f377b2d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:08.593034 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1380/2762] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:08 2022] PUT /identity/v3/projects/a9447664e82b4e76b7f35817dd596a38/users/ead4cb17c56a40eea79d464b2ea631e0/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:08.603308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254feed1-2853-4903-a997-82b3baa3447e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.603614 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254feed1-2853-4903-a997-82b3baa3447e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.603902 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254feed1-2853-4903-a997-82b3baa3447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.635563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-254feed1-2853-4903-a997-82b3baa3447e None None] MFA Rules not processed for user `ead4cb17c56a40eea79d464b2ea631e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:08.638025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-254feed1-2853-4903-a997-82b3baa3447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:08.703272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1383/2763] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:08.708746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bb284-69d1-49a7-bc7e-53409f377b2d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:08.773221 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bb284-69d1-49a7-bc7e-53409f377b2d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.778665 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff44f8c-837f-4488-9302-48c7ca40c105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.779333 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff44f8c-837f-4488-9302-48c7ca40c105 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.779621 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff44f8c-837f-4488-9302-48c7ca40c105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.779900 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff44f8c-837f-4488-9302-48c7ca40c105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.780597 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff44f8c-837f-4488-9302-48c7ca40c105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:08.782528 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff44f8c-837f-4488-9302-48c7ca40c105 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:08.809320 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1381/2764] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:16:08 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:16:08.813400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254feed1-2853-4903-a997-82b3baa3447e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:08.824395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254feed1-2853-4903-a997-82b3baa3447e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.863083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:08.882719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd461377-0e3c-4f5d-b82c-c852d53cd6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.883456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd461377-0e3c-4f5d-b82c-c852d53cd6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.883740 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd461377-0e3c-4f5d-b82c-c852d53cd6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.884117 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd461377-0e3c-4f5d-b82c-c852d53cd6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.884833 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd461377-0e3c-4f5d-b82c-c852d53cd6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:08.887340 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd461377-0e3c-4f5d-b82c-c852d53cd6d5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:08.910686 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1384/2765] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:16:08 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:16:08.911960 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff44f8c-837f-4488-9302-48c7ca40c105 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:08.923402 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff44f8c-837f-4488-9302-48c7ca40c105 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.928109 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e5ae2-2723-44d4-b202-64a55bc19c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.928759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5ae2-2723-44d4-b202-64a55bc19c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.929050 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5ae2-2723-44d4-b202-64a55bc19c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.929342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5ae2-2723-44d4-b202-64a55bc19c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.930072 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e5ae2-2723-44d4-b202-64a55bc19c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:08.931703 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e5ae2-2723-44d4-b202-64a55bc19c77 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:08.942132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1382/2766] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:08.945874 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd461377-0e3c-4f5d-b82c-c852d53cd6d5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:08.957328 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd461377-0e3c-4f5d-b82c-c852d53cd6d5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.962186 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b55aa1-67c9-4776-b437-4cf2cacbe31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.962895 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b55aa1-67c9-4776-b437-4cf2cacbe31b admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.963185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b55aa1-67c9-4776-b437-4cf2cacbe31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.964096 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b55aa1-67c9-4776-b437-4cf2cacbe31b admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.964834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b55aa1-67c9-4776-b437-4cf2cacbe31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:08.966458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b55aa1-67c9-4776-b437-4cf2cacbe31b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:08.976627 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1385/2767] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:16:08.981018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e5ae2-2723-44d4-b202-64a55bc19c77 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:08.990963 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e5ae2-2723-44d4-b202-64a55bc19c77 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.996362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51357918-eaab-42f6-a18f-b87956100131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.997288 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51357918-eaab-42f6-a18f-b87956100131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.997565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51357918-eaab-42f6-a18f-b87956100131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.997840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51357918-eaab-42f6-a18f-b87956100131 admin admin] PATH_INFO: `/v3/projects/07bf9a61c8c94e6ca04d24ec51d7c9e8/users/006bd654f91d4021a2868c7989cc3956/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:09.014844 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51357918-eaab-42f6-a18f-b87956100131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bf9a61c8c94e6ca04d24ec51d7c9e8, user_id=006bd654f91d4021a2868c7989cc3956, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:09.017499 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51357918-eaab-42f6-a18f-b87956100131 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:09.031036 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1383/2768] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:08 2022] PUT /identity/v3/projects/07bf9a61c8c94e6ca04d24ec51d7c9e8/users/006bd654f91d4021a2868c7989cc3956/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:09.041114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680faea-03a8-450b-b3c4-ce019e2aa898 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:09.041433 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680faea-03a8-450b-b3c4-ce019e2aa898 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:09.041719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680faea-03a8-450b-b3c4-ce019e2aa898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:09.068151 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7680faea-03a8-450b-b3c4-ce019e2aa898 None None] MFA Rules not processed for user `006bd654f91d4021a2868c7989cc3956`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:09.069372 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7680faea-03a8-450b-b3c4-ce019e2aa898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:09.137591 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1386/2769] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:09.142098 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51357918-eaab-42f6-a18f-b87956100131 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:09.187660 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:09.207099 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51357918-eaab-42f6-a18f-b87956100131 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:09.211933 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98b388-622b-4f10-9d1d-c23b027d866c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:09.212598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98b388-622b-4f10-9d1d-c23b027d866c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:09.212883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98b388-622b-4f10-9d1d-c23b027d866c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:09.213157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98b388-622b-4f10-9d1d-c23b027d866c admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:09.214020 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98b388-622b-4f10-9d1d-c23b027d866c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:09.215953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98b388-622b-4f10-9d1d-c23b027d866c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:09.241626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1384/2770] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:16:09 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:09.246258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680faea-03a8-450b-b3c4-ce019e2aa898 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:09.257286 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680faea-03a8-450b-b3c4-ce019e2aa898 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:09.317178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfded20-dcc5-42bd-ac46-6624c7e60068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:09.318260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfded20-dcc5-42bd-ac46-6624c7e60068 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:09.318592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfded20-dcc5-42bd-ac46-6624c7e60068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:09.318887 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfded20-dcc5-42bd-ac46-6624c7e60068 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:09.319596 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfded20-dcc5-42bd-ac46-6624c7e60068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:09.321510 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfded20-dcc5-42bd-ac46-6624c7e60068 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:09.346841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1387/2771] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:16:09 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:09.350310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98b388-622b-4f10-9d1d-c23b027d866c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:09.361543 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98b388-622b-4f10-9d1d-c23b027d866c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:09.366132 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f664aaa-9fa6-4c1f-b927-ee44f63ab79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:09.366822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f664aaa-9fa6-4c1f-b927-ee44f63ab79e admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:09.367112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f664aaa-9fa6-4c1f-b927-ee44f63ab79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:09.367393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f664aaa-9fa6-4c1f-b927-ee44f63ab79e admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:09.368118 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f664aaa-9fa6-4c1f-b927-ee44f63ab79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:09.369755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f664aaa-9fa6-4c1f-b927-ee44f63ab79e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:09.380379 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1385/2772] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:09.384379 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfded20-dcc5-42bd-ac46-6624c7e60068 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:09.396393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfded20-dcc5-42bd-ac46-6624c7e60068 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:09.401603 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f126e42-6204-45f5-9961-a99c2ac29a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:09.402906 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f126e42-6204-45f5-9961-a99c2ac29a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:09.403188 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f126e42-6204-45f5-9961-a99c2ac29a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:09.403461 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f126e42-6204-45f5-9961-a99c2ac29a67 admin admin] PATH_INFO: `/v3/projects/164d16918b2a461cab8ededc3a23027c/users/19a22ba92cce47589b088a3e4e114bc9/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:09.419179 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f126e42-6204-45f5-9961-a99c2ac29a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=164d16918b2a461cab8ededc3a23027c, user_id=19a22ba92cce47589b088a3e4e114bc9, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:09.421797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f126e42-6204-45f5-9961-a99c2ac29a67 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:09.434763 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1388/2773] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:09 2022] PUT /identity/v3/projects/164d16918b2a461cab8ededc3a23027c/users/19a22ba92cce47589b088a3e4e114bc9/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:09.438892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f664aaa-9fa6-4c1f-b927-ee44f63ab79e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:09.449566 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f664aaa-9fa6-4c1f-b927-ee44f63ab79e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:09.508767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d7e83-c245-49cf-88d5-5d8de4f96648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:09.509439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d7e83-c245-49cf-88d5-5d8de4f96648 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:09.509723 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d7e83-c245-49cf-88d5-5d8de4f96648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:09.509998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d7e83-c245-49cf-88d5-5d8de4f96648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:09.511192 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d7e83-c245-49cf-88d5-5d8de4f96648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:09.512945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d7e83-c245-49cf-88d5-5d8de4f96648 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:09.522721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1386/2774] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:09.527486 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f126e42-6204-45f5-9961-a99c2ac29a67 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:09.538153 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f126e42-6204-45f5-9961-a99c2ac29a67 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:09.544049 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd872bae-7128-4adb-8ce8-5002397cee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:09.544961 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd872bae-7128-4adb-8ce8-5002397cee12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:09.545251 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd872bae-7128-4adb-8ce8-5002397cee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:09.545542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd872bae-7128-4adb-8ce8-5002397cee12 admin admin] PATH_INFO: `/v3/projects/164d16918b2a461cab8ededc3a23027c/users/19a22ba92cce47589b088a3e4e114bc9/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:09.547599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd872bae-7128-4adb-8ce8-5002397cee12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=164d16918b2a461cab8ededc3a23027c, user_id=19a22ba92cce47589b088a3e4e114bc9, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:09.550222 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd872bae-7128-4adb-8ce8-5002397cee12 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:09.556862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:09.562120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1389/2775] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:09 2022] PUT /identity/v3/projects/164d16918b2a461cab8ededc3a23027c/users/19a22ba92cce47589b088a3e4e114bc9/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:09.573667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002c5ff-eee8-491c-a3d8-60fcb4ce7d8c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:09.573901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002c5ff-eee8-491c-a3d8-60fcb4ce7d8c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:09.574230 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002c5ff-eee8-491c-a3d8-60fcb4ce7d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:09.611078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2002c5ff-eee8-491c-a3d8-60fcb4ce7d8c None None] MFA Rules not processed for user `19a22ba92cce47589b088a3e4e114bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:09.611078 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2002c5ff-eee8-491c-a3d8-60fcb4ce7d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:09.685680 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1387/2776] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:09.696989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd872bae-7128-4adb-8ce8-5002397cee12 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:09.699629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cd872bae-7128-4adb-8ce8-5002397cee12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:09.758963 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd872bae-7128-4adb-8ce8-5002397cee12 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:09.763247 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928379e-3119-47cb-a98c-7c8301566e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:09.763920 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928379e-3119-47cb-a98c-7c8301566e0e service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:09.764205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928379e-3119-47cb-a98c-7c8301566e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:09.764481 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928379e-3119-47cb-a98c-7c8301566e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:09.773828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928379e-3119-47cb-a98c-7c8301566e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:09.775283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928379e-3119-47cb-a98c-7c8301566e0e service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:09.786470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1390/2777] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:09.827743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002c5ff-eee8-491c-a3d8-60fcb4ce7d8c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:09.829091 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2002c5ff-eee8-491c-a3d8-60fcb4ce7d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:09.842403 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002c5ff-eee8-491c-a3d8-60fcb4ce7d8c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:09.846008 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322639a-d224-4ff8-86e8-9a87a5b34b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:09.846683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322639a-d224-4ff8-86e8-9a87a5b34b7b service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:09.846974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322639a-d224-4ff8-86e8-9a87a5b34b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:09.847254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322639a-d224-4ff8-86e8-9a87a5b34b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:09.880925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:09.907129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322639a-d224-4ff8-86e8-9a87a5b34b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:09.908572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322639a-d224-4ff8-86e8-9a87a5b34b7b service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:09.917661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1388/2778] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:12.791841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928379e-3119-47cb-a98c-7c8301566e0e service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:12.855789 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928379e-3119-47cb-a98c-7c8301566e0e service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:12.860270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:12.861135 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:12.861420 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:12.861796 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] PATH_INFO: `/v3/users/ead4cb17c56a40eea79d464b2ea631e0` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:12.863112 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead4cb17c56a40eea79d464b2ea631e0)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:12.865384 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:12.914680 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead4cb17c56a40eea79d464b2ea631e0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:12.915339 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead4cb17c56a40eea79d464b2ea631e0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:12.927305 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead4cb17c56a40eea79d464b2ea631e0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:12.935643 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead4cb17c56a40eea79d464b2ea631e0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:12.936285 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead4cb17c56a40eea79d464b2ea631e0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:12.955302 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1391/2779] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:12 2022] DELETE /identity/v3/users/ead4cb17c56a40eea79d464b2ea631e0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:12.960032 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddd7bc-38d5-4438-9790-1dc633950dba None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:12.960488 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddd7bc-38d5-4438-9790-1dc633950dba None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:12.960604 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddd7bc-38d5-4438-9790-1dc633950dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:12.984667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-07ddd7bc-38d5-4438-9790-1dc633950dba None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:12.985878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-07ddd7bc-38d5-4438-9790-1dc633950dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:13.069282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1389/2780] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:13.080517 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:13.081957 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:13.115161 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:13.150637 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35962164-6a1a-456c-84ef-fc863bc1a4d3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:13.154809 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5320a-20b7-412a-a778-e86c579cb5fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:13.155489 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5320a-20b7-412a-a778-e86c579cb5fd service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:13.155780 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5320a-20b7-412a-a778-e86c579cb5fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:13.156063 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5320a-20b7-412a-a778-e86c579cb5fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:13.167355 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5320a-20b7-412a-a778-e86c579cb5fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:13.168799 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5320a-20b7-412a-a778-e86c579cb5fd service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:13.178462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1392/2781] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:13.518129 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddd7bc-38d5-4438-9790-1dc633950dba None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:13.519801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-07ddd7bc-38d5-4438-9790-1dc633950dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:13.532375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddd7bc-38d5-4438-9790-1dc633950dba None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:13.537548 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:13.538472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:13.538907 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:13.539743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] PATH_INFO: `/v3/projects/a9447664e82b4e76b7f35817dd596a38` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:13.540448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9447664e82b4e76b7f35817dd596a38)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:13.542420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:13.598824 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9447664e82b4e76b7f35817dd596a38', 'request_id': 'req-11dba0c2-6012-423b-a0e8-7f1660567447'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:13.604833 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9447664e82b4e76b7f35817dd596a38', 'request_id': 'req-11dba0c2-6012-423b-a0e8-7f1660567447'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:13.611849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9447664e82b4e76b7f35817dd596a38', 'request_id': 'req-11dba0c2-6012-423b-a0e8-7f1660567447'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:13.628834 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] The token cache is being invalidate because project a9447664e82b4e76b7f35817dd596a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:13.629311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:13.630302 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:13.632272 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1390/2782] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:13 2022] DELETE /identity/v3/projects/a9447664e82b4e76b7f35817dd596a38 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:13.636377 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5320a-20b7-412a-a778-e86c579cb5fd service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:13.647245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5320a-20b7-412a-a778-e86c579cb5fd service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:13.727092 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:13.728489 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:13.728955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:13.729422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] PATH_INFO: `/v3/users/006bd654f91d4021a2868c7989cc3956` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:13.730754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=006bd654f91d4021a2868c7989cc3956)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:13.733711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:13.805508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006bd654f91d4021a2868c7989cc3956'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:13.806613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006bd654f91d4021a2868c7989cc3956'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:13.817203 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006bd654f91d4021a2868c7989cc3956'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:13.827395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006bd654f91d4021a2868c7989cc3956'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:13.828067 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006bd654f91d4021a2868c7989cc3956'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:13.851976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1393/2783] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:13 2022] DELETE /identity/v3/users/006bd654f91d4021a2868c7989cc3956 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:14.137357 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:14.139349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:14.153957 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba0c2-6012-423b-a0e8-7f1660567447 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:14.218472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:14.219337 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:14.219620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:14.219901 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] PATH_INFO: `/v3/projects/07bf9a61c8c94e6ca04d24ec51d7c9e8` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:14.221082 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bf9a61c8c94e6ca04d24ec51d7c9e8)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:14.223031 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:14.224526 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:14.273768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bf9a61c8c94e6ca04d24ec51d7c9e8', 'request_id': 'req-28058373-3c8f-41fb-9a47-16c2a45fbb99'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.280615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bf9a61c8c94e6ca04d24ec51d7c9e8', 'request_id': 'req-28058373-3c8f-41fb-9a47-16c2a45fbb99'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.286912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bf9a61c8c94e6ca04d24ec51d7c9e8', 'request_id': 'req-28058373-3c8f-41fb-9a47-16c2a45fbb99'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.299572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] The token cache is being invalidate because project 07bf9a61c8c94e6ca04d24ec51d7c9e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:14.299862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.300492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.302038 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1391/2784] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:14 2022] DELETE /identity/v3/projects/07bf9a61c8c94e6ca04d24ec51d7c9e8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:14.306034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:14.307553 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:14.322938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6f7c9-7579-42d2-be33-e2c91936d4fd admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:14.366905 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:14.383233 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c9410-9431-4d7c-a293-45a65b8d0282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:14.384106 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c9410-9431-4d7c-a293-45a65b8d0282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:14.384412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c9410-9431-4d7c-a293-45a65b8d0282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:14.384689 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c9410-9431-4d7c-a293-45a65b8d0282 admin admin] PATH_INFO: `/v3/users/19a22ba92cce47589b088a3e4e114bc9` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:14.385869 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c9410-9431-4d7c-a293-45a65b8d0282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a22ba92cce47589b088a3e4e114bc9)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:14.388500 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c9410-9431-4d7c-a293-45a65b8d0282 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:14.436983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cc0c9410-9431-4d7c-a293-45a65b8d0282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a22ba92cce47589b088a3e4e114bc9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.437628 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cc0c9410-9431-4d7c-a293-45a65b8d0282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a22ba92cce47589b088a3e4e114bc9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.445075 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cc0c9410-9431-4d7c-a293-45a65b8d0282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a22ba92cce47589b088a3e4e114bc9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.454023 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cc0c9410-9431-4d7c-a293-45a65b8d0282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a22ba92cce47589b088a3e4e114bc9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.454987 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cc0c9410-9431-4d7c-a293-45a65b8d0282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a22ba92cce47589b088a3e4e114bc9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.473229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1394/2785] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:14 2022] DELETE /identity/v3/users/19a22ba92cce47589b088a3e4e114bc9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:14.754472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:14.755896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:14.773753 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28058373-3c8f-41fb-9a47-16c2a45fbb99 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:14.836509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03df583-5fb7-4173-8567-d5b034e499ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:14.837373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03df583-5fb7-4173-8567-d5b034e499ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:14.837655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03df583-5fb7-4173-8567-d5b034e499ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:14.837953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03df583-5fb7-4173-8567-d5b034e499ff admin admin] PATH_INFO: `/v3/projects/164d16918b2a461cab8ededc3a23027c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:14.839162 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03df583-5fb7-4173-8567-d5b034e499ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=164d16918b2a461cab8ededc3a23027c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:14.841127 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03df583-5fb7-4173-8567-d5b034e499ff admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:14.892069 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c03df583-5fb7-4173-8567-d5b034e499ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '164d16918b2a461cab8ededc3a23027c', 'request_id': 'req-c03df583-5fb7-4173-8567-d5b034e499ff'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.897900 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c03df583-5fb7-4173-8567-d5b034e499ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '164d16918b2a461cab8ededc3a23027c', 'request_id': 'req-c03df583-5fb7-4173-8567-d5b034e499ff'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.905094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c03df583-5fb7-4173-8567-d5b034e499ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '164d16918b2a461cab8ededc3a23027c', 'request_id': 'req-c03df583-5fb7-4173-8567-d5b034e499ff'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.917731 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c03df583-5fb7-4173-8567-d5b034e499ff admin admin] The token cache is being invalidate because project 164d16918b2a461cab8ededc3a23027c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:14.918018 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c03df583-5fb7-4173-8567-d5b034e499ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.920128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c03df583-5fb7-4173-8567-d5b034e499ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:14.921683 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1392/2786] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:14 2022] DELETE /identity/v3/projects/164d16918b2a461cab8ededc3a23027c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:14.927590 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89776b1-ad76-4213-a909-208f821f0115 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:14.928070 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89776b1-ad76-4213-a909-208f821f0115 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:14.928168 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89776b1-ad76-4213-a909-208f821f0115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:14.947117 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f89776b1-ad76-4213-a909-208f821f0115 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:14.948313 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f89776b1-ad76-4213-a909-208f821f0115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:15.011852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1395/2787] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:15.021128 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7aa2f-8c3c-4af8-8282-656014d30745 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:15.021474 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7aa2f-8c3c-4af8-8282-656014d30745 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:15.021789 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7aa2f-8c3c-4af8-8282-656014d30745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:15.041029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b2b7aa2f-8c3c-4af8-8282-656014d30745 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:15.042266 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b2b7aa2f-8c3c-4af8-8282-656014d30745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:15.050708 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1393/2788] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:15.055045 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89776b1-ad76-4213-a909-208f821f0115 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:15.065673 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89776b1-ad76-4213-a909-208f821f0115 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:15.070711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb25cb-874f-4314-bae6-839301acb42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:15.071404 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb25cb-874f-4314-bae6-839301acb42a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:15.071709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb25cb-874f-4314-bae6-839301acb42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:15.071983 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb25cb-874f-4314-bae6-839301acb42a admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:15.072709 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb25cb-874f-4314-bae6-839301acb42a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:16:15.073015 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb25cb-874f-4314-bae6-839301acb42a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:15.074622 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb25cb-874f-4314-bae6-839301acb42a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:15.087832 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1396/2789] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:16:15.092865 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7aa2f-8c3c-4af8-8282-656014d30745 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:15.102314 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7aa2f-8c3c-4af8-8282-656014d30745 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:15.107510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2abdd-9686-4c14-81f4-26af111c7b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:15.108166 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2abdd-9686-4c14-81f4-26af111c7b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:15.108447 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2abdd-9686-4c14-81f4-26af111c7b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:15.108718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2abdd-9686-4c14-81f4-26af111c7b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:15.109420 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2abdd-9686-4c14-81f4-26af111c7b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:15.111367 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2abdd-9686-4c14-81f4-26af111c7b61 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:15.121531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:15.140979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1394/2790] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:16:15 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:15.145307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb25cb-874f-4314-bae6-839301acb42a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:15.156684 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb25cb-874f-4314-bae6-839301acb42a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:15.205688 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:15.217758 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f4923-2ab1-4705-be14-2de73eecec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:15.218470 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4923-2ab1-4705-be14-2de73eecec0b admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:15.218763 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4923-2ab1-4705-be14-2de73eecec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:15.219047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4923-2ab1-4705-be14-2de73eecec0b admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:15.219743 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f4923-2ab1-4705-be14-2de73eecec0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:15.221696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f4923-2ab1-4705-be14-2de73eecec0b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:15.241446 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1397/2791] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:16:15 2022] POST /identity/v3/users => generated 281 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:15.245598 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2abdd-9686-4c14-81f4-26af111c7b61 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:15.257301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2abdd-9686-4c14-81f4-26af111c7b61 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:15.261878 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829e172-2a94-4791-8a07-6397883b69b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:15.263313 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829e172-2a94-4791-8a07-6397883b69b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:15.263610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829e172-2a94-4791-8a07-6397883b69b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:15.263892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829e172-2a94-4791-8a07-6397883b69b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:15.264623 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829e172-2a94-4791-8a07-6397883b69b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:15.266222 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829e172-2a94-4791-8a07-6397883b69b7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:15.277062 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1395/2792] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:15.281359 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f4923-2ab1-4705-be14-2de73eecec0b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:15.291507 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f4923-2ab1-4705-be14-2de73eecec0b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:15.296378 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc856e81-6a83-4c50-930b-fb289fe49f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:15.297063 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc856e81-6a83-4c50-930b-fb289fe49f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:15.297358 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc856e81-6a83-4c50-930b-fb289fe49f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:15.297650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc856e81-6a83-4c50-930b-fb289fe49f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:15.298424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc856e81-6a83-4c50-930b-fb289fe49f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:15.300037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc856e81-6a83-4c50-930b-fb289fe49f2d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:15.311293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1398/2793] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:15.315921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829e172-2a94-4791-8a07-6397883b69b7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:15.326886 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829e172-2a94-4791-8a07-6397883b69b7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:15.332467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfaa34-ce92-43ea-9691-8ff026d44c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:15.333472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfaa34-ce92-43ea-9691-8ff026d44c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:15.333986 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfaa34-ce92-43ea-9691-8ff026d44c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:15.334317 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfaa34-ce92-43ea-9691-8ff026d44c52 admin admin] PATH_INFO: `/v3/projects/5673567e43694153a576690c010e4fc0/users/ccf20d0b9bdd4b89856435aca43bb21a/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:15.351542 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfaa34-ce92-43ea-9691-8ff026d44c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5673567e43694153a576690c010e4fc0, user_id=ccf20d0b9bdd4b89856435aca43bb21a, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:15.354271 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfaa34-ce92-43ea-9691-8ff026d44c52 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:15.366937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1396/2794] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:15 2022] PUT /identity/v3/projects/5673567e43694153a576690c010e4fc0/users/ccf20d0b9bdd4b89856435aca43bb21a/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:16:15.379663 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37da354-7861-41f0-b4da-c265f88391b5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:15.379964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37da354-7861-41f0-b4da-c265f88391b5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:15.380249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37da354-7861-41f0-b4da-c265f88391b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:15.408309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f37da354-7861-41f0-b4da-c265f88391b5 None None] MFA Rules not processed for user `ccf20d0b9bdd4b89856435aca43bb21a`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:15.409556 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f37da354-7861-41f0-b4da-c265f88391b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:15.475741 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1399/2795] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:15.507472 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfaa34-ce92-43ea-9691-8ff026d44c52 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:15.509150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-20dfaa34-ce92-43ea-9691-8ff026d44c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:15.567456 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfaa34-ce92-43ea-9691-8ff026d44c52 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:15.571684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53e15e-8762-481b-91ef-5dda00e928b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:15.572359 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53e15e-8762-481b-91ef-5dda00e928b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:15.572642 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53e15e-8762-481b-91ef-5dda00e928b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:15.572921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53e15e-8762-481b-91ef-5dda00e928b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:15.583023 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53e15e-8762-481b-91ef-5dda00e928b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:15.584455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53e15e-8762-481b-91ef-5dda00e928b6 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:15.594006 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1397/2796] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:15.612469 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37da354-7861-41f0-b4da-c265f88391b5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:15.683129 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37da354-7861-41f0-b4da-c265f88391b5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:15.688518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:15.689388 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:15.689671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:15.689945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] PATH_INFO: `/v3/users/ccf20d0b9bdd4b89856435aca43bb21a` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:15.691176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf20d0b9bdd4b89856435aca43bb21a)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:15.693144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:15.739893 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf20d0b9bdd4b89856435aca43bb21a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:15.740577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf20d0b9bdd4b89856435aca43bb21a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:15.748182 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf20d0b9bdd4b89856435aca43bb21a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:15.751724 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:15.756425 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf20d0b9bdd4b89856435aca43bb21a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:15.757654 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf20d0b9bdd4b89856435aca43bb21a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:15.777003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1400/2797] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:15 2022] DELETE /identity/v3/users/ccf20d0b9bdd4b89856435aca43bb21a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:15.783142 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b734f0-8374-4464-9421-8f27b49018d6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:15.783430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b734f0-8374-4464-9421-8f27b49018d6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:15.783734 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b734f0-8374-4464-9421-8f27b49018d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:15.802052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-65b734f0-8374-4464-9421-8f27b49018d6 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:15.803270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-65b734f0-8374-4464-9421-8f27b49018d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:15.863950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1398/2798] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:15.873407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:15.874822 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:15.934393 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b1900-b0e0-4981-ab03-960b1d062001 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:15.938306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e8b3-2f41-450b-98ae-2f753193f183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:15.938979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e8b3-2f41-450b-98ae-2f753193f183 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:15.939267 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e8b3-2f41-450b-98ae-2f753193f183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:15.939549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e8b3-2f41-450b-98ae-2f753193f183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:15.948851 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e8b3-2f41-450b-98ae-2f753193f183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:15.951017 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e8b3-2f41-450b-98ae-2f753193f183 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:15.961097 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1401/2799] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:16.229774 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b734f0-8374-4464-9421-8f27b49018d6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:16.231380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-65b734f0-8374-4464-9421-8f27b49018d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:16.243747 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b734f0-8374-4464-9421-8f27b49018d6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:16.249058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080a75d-4453-48d4-ad86-db39307104d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:16.249925 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080a75d-4453-48d4-ad86-db39307104d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:16.250219 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080a75d-4453-48d4-ad86-db39307104d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:16.250531 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080a75d-4453-48d4-ad86-db39307104d4 admin admin] PATH_INFO: `/v3/projects/5673567e43694153a576690c010e4fc0` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:16.251754 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080a75d-4453-48d4-ad86-db39307104d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5673567e43694153a576690c010e4fc0)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:16.253662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080a75d-4453-48d4-ad86-db39307104d4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:16.301495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c080a75d-4453-48d4-ad86-db39307104d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5673567e43694153a576690c010e4fc0', 'request_id': 'req-c080a75d-4453-48d4-ad86-db39307104d4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:16.305590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:16.307822 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c080a75d-4453-48d4-ad86-db39307104d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5673567e43694153a576690c010e4fc0', 'request_id': 'req-c080a75d-4453-48d4-ad86-db39307104d4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:16.315453 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c080a75d-4453-48d4-ad86-db39307104d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5673567e43694153a576690c010e4fc0', 'request_id': 'req-c080a75d-4453-48d4-ad86-db39307104d4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:16.331637 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c080a75d-4453-48d4-ad86-db39307104d4 admin admin] The token cache is being invalidate because project 5673567e43694153a576690c010e4fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:16.331921 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c080a75d-4453-48d4-ad86-db39307104d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:16.332610 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c080a75d-4453-48d4-ad86-db39307104d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:16.334173 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1399/2800] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:16 2022] DELETE /identity/v3/projects/5673567e43694153a576690c010e4fc0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:16.340823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb7b8-9c18-432e-bf9f-ee70bff31930 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:16.341116 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb7b8-9c18-432e-bf9f-ee70bff31930 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:16.341577 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb7b8-9c18-432e-bf9f-ee70bff31930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:16.359797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2bcfb7b8-9c18-432e-bf9f-ee70bff31930 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:16.360979 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2bcfb7b8-9c18-432e-bf9f-ee70bff31930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:16.420028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1402/2801] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:16.427786 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33adf-a91d-461c-bc2a-74a27b60a237 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:16.428084 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33adf-a91d-461c-bc2a-74a27b60a237 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:16.428370 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33adf-a91d-461c-bc2a-74a27b60a237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:16.448172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f8e33adf-a91d-461c-bc2a-74a27b60a237 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:16.449535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f8e33adf-a91d-461c-bc2a-74a27b60a237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:16.457967 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1400/2802] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:16.462137 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfb7b8-9c18-432e-bf9f-ee70bff31930 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:16.472110 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfb7b8-9c18-432e-bf9f-ee70bff31930 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:16.476592 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d729e-1381-41bb-a3a1-9766c0153b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:16.477247 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d729e-1381-41bb-a3a1-9766c0153b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:16.477534 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d729e-1381-41bb-a3a1-9766c0153b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:16.477814 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d729e-1381-41bb-a3a1-9766c0153b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:16.478570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d729e-1381-41bb-a3a1-9766c0153b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:16:16.478882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d729e-1381-41bb-a3a1-9766c0153b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:16.480482 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d729e-1381-41bb-a3a1-9766c0153b21 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:16.492964 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1403/2803] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:16:16.497168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e33adf-a91d-461c-bc2a-74a27b60a237 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:16.506467 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e33adf-a91d-461c-bc2a-74a27b60a237 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:16.511050 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4901ab2-79fd-4dea-9126-1908b9029356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:16.511695 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4901ab2-79fd-4dea-9126-1908b9029356 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:16.511985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4901ab2-79fd-4dea-9126-1908b9029356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:16.512265 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4901ab2-79fd-4dea-9126-1908b9029356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:16.513482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4901ab2-79fd-4dea-9126-1908b9029356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:16.515422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4901ab2-79fd-4dea-9126-1908b9029356 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:16.540517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1401/2804] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:16:16 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:16.544621 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d729e-1381-41bb-a3a1-9766c0153b21 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:16.554484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d729e-1381-41bb-a3a1-9766c0153b21 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:16.611051 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f17d0e-a31a-458e-a1e3-ecd013ca35ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:16.611727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f17d0e-a31a-458e-a1e3-ecd013ca35ed admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:16.612020 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f17d0e-a31a-458e-a1e3-ecd013ca35ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:16.612303 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f17d0e-a31a-458e-a1e3-ecd013ca35ed admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:16.613005 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f17d0e-a31a-458e-a1e3-ecd013ca35ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:16.615083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f17d0e-a31a-458e-a1e3-ecd013ca35ed admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:16.630031 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:16.640708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1404/2805] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:16:16 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:16.641981 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4901ab2-79fd-4dea-9126-1908b9029356 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:16.652282 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4901ab2-79fd-4dea-9126-1908b9029356 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:16.657426 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b29c2e-bbd6-4ca5-8ccd-ce443f3dc8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:16.658075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b29c2e-bbd6-4ca5-8ccd-ce443f3dc8cc admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:16.658351 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b29c2e-bbd6-4ca5-8ccd-ce443f3dc8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:16.658666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b29c2e-bbd6-4ca5-8ccd-ce443f3dc8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:16.659388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b29c2e-bbd6-4ca5-8ccd-ce443f3dc8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:16.660980 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b29c2e-bbd6-4ca5-8ccd-ce443f3dc8cc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:16.671518 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1402/2806] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:16.675270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f17d0e-a31a-458e-a1e3-ecd013ca35ed admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:16.685078 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f17d0e-a31a-458e-a1e3-ecd013ca35ed admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:16.689599 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cd567-b6ab-4230-9790-5160b1ce847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:16.690258 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cd567-b6ab-4230-9790-5160b1ce847e admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:16.690574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cd567-b6ab-4230-9790-5160b1ce847e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:16.690854 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cd567-b6ab-4230-9790-5160b1ce847e admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:16.691578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cd567-b6ab-4230-9790-5160b1ce847e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:16.693147 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cd567-b6ab-4230-9790-5160b1ce847e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:16.704202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1405/2807] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:16:16.709108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b29c2e-bbd6-4ca5-8ccd-ce443f3dc8cc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:16.719517 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b29c2e-bbd6-4ca5-8ccd-ce443f3dc8cc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:16.723983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8014f-1c45-4d58-8004-4438e5e05441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:16.724850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8014f-1c45-4d58-8004-4438e5e05441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:16.725131 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8014f-1c45-4d58-8004-4438e5e05441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:16.725404 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8014f-1c45-4d58-8004-4438e5e05441 admin admin] PATH_INFO: `/v3/projects/d1ae354fc66740b6acbcf1a6d97cf02a/users/686fad92c5034b3ebfd0dbbd4564c566/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:16.739593 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8014f-1c45-4d58-8004-4438e5e05441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ae354fc66740b6acbcf1a6d97cf02a, user_id=686fad92c5034b3ebfd0dbbd4564c566, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:16.742211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8014f-1c45-4d58-8004-4438e5e05441 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:16.755399 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1403/2808] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:16 2022] PUT /identity/v3/projects/d1ae354fc66740b6acbcf1a6d97cf02a/users/686fad92c5034b3ebfd0dbbd4564c566/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:16.760283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550b813-c77f-478f-87ab-89d22209bb9d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:16.760581 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550b813-c77f-478f-87ab-89d22209bb9d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:16.760863 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550b813-c77f-478f-87ab-89d22209bb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:16.779484 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0550b813-c77f-478f-87ab-89d22209bb9d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:16.780466 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0550b813-c77f-478f-87ab-89d22209bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:16.840314 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1406/2809] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:16.850136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8014f-1c45-4d58-8004-4438e5e05441 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:16.851950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2da8014f-1c45-4d58-8004-4438e5e05441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:16.909619 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8014f-1c45-4d58-8004-4438e5e05441 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:16.913217 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d5d3e-eec5-4cc6-b035-8f66203ad241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:16.913855 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d5d3e-eec5-4cc6-b035-8f66203ad241 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:16.914138 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d5d3e-eec5-4cc6-b035-8f66203ad241 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:16.914448 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d5d3e-eec5-4cc6-b035-8f66203ad241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:16.924482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d5d3e-eec5-4cc6-b035-8f66203ad241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:16.926086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d5d3e-eec5-4cc6-b035-8f66203ad241 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:16.936468 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1404/2810] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:17.537901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8c61d-c440-40c8-af88-ddbcccec16cb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:17.538432 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8c61d-c440-40c8-af88-ddbcccec16cb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:17.538533 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8c61d-c440-40c8-af88-ddbcccec16cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:17.565811 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1fc8c61d-c440-40c8-af88-ddbcccec16cb None None] MFA Rules not processed for user `686fad92c5034b3ebfd0dbbd4564c566`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:17.567156 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1fc8c61d-c440-40c8-af88-ddbcccec16cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:17.635083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1407/2811] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:17.646604 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d5d3e-eec5-4cc6-b035-8f66203ad241 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:17.648092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-648d5d3e-eec5-4cc6-b035-8f66203ad241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:17.708514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d5d3e-eec5-4cc6-b035-8f66203ad241 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:17.712185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52375d-4f4a-4cec-bbaf-df4855ea7a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:17.712818 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52375d-4f4a-4cec-bbaf-df4855ea7a5a service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:17.713110 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52375d-4f4a-4cec-bbaf-df4855ea7a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:17.713390 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52375d-4f4a-4cec-bbaf-df4855ea7a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:17.722204 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52375d-4f4a-4cec-bbaf-df4855ea7a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:17.723619 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52375d-4f4a-4cec-bbaf-df4855ea7a5a service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:17.732691 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1405/2812] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:16:19.078734 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716f8bd-6d9f-447b-855c-5336e0a0e1cd None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:19.079522 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716f8bd-6d9f-447b-855c-5336e0a0e1cd None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:19.079766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716f8bd-6d9f-447b-855c-5336e0a0e1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:19.099828 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6716f8bd-6d9f-447b-855c-5336e0a0e1cd None None] MFA Rules not processed for user `686fad92c5034b3ebfd0dbbd4564c566`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:19.101113 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6716f8bd-6d9f-447b-855c-5336e0a0e1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:19.108991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1408/2813] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:16:19.352016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52375d-4f4a-4cec-bbaf-df4855ea7a5a service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:19.353603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dd52375d-4f4a-4cec-bbaf-df4855ea7a5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:19.365849 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52375d-4f4a-4cec-bbaf-df4855ea7a5a service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:19.369688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748e5a7-399f-470f-97b8-60f57413b372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:19.370516 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748e5a7-399f-470f-97b8-60f57413b372 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:19.370759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748e5a7-399f-470f-97b8-60f57413b372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:19.371218 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748e5a7-399f-470f-97b8-60f57413b372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:19.372993 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6748e5a7-399f-470f-97b8-60f57413b372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:19.383617 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748e5a7-399f-470f-97b8-60f57413b372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:19.385053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748e5a7-399f-470f-97b8-60f57413b372 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:19.394433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1406/2814] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:20.444807 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716f8bd-6d9f-447b-855c-5336e0a0e1cd None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:20.446177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6716f8bd-6d9f-447b-855c-5336e0a0e1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:20.460306 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716f8bd-6d9f-447b-855c-5336e0a0e1cd None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:20.464711 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:20.465566 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:20.465849 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:20.466120 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] PATH_INFO: `/v3/users/740fdc4248884dfdbc13bd50561775df` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:20.467331 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=740fdc4248884dfdbc13bd50561775df)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:20.469229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:20.515827 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740fdc4248884dfdbc13bd50561775df'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:20.516525 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740fdc4248884dfdbc13bd50561775df'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:20.523540 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740fdc4248884dfdbc13bd50561775df'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:20.530800 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740fdc4248884dfdbc13bd50561775df'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:20.531447 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740fdc4248884dfdbc13bd50561775df'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:20.533369 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:20.550672 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1409/2815] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:20 2022] DELETE /identity/v3/users/740fdc4248884dfdbc13bd50561775df => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:20.555139 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7958e2-2dd8-4ad3-8827-b561914cc75f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:20.555591 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7958e2-2dd8-4ad3-8827-b561914cc75f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:20.555708 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7958e2-2dd8-4ad3-8827-b561914cc75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:20.572974 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ec7958e2-2dd8-4ad3-8827-b561914cc75f None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:20.574167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ec7958e2-2dd8-4ad3-8827-b561914cc75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:20.579159 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:20.634156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1407/2816] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:20.644492 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:20.645866 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:20.720395 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2442c-0693-4f6d-965f-6386037da4c5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:20.730450 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fccd9-cdf4-4224-a612-77fff474ec8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:20.731151 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fccd9-cdf4-4224-a612-77fff474ec8c service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:20.731440 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fccd9-cdf4-4224-a612-77fff474ec8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:20.731722 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fccd9-cdf4-4224-a612-77fff474ec8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:20.741973 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fccd9-cdf4-4224-a612-77fff474ec8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:20.743477 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fccd9-cdf4-4224-a612-77fff474ec8c service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:20.753754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1410/2817] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:21.060211 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7958e2-2dd8-4ad3-8827-b561914cc75f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:21.062937 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ec7958e2-2dd8-4ad3-8827-b561914cc75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:21.075386 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7958e2-2dd8-4ad3-8827-b561914cc75f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:21.081258 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a96a2-2d68-46f4-b748-0a9e54816681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:21.082254 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a96a2-2d68-46f4-b748-0a9e54816681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:21.082626 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a96a2-2d68-46f4-b748-0a9e54816681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:21.083016 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a96a2-2d68-46f4-b748-0a9e54816681 admin admin] PATH_INFO: `/v3/projects/b46822cc6fd34285a078dc78756a293f` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:21.084261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a96a2-2d68-46f4-b748-0a9e54816681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46822cc6fd34285a078dc78756a293f)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:21.086294 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a96a2-2d68-46f4-b748-0a9e54816681 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:21.136449 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e31a96a2-2d68-46f4-b748-0a9e54816681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46822cc6fd34285a078dc78756a293f', 'request_id': 'req-e31a96a2-2d68-46f4-b748-0a9e54816681'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:21.142302 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e31a96a2-2d68-46f4-b748-0a9e54816681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46822cc6fd34285a078dc78756a293f', 'request_id': 'req-e31a96a2-2d68-46f4-b748-0a9e54816681'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:21.149186 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e31a96a2-2d68-46f4-b748-0a9e54816681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46822cc6fd34285a078dc78756a293f', 'request_id': 'req-e31a96a2-2d68-46f4-b748-0a9e54816681'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:21.161667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e31a96a2-2d68-46f4-b748-0a9e54816681 admin admin] The token cache is being invalidate because project b46822cc6fd34285a078dc78756a293f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:21.161954 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e31a96a2-2d68-46f4-b748-0a9e54816681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:21.162624 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e31a96a2-2d68-46f4-b748-0a9e54816681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:21.164199 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1408/2818] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:21 2022] DELETE /identity/v3/projects/b46822cc6fd34285a078dc78756a293f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:21.169397 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bffe66-0560-4e6a-9193-6dc18a8142cb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:21.169737 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bffe66-0560-4e6a-9193-6dc18a8142cb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:21.170713 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bffe66-0560-4e6a-9193-6dc18a8142cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:21.189796 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-68bffe66-0560-4e6a-9193-6dc18a8142cb None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:21.191055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-68bffe66-0560-4e6a-9193-6dc18a8142cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:21.251967 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1411/2819] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:21.259592 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa3355-2d4d-4be6-bc28-77744247b288 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:21.259884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa3355-2d4d-4be6-bc28-77744247b288 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:21.260156 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa3355-2d4d-4be6-bc28-77744247b288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:21.280799 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-18aa3355-2d4d-4be6-bc28-77744247b288 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:21.282144 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-18aa3355-2d4d-4be6-bc28-77744247b288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:21.291444 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1409/2820] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:21.295774 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bffe66-0560-4e6a-9193-6dc18a8142cb None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:21.306309 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bffe66-0560-4e6a-9193-6dc18a8142cb None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:21.312196 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ad77d-fc3b-4940-acc0-a395a89d9f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:21.312868 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ad77d-fc3b-4940-acc0-a395a89d9f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:21.313157 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ad77d-fc3b-4940-acc0-a395a89d9f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:21.313437 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ad77d-fc3b-4940-acc0-a395a89d9f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:21.314177 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ad77d-fc3b-4940-acc0-a395a89d9f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:16:21.314535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ad77d-fc3b-4940-acc0-a395a89d9f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:21.316128 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ad77d-fc3b-4940-acc0-a395a89d9f49 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:21.330945 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1412/2821] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:16:21.335246 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa3355-2d4d-4be6-bc28-77744247b288 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:21.345681 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa3355-2d4d-4be6-bc28-77744247b288 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:21.350349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566e9af-60be-436b-ad55-af3ff80a6add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:21.351052 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566e9af-60be-436b-ad55-af3ff80a6add admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:21.351342 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566e9af-60be-436b-ad55-af3ff80a6add admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:21.351616 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566e9af-60be-436b-ad55-af3ff80a6add admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:21.352355 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566e9af-60be-436b-ad55-af3ff80a6add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:21.354305 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566e9af-60be-436b-ad55-af3ff80a6add admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:21.382393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1410/2822] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:16:21 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:16:21.386424 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ad77d-fc3b-4940-acc0-a395a89d9f49 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:21.397443 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ad77d-fc3b-4940-acc0-a395a89d9f49 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:21.452903 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025644c2-d609-44fe-95cf-46ec94b93479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:21.453549 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025644c2-d609-44fe-95cf-46ec94b93479 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:21.453752 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025644c2-d609-44fe-95cf-46ec94b93479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:21.454028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025644c2-d609-44fe-95cf-46ec94b93479 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:21.455024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025644c2-d609-44fe-95cf-46ec94b93479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:21.456909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025644c2-d609-44fe-95cf-46ec94b93479 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:21.475877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1413/2823] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:16:21 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:21.479950 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566e9af-60be-436b-ad55-af3ff80a6add admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:21.490949 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566e9af-60be-436b-ad55-af3ff80a6add admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:21.495547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66bd7c-4171-42fa-b1d9-5f22284be4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:21.496205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66bd7c-4171-42fa-b1d9-5f22284be4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:21.496492 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66bd7c-4171-42fa-b1d9-5f22284be4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:21.496775 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66bd7c-4171-42fa-b1d9-5f22284be4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:21.497503 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66bd7c-4171-42fa-b1d9-5f22284be4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:21.499693 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66bd7c-4171-42fa-b1d9-5f22284be4c6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:21.510292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1411/2824] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:16:21.514228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025644c2-d609-44fe-95cf-46ec94b93479 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:21.519411 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:21.525862 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025644c2-d609-44fe-95cf-46ec94b93479 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:21.532083 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c22a90-4843-4545-95cd-cf51a5086d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:21.533401 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c22a90-4843-4545-95cd-cf51a5086d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:21.533708 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c22a90-4843-4545-95cd-cf51a5086d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:21.533995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c22a90-4843-4545-95cd-cf51a5086d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:21.535012 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c22a90-4843-4545-95cd-cf51a5086d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:21.536608 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c22a90-4843-4545-95cd-cf51a5086d40 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:21.548271 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1414/2825] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:21.552227 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66bd7c-4171-42fa-b1d9-5f22284be4c6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:21.562752 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66bd7c-4171-42fa-b1d9-5f22284be4c6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:21.567298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991e9b6-2448-4581-94e7-5f4cdb48889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:21.568176 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991e9b6-2448-4581-94e7-5f4cdb48889c admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:21.568463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991e9b6-2448-4581-94e7-5f4cdb48889c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:21.568743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991e9b6-2448-4581-94e7-5f4cdb48889c admin admin] PATH_INFO: `/v3/projects/133c3a117e724a71a7376f0dd289294a/users/4af6403321584da892bcd721e207d7f5/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:21.583557 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991e9b6-2448-4581-94e7-5f4cdb48889c admin admin] RBAC: Authorizing `identity:create_grant(project_id=133c3a117e724a71a7376f0dd289294a, user_id=4af6403321584da892bcd721e207d7f5, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:21.586212 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991e9b6-2448-4581-94e7-5f4cdb48889c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:21.601292 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1412/2826] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:21 2022] PUT /identity/v3/projects/133c3a117e724a71a7376f0dd289294a/users/4af6403321584da892bcd721e207d7f5/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:21.612745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de315561-dac1-448c-94b0-97eab9969db9 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:21.613047 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de315561-dac1-448c-94b0-97eab9969db9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:21.613337 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de315561-dac1-448c-94b0-97eab9969db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:21.644400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-de315561-dac1-448c-94b0-97eab9969db9 None None] MFA Rules not processed for user `4af6403321584da892bcd721e207d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:21.645640 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-de315561-dac1-448c-94b0-97eab9969db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:21.722324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1415/2827] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:16:21.735726 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991e9b6-2448-4581-94e7-5f4cdb48889c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:21.737653 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b991e9b6-2448-4581-94e7-5f4cdb48889c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:21.782942 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:21.822301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991e9b6-2448-4581-94e7-5f4cdb48889c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:21.826180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2dd4a-7bdd-4dd4-b26a-d9e24ae978eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:21.827112 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2dd4a-7bdd-4dd4-b26a-d9e24ae978eb service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:21.827544 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2dd4a-7bdd-4dd4-b26a-d9e24ae978eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:21.827862 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2dd4a-7bdd-4dd4-b26a-d9e24ae978eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:21.840502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2dd4a-7bdd-4dd4-b26a-d9e24ae978eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:21.842559 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2dd4a-7bdd-4dd4-b26a-d9e24ae978eb service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:21.853755 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1413/2828] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:21.883064 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de315561-dac1-448c-94b0-97eab9969db9 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:21.948205 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de315561-dac1-448c-94b0-97eab9969db9 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:21.953178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:21.954054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:21.955172 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:21.955462 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] PATH_INFO: `/v3/users/4af6403321584da892bcd721e207d7f5` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:21.956666 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af6403321584da892bcd721e207d7f5)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:21.958610 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:22.010445 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af6403321584da892bcd721e207d7f5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:22.011223 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af6403321584da892bcd721e207d7f5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:22.020262 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af6403321584da892bcd721e207d7f5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:22.028270 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af6403321584da892bcd721e207d7f5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:22.029024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af6403321584da892bcd721e207d7f5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:22.044445 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:22.051051 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1416/2829] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:21 2022] DELETE /identity/v3/users/4af6403321584da892bcd721e207d7f5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:22.055891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83f5ee-a929-4235-881d-95cae7e6973e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:22.056191 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83f5ee-a929-4235-881d-95cae7e6973e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:22.056477 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83f5ee-a929-4235-881d-95cae7e6973e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:22.074679 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3b83f5ee-a929-4235-881d-95cae7e6973e None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:22.075885 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3b83f5ee-a929-4235-881d-95cae7e6973e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:22.141495 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1414/2830] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:22.148016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:22.149418 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:22.207999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846c9e5-b6ea-415e-8741-d517be0c3c66 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:22.211750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455a474-68af-40ad-a73c-70928b6f4f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:22.212407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455a474-68af-40ad-a73c-70928b6f4f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:22.212696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455a474-68af-40ad-a73c-70928b6f4f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:22.212984 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455a474-68af-40ad-a73c-70928b6f4f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:22.223259 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455a474-68af-40ad-a73c-70928b6f4f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:22.224759 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455a474-68af-40ad-a73c-70928b6f4f5f service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:22.235877 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1417/2831] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:22.679645 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83f5ee-a929-4235-881d-95cae7e6973e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:22.681124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3b83f5ee-a929-4235-881d-95cae7e6973e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:22.693270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83f5ee-a929-4235-881d-95cae7e6973e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:22.698590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc5740-caaf-42c3-9258-de47616dbbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:22.699491 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc5740-caaf-42c3-9258-de47616dbbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:22.699782 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc5740-caaf-42c3-9258-de47616dbbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:22.700061 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc5740-caaf-42c3-9258-de47616dbbbf admin admin] PATH_INFO: `/v3/projects/133c3a117e724a71a7376f0dd289294a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:22.701335 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc5740-caaf-42c3-9258-de47616dbbbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=133c3a117e724a71a7376f0dd289294a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:22.703357 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc5740-caaf-42c3-9258-de47616dbbbf admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:22.754368 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-11fc5740-caaf-42c3-9258-de47616dbbbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133c3a117e724a71a7376f0dd289294a', 'request_id': 'req-11fc5740-caaf-42c3-9258-de47616dbbbf'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:22.760655 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-11fc5740-caaf-42c3-9258-de47616dbbbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133c3a117e724a71a7376f0dd289294a', 'request_id': 'req-11fc5740-caaf-42c3-9258-de47616dbbbf'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:22.773180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-11fc5740-caaf-42c3-9258-de47616dbbbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133c3a117e724a71a7376f0dd289294a', 'request_id': 'req-11fc5740-caaf-42c3-9258-de47616dbbbf'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:22.787936 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-11fc5740-caaf-42c3-9258-de47616dbbbf admin admin] The token cache is being invalidate because project 133c3a117e724a71a7376f0dd289294a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:22.788234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-11fc5740-caaf-42c3-9258-de47616dbbbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:22.788888 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-11fc5740-caaf-42c3-9258-de47616dbbbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:22.790463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1415/2832] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:22 2022] DELETE /identity/v3/projects/133c3a117e724a71a7376f0dd289294a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:22.796594 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cb570-9f06-4fe4-838e-8c33b8d3da5d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:22.797105 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cb570-9f06-4fe4-838e-8c33b8d3da5d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:22.797293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cb570-9f06-4fe4-838e-8c33b8d3da5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:22.816671 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-534cb570-9f06-4fe4-838e-8c33b8d3da5d None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:22.817898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-534cb570-9f06-4fe4-838e-8c33b8d3da5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:22.883989 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1418/2833] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:22.892729 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300699c-684d-4676-98a0-c892190c089e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:22.893157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300699c-684d-4676-98a0-c892190c089e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:22.893545 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300699c-684d-4676-98a0-c892190c089e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:22.914600 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c300699c-684d-4676-98a0-c892190c089e None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:22.916484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c300699c-684d-4676-98a0-c892190c089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:22.928567 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1416/2834] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:22.930473 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cb570-9f06-4fe4-838e-8c33b8d3da5d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:22.941823 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cb570-9f06-4fe4-838e-8c33b8d3da5d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:22.946850 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754584d1-60c1-44cc-9cb0-7c1e96ad166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:22.947575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754584d1-60c1-44cc-9cb0-7c1e96ad166d admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:22.947794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754584d1-60c1-44cc-9cb0-7c1e96ad166d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:22.948062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754584d1-60c1-44cc-9cb0-7c1e96ad166d admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:22.948798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754584d1-60c1-44cc-9cb0-7c1e96ad166d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:16:22.949249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754584d1-60c1-44cc-9cb0-7c1e96ad166d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:22.950852 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754584d1-60c1-44cc-9cb0-7c1e96ad166d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:22.967911 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1419/2835] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:16:22.969354 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300699c-684d-4676-98a0-c892190c089e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:22.979004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300699c-684d-4676-98a0-c892190c089e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:22.984205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742c143-8b0a-470b-b75c-12412a2d2a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:22.984982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742c143-8b0a-470b-b75c-12412a2d2a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:22.986029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742c143-8b0a-470b-b75c-12412a2d2a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:22.986029 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742c143-8b0a-470b-b75c-12412a2d2a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:22.986819 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742c143-8b0a-470b-b75c-12412a2d2a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:22.988574 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742c143-8b0a-470b-b75c-12412a2d2a9b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:23.025063 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1417/2836] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:16:22 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:23.026189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754584d1-60c1-44cc-9cb0-7c1e96ad166d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:23.037873 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754584d1-60c1-44cc-9cb0-7c1e96ad166d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:23.099174 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ea82-78aa-4a7a-8b23-370a728b3bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:23.099857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ea82-78aa-4a7a-8b23-370a728b3bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:23.100144 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ea82-78aa-4a7a-8b23-370a728b3bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:23.100422 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ea82-78aa-4a7a-8b23-370a728b3bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:23.101228 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49ea82-78aa-4a7a-8b23-370a728b3bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:23.103468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49ea82-78aa-4a7a-8b23-370a728b3bd9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:23.125117 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1420/2837] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:16:23 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:16:23.128840 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742c143-8b0a-470b-b75c-12412a2d2a9b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:23.139555 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742c143-8b0a-470b-b75c-12412a2d2a9b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:23.144835 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c882d1-f618-4dc7-847e-69be7a3c6c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:23.145514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c882d1-f618-4dc7-847e-69be7a3c6c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:23.145801 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c882d1-f618-4dc7-847e-69be7a3c6c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:23.146077 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c882d1-f618-4dc7-847e-69be7a3c6c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:23.146854 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c882d1-f618-4dc7-847e-69be7a3c6c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:23.148523 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c882d1-f618-4dc7-847e-69be7a3c6c81 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:23.163185 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1418/2838] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:16:23.164935 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ea82-78aa-4a7a-8b23-370a728b3bd9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:23.180022 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ea82-78aa-4a7a-8b23-370a728b3bd9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:23.184857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda03bd0-5314-4ab1-966c-162b9990031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:23.186187 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda03bd0-5314-4ab1-966c-162b9990031d admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:23.186562 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda03bd0-5314-4ab1-966c-162b9990031d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:23.186846 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda03bd0-5314-4ab1-966c-162b9990031d admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:23.187582 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda03bd0-5314-4ab1-966c-162b9990031d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:23.189185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda03bd0-5314-4ab1-966c-162b9990031d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:23.202028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1421/2839] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:16:23.206586 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c882d1-f618-4dc7-847e-69be7a3c6c81 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:23.217797 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c882d1-f618-4dc7-847e-69be7a3c6c81 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:23.223130 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7488f4f-42e7-47e4-acf2-54964903ef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:23.224136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488f4f-42e7-47e4-acf2-54964903ef4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:23.224602 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488f4f-42e7-47e4-acf2-54964903ef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:23.224973 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488f4f-42e7-47e4-acf2-54964903ef4b admin admin] PATH_INFO: `/v3/projects/ea099e2a2c24498e969ecad02580ef28/users/453e85d01c414364b13cecf3b4f7a4f6/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:23.240966 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7488f4f-42e7-47e4-acf2-54964903ef4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea099e2a2c24498e969ecad02580ef28, user_id=453e85d01c414364b13cecf3b4f7a4f6, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:23.243670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7488f4f-42e7-47e4-acf2-54964903ef4b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:23.246081 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:23.259743 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1419/2840] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:16:23 2022] PUT /identity/v3/projects/ea099e2a2c24498e969ecad02580ef28/users/453e85d01c414364b13cecf3b4f7a4f6/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:23.325038 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec633703-c75a-424a-a998-628c05554714 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:23.325329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec633703-c75a-424a-a998-628c05554714 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:23.325604 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec633703-c75a-424a-a998-628c05554714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:23.345386 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:23.356050 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ec633703-c75a-424a-a998-628c05554714 None None] MFA Rules not processed for user `453e85d01c414364b13cecf3b4f7a4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:23.357403 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ec633703-c75a-424a-a998-628c05554714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:23.422134 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1422/2841] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:23.432636 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7488f4f-42e7-47e4-acf2-54964903ef4b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:23.434301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b7488f4f-42e7-47e4-acf2-54964903ef4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:23.495580 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7488f4f-42e7-47e4-acf2-54964903ef4b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:23.499338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6806d86-658c-4675-8645-ad74a44f89a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91dcf97796941718e251912271aea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:23.499995 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6806d86-658c-4675-8645-ad74a44f89a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:23.500280 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6806d86-658c-4675-8645-ad74a44f89a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:23.500558 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6806d86-658c-4675-8645-ad74a44f89a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:23.509443 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6806d86-658c-4675-8645-ad74a44f89a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:23.510899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6806d86-658c-4675-8645-ad74a44f89a0 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:23.520223 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1420/2842] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:33.419235 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=28 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:33.494569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec633703-c75a-424a-a998-628c05554714 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:33.516200 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:33.559214 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec633703-c75a-424a-a998-628c05554714 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:33.564262 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:33.565164 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:33.565448 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:33.565726 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] PATH_INFO: `/v3/users/453e85d01c414364b13cecf3b4f7a4f6` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:33.566929 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453e85d01c414364b13cecf3b4f7a4f6)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:33.568844 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:33.618024 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453e85d01c414364b13cecf3b4f7a4f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:33.618959 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453e85d01c414364b13cecf3b4f7a4f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:33.628818 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453e85d01c414364b13cecf3b4f7a4f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:33.635352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453e85d01c414364b13cecf3b4f7a4f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:33.636002 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453e85d01c414364b13cecf3b4f7a4f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:33.654735 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1423/2843] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:16:33 2022] DELETE /identity/v3/users/453e85d01c414364b13cecf3b4f7a4f6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:33.659590 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21148ed0-54a8-4fa3-9f77-355e07839846 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:33.659881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21148ed0-54a8-4fa3-9f77-355e07839846 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:33.660157 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21148ed0-54a8-4fa3-9f77-355e07839846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:33.677141 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-21148ed0-54a8-4fa3-9f77-355e07839846 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:33.678270 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-21148ed0-54a8-4fa3-9f77-355e07839846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:33.745620 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1421/2844] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:33.755928 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:33.757998 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:33.823915 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e43413-560b-49c4-b29a-6510560a2036 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:33.828714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013eca1-d28d-4dbc-84ab-e29e46a39a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:33.829650 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013eca1-d28d-4dbc-84ab-e29e46a39a28 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:33.829938 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013eca1-d28d-4dbc-84ab-e29e46a39a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:33.830251 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013eca1-d28d-4dbc-84ab-e29e46a39a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:33.839949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013eca1-d28d-4dbc-84ab-e29e46a39a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:33.841364 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013eca1-d28d-4dbc-84ab-e29e46a39a28 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:33.851249 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1424/2845] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:34.129229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21148ed0-54a8-4fa3-9f77-355e07839846 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:34.131565 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-21148ed0-54a8-4fa3-9f77-355e07839846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:34.144179 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21148ed0-54a8-4fa3-9f77-355e07839846 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:34.149668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:34.151281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:34.151281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:34.151281 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] PATH_INFO: `/v3/projects/ea099e2a2c24498e969ecad02580ef28` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:34.152501 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea099e2a2c24498e969ecad02580ef28)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:34.154441 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:34.204512 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea099e2a2c24498e969ecad02580ef28', 'request_id': 'req-eff8ad7c-a967-4fb7-8878-fd70138594c0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:34.210262 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea099e2a2c24498e969ecad02580ef28', 'request_id': 'req-eff8ad7c-a967-4fb7-8878-fd70138594c0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:34.216802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea099e2a2c24498e969ecad02580ef28', 'request_id': 'req-eff8ad7c-a967-4fb7-8878-fd70138594c0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:34.229884 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] The token cache is being invalidate because project ea099e2a2c24498e969ecad02580ef28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:16:34.230172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:34.230831 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:16:34.232369 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1422/2846] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:16:34 2022] DELETE /identity/v3/projects/ea099e2a2c24498e969ecad02580ef28 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:16:43.846909 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:44.227301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:47.259723 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3f5e-677a-420d-950f-917ee2f33d38 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:47.260262 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3f5e-677a-420d-950f-917ee2f33d38 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:47.260262 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3f5e-677a-420d-950f-917ee2f33d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:47.277907 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ac3c3f5e-677a-420d-950f-917ee2f33d38 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:47.279143 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ac3c3f5e-677a-420d-950f-917ee2f33d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:47.337229 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1425/2847] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 23 17:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:47.359460 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:47.361509 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:47.433582 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8ad7c-a967-4fb7-8878-fd70138594c0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:47.439059 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac3e2c-8c25-460a-9d33-10343dc9087b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:47.439702 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3e2c-8c25-460a-9d33-10343dc9087b service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:47.439989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3e2c-8c25-460a-9d33-10343dc9087b service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:47.440266 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3e2c-8c25-460a-9d33-10343dc9087b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:47.448372 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac3e2c-8c25-460a-9d33-10343dc9087b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:47.449944 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac3e2c-8c25-460a-9d33-10343dc9087b service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:47.460068 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1423/2848] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:50.340772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bd76f-ad49-415a-b713-05875b9f63ab None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:50.341329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bd76f-ad49-415a-b713-05875b9f63ab None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:50.341329 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bd76f-ad49-415a-b713-05875b9f63ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:50.361754 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e61bd76f-ad49-415a-b713-05875b9f63ab None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:50.363015 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e61bd76f-ad49-415a-b713-05875b9f63ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:50.370692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1426/2849] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 23 17:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:50.390894 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac3e2c-8c25-460a-9d33-10343dc9087b service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:50.393137 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-95ac3e2c-8c25-460a-9d33-10343dc9087b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:50.408813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac3e2c-8c25-460a-9d33-10343dc9087b service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:50.414241 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bb843-7944-460c-975c-2f6ac391292a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:50.414912 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bb843-7944-460c-975c-2f6ac391292a service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:50.415197 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bb843-7944-460c-975c-2f6ac391292a service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:50.415466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bb843-7944-460c-975c-2f6ac391292a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:50.423891 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bb843-7944-460c-975c-2f6ac391292a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:50.425457 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bb843-7944-460c-975c-2f6ac391292a service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:50.434802 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1424/2850] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:53.546079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24defcc-5b12-4993-9761-ac7e7ce63902 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:53.546646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24defcc-5b12-4993-9761-ac7e7ce63902 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:53.546646 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24defcc-5b12-4993-9761-ac7e7ce63902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:53.564819 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c24defcc-5b12-4993-9761-ac7e7ce63902 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:53.566025 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c24defcc-5b12-4993-9761-ac7e7ce63902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:53.573750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1427/2851] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 23 17:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:53.592587 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bb843-7944-460c-975c-2f6ac391292a service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:53.604608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bb843-7944-460c-975c-2f6ac391292a service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:53.610136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1725f-681f-4885-a453-ddb433877742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:53.610813 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1725f-681f-4885-a453-ddb433877742 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:53.611103 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1725f-681f-4885-a453-ddb433877742 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:53.611380 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1725f-681f-4885-a453-ddb433877742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:53.619732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1725f-681f-4885-a453-ddb433877742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:53.621298 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1725f-681f-4885-a453-ddb433877742 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:53.630928 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1425/2852] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:56.618178 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be6903-4172-40e5-924e-eacd43bb38ca None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:56.619114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be6903-4172-40e5-924e-eacd43bb38ca None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:56.619114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be6903-4172-40e5-924e-eacd43bb38ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:56.637239 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-17be6903-4172-40e5-924e-eacd43bb38ca None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:56.638457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-17be6903-4172-40e5-924e-eacd43bb38ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:56.646831 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1428/2853] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 23 17:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:56.667439 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1725f-681f-4885-a453-ddb433877742 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:56.679423 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1725f-681f-4885-a453-ddb433877742 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:56.684765 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0aaa43-9433-4e21-8666-12bed5724d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:56.685393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aaa43-9433-4e21-8666-12bed5724d48 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:56.685677 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aaa43-9433-4e21-8666-12bed5724d48 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:56.685970 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aaa43-9433-4e21-8666-12bed5724d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:56.695058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0aaa43-9433-4e21-8666-12bed5724d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:56.696613 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0aaa43-9433-4e21-8666-12bed5724d48 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:56.706674 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1426/2854] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:59.778011 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b4893-8359-49bd-b4fc-085171820116 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:59.778550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b4893-8359-49bd-b4fc-085171820116 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:59.778666 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b4893-8359-49bd-b4fc-085171820116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:59.797037 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d09b4893-8359-49bd-b4fc-085171820116 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:59.798502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d09b4893-8359-49bd-b4fc-085171820116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:59.806200 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1429/2855] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 23 17:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:59.829673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0aaa43-9433-4e21-8666-12bed5724d48 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:59.840670 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0aaa43-9433-4e21-8666-12bed5724d48 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:59.846225 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce8956-d4d3-4ea4-8009-69ab4ab2066d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:59.846883 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce8956-d4d3-4ea4-8009-69ab4ab2066d service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:59.847171 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce8956-d4d3-4ea4-8009-69ab4ab2066d service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:59.847450 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce8956-d4d3-4ea4-8009-69ab4ab2066d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:59.855809 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce8956-d4d3-4ea4-8009-69ab4ab2066d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:59.857375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce8956-d4d3-4ea4-8009-69ab4ab2066d service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:59.868007 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1427/2856] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:02.938769 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91f65e-a25c-4064-a1e7-2bc1dc0d08ad None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:02.939299 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91f65e-a25c-4064-a1e7-2bc1dc0d08ad None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:02.939434 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91f65e-a25c-4064-a1e7-2bc1dc0d08ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:02.960356 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3c91f65e-a25c-4064-a1e7-2bc1dc0d08ad None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:02.961745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3c91f65e-a25c-4064-a1e7-2bc1dc0d08ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:02.971429 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1430/2857] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 23 17:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:02.996547 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce8956-d4d3-4ea4-8009-69ab4ab2066d service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:03.008290 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce8956-d4d3-4ea4-8009-69ab4ab2066d service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:03.013759 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7e870-20be-4289-806c-bf99b762a857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:03.014428 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7e870-20be-4289-806c-bf99b762a857 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:03.014714 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7e870-20be-4289-806c-bf99b762a857 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:03.014989 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7e870-20be-4289-806c-bf99b762a857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:03.024777 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7e870-20be-4289-806c-bf99b762a857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:03.026463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7e870-20be-4289-806c-bf99b762a857 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:03.037009 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1428/2858] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:12.758806 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91f65e-a25c-4064-a1e7-2bc1dc0d08ad None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:12.760232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3c91f65e-a25c-4064-a1e7-2bc1dc0d08ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:12.830625 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91f65e-a25c-4064-a1e7-2bc1dc0d08ad None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:12.835629 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d52d89-55b1-480d-965a-f1c4539513ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81fb8b261e2142fcbf8d23bd010bf715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:12.836276 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d52d89-55b1-480d-965a-f1c4539513ce service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:12.836565 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d52d89-55b1-480d-965a-f1c4539513ce service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:12.836846 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d52d89-55b1-480d-965a-f1c4539513ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:12.838630 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-50d52d89-55b1-480d-965a-f1c4539513ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:12.850518 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d52d89-55b1-480d-965a-f1c4539513ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:12.852079 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d52d89-55b1-480d-965a-f1c4539513ce service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:12.862563 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1431/2859] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:17:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:13.032322 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=64 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:18.008256 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69504ec6-0d73-4475-bd38-aa3a2d265150 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:18.008853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69504ec6-0d73-4475-bd38-aa3a2d265150 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:18.008853 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69504ec6-0d73-4475-bd38-aa3a2d265150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:18.026666 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-69504ec6-0d73-4475-bd38-aa3a2d265150 None None] MFA Rules not processed for user `686fad92c5034b3ebfd0dbbd4564c566`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:18.027861 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-69504ec6-0d73-4475-bd38-aa3a2d265150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:18.082267 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1429/2860] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:22.857683 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=74 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:28.075311 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=25 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:33.914134 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39be29-b9a9-47d8-8356-6acc03b24b20 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:33.914639 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39be29-b9a9-47d8-8356-6acc03b24b20 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:33.914751 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39be29-b9a9-47d8-8356-6acc03b24b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:33.932999 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-fe39be29-b9a9-47d8-8356-6acc03b24b20 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:33.934202 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fe39be29-b9a9-47d8-8356-6acc03b24b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:33.942772 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1432/2861] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 23 17:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:33.961362 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69504ec6-0d73-4475-bd38-aa3a2d265150 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:33.974325 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69504ec6-0d73-4475-bd38-aa3a2d265150 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:33.979751 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34aa8c-24cc-46e8-b0d2-6acbbad42aad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:33.980376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34aa8c-24cc-46e8-b0d2-6acbbad42aad service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:33.980658 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34aa8c-24cc-46e8-b0d2-6acbbad42aad service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:33.980931 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34aa8c-24cc-46e8-b0d2-6acbbad42aad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:33.989842 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34aa8c-24cc-46e8-b0d2-6acbbad42aad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:33.991810 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34aa8c-24cc-46e8-b0d2-6acbbad42aad service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:34.001229 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1430/2862] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:37.162991 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9234a39-b27d-4420-a40d-bea01f8afea2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.163602 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9234a39-b27d-4420-a40d-bea01f8afea2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.163717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9234a39-b27d-4420-a40d-bea01f8afea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:37.182165 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d9234a39-b27d-4420-a40d-bea01f8afea2 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:37.183407 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d9234a39-b27d-4420-a40d-bea01f8afea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:37.191252 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1433/2863] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 23 17:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:37.224781 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34aa8c-24cc-46e8-b0d2-6acbbad42aad service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:37.235828 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34aa8c-24cc-46e8-b0d2-6acbbad42aad service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:37.242614 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bb9a4-6a3f-4f13-ba87-415ab424b288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:37.243244 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bb9a4-6a3f-4f13-ba87-415ab424b288 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.243525 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bb9a4-6a3f-4f13-ba87-415ab424b288 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.243800 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bb9a4-6a3f-4f13-ba87-415ab424b288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:37.252047 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bb9a4-6a3f-4f13-ba87-415ab424b288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:37.253768 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bb9a4-6a3f-4f13-ba87-415ab424b288 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:37.263310 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1431/2864] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:40.238546 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13086e5-bdf3-4a32-a680-f9a47ccb5263 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.239060 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13086e5-bdf3-4a32-a680-f9a47ccb5263 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.239167 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13086e5-bdf3-4a32-a680-f9a47ccb5263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.257624 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b13086e5-bdf3-4a32-a680-f9a47ccb5263 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:40.258883 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b13086e5-bdf3-4a32-a680-f9a47ccb5263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:40.266806 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1434/2865] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 23 17:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:40.287466 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bb9a4-6a3f-4f13-ba87-415ab424b288 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.298846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bb9a4-6a3f-4f13-ba87-415ab424b288 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.304435 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fe000-0c2f-49f3-9645-a304c578fcf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.305067 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fe000-0c2f-49f3-9645-a304c578fcf5 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.305355 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fe000-0c2f-49f3-9645-a304c578fcf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.305641 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fe000-0c2f-49f3-9645-a304c578fcf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.313728 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fe000-0c2f-49f3-9645-a304c578fcf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.315332 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fe000-0c2f-49f3-9645-a304c578fcf5 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.325277 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1432/2866] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:43.390016 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71351e04-882a-4a80-bc04-684362c61284 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:43.390542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71351e04-882a-4a80-bc04-684362c61284 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:43.390542 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71351e04-882a-4a80-bc04-684362c61284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:43.408150 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-71351e04-882a-4a80-bc04-684362c61284 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:43.409878 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-71351e04-882a-4a80-bc04-684362c61284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:43.417794 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1435/2867] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 23 17:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:43.440261 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fe000-0c2f-49f3-9645-a304c578fcf5 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:43.451480 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fe000-0c2f-49f3-9645-a304c578fcf5 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:43.457172 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30339d55-bdb7-4314-96e7-035eacdcf5fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:43.457807 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30339d55-bdb7-4314-96e7-035eacdcf5fe service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:43.458097 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30339d55-bdb7-4314-96e7-035eacdcf5fe service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:43.458406 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30339d55-bdb7-4314-96e7-035eacdcf5fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:43.466422 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30339d55-bdb7-4314-96e7-035eacdcf5fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:43.467998 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30339d55-bdb7-4314-96e7-035eacdcf5fe service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:43.478057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1433/2868] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:46.544408 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f37197-c0b9-487a-85d5-c3590608ce61 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:46.544918 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f37197-c0b9-487a-85d5-c3590608ce61 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:46.545028 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f37197-c0b9-487a-85d5-c3590608ce61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:46.563368 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-25f37197-c0b9-487a-85d5-c3590608ce61 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:46.564565 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-25f37197-c0b9-487a-85d5-c3590608ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:46.575197 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1436/2869] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 23 17:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:46.596848 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30339d55-bdb7-4314-96e7-035eacdcf5fe service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:46.608411 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30339d55-bdb7-4314-96e7-035eacdcf5fe service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:46.614514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f554fe9-30aa-4c8a-8d31-46630720544b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:46.615148 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f554fe9-30aa-4c8a-8d31-46630720544b service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:46.615440 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f554fe9-30aa-4c8a-8d31-46630720544b service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:46.615721 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f554fe9-30aa-4c8a-8d31-46630720544b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:46.624476 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f554fe9-30aa-4c8a-8d31-46630720544b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:46.626253 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f554fe9-30aa-4c8a-8d31-46630720544b service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:46.636373 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1434/2870] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:56.558283 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=15 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:56.632145 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=30 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:14.265451 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f37197-c0b9-487a-85d5-c3590608ce61 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:14.266965 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-25f37197-c0b9-487a-85d5-c3590608ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:14.280264 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f37197-c0b9-487a-85d5-c3590608ce61 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:14.284857 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86c933-9b5e-417e-ac0d-6d7c192259c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:14.285779 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86c933-9b5e-417e-ac0d-6d7c192259c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.286064 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86c933-9b5e-417e-ac0d-6d7c192259c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.286342 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86c933-9b5e-417e-ac0d-6d7c192259c9 admin admin] PATH_INFO: `/v3/users/686fad92c5034b3ebfd0dbbd4564c566` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.287550 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86c933-9b5e-417e-ac0d-6d7c192259c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=686fad92c5034b3ebfd0dbbd4564c566)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:14.289487 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86c933-9b5e-417e-ac0d-6d7c192259c9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:14.336520 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9c86c933-9b5e-417e-ac0d-6d7c192259c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686fad92c5034b3ebfd0dbbd4564c566'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:14.337189 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9c86c933-9b5e-417e-ac0d-6d7c192259c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686fad92c5034b3ebfd0dbbd4564c566'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:14.343898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9c86c933-9b5e-417e-ac0d-6d7c192259c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686fad92c5034b3ebfd0dbbd4564c566'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:14.350932 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9c86c933-9b5e-417e-ac0d-6d7c192259c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686fad92c5034b3ebfd0dbbd4564c566'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:14.351541 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9c86c933-9b5e-417e-ac0d-6d7c192259c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686fad92c5034b3ebfd0dbbd4564c566'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:14.369370 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1437/2871] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:18:14 2022] DELETE /identity/v3/users/686fad92c5034b3ebfd0dbbd4564c566 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:14.539684 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f554fe9-30aa-4c8a-8d31-46630720544b service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:14.549391 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f554fe9-30aa-4c8a-8d31-46630720544b service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:14.606510 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e34bb-1125-4122-9cce-d9d18de61295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:14.607374 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e34bb-1125-4122-9cce-d9d18de61295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.607661 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e34bb-1125-4122-9cce-d9d18de61295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.607938 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e34bb-1125-4122-9cce-d9d18de61295 admin admin] PATH_INFO: `/v3/projects/d1ae354fc66740b6acbcf1a6d97cf02a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.609114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e34bb-1125-4122-9cce-d9d18de61295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ae354fc66740b6acbcf1a6d97cf02a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:14.611060 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e34bb-1125-4122-9cce-d9d18de61295 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:14.659985 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f9e34bb-1125-4122-9cce-d9d18de61295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ae354fc66740b6acbcf1a6d97cf02a', 'request_id': 'req-2f9e34bb-1125-4122-9cce-d9d18de61295'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:14.667609 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f9e34bb-1125-4122-9cce-d9d18de61295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ae354fc66740b6acbcf1a6d97cf02a', 'request_id': 'req-2f9e34bb-1125-4122-9cce-d9d18de61295'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:14.673908 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f9e34bb-1125-4122-9cce-d9d18de61295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ae354fc66740b6acbcf1a6d97cf02a', 'request_id': 'req-2f9e34bb-1125-4122-9cce-d9d18de61295'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:14.687123 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f9e34bb-1125-4122-9cce-d9d18de61295 admin admin] The token cache is being invalidate because project d1ae354fc66740b6acbcf1a6d97cf02a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:14.687410 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f9e34bb-1125-4122-9cce-d9d18de61295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:14.688026 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f9e34bb-1125-4122-9cce-d9d18de61295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:14.689572 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1435/2872] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:18:14 2022] DELETE /identity/v3/projects/d1ae354fc66740b6acbcf1a6d97cf02a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:14.695088 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3b719-3978-49c9-a03a-ee492428c465 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.695381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3b719-3978-49c9-a03a-ee492428c465 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.695662 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3b719-3978-49c9-a03a-ee492428c465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.714995 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c8c3b719-3978-49c9-a03a-ee492428c465 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:14.716250 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c8c3b719-3978-49c9-a03a-ee492428c465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:14.773245 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1438/2873] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:14.833469 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081df56-e60d-4174-8359-45bb14a4b528 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.833760 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081df56-e60d-4174-8359-45bb14a4b528 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.834043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081df56-e60d-4174-8359-45bb14a4b528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.852868 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d081df56-e60d-4174-8359-45bb14a4b528 None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:14.854073 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d081df56-e60d-4174-8359-45bb14a4b528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:14.862125 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1436/2874] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:14.867232 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3b719-3978-49c9-a03a-ee492428c465 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:14.877458 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3b719-3978-49c9-a03a-ee492428c465 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:14.882495 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e217b3-a5b2-4184-a28f-8efc8e8f8888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:14.883173 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e217b3-a5b2-4184-a28f-8efc8e8f8888 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.883456 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e217b3-a5b2-4184-a28f-8efc8e8f8888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.883727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e217b3-a5b2-4184-a28f-8efc8e8f8888 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.884441 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e217b3-a5b2-4184-a28f-8efc8e8f8888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:14.884745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e217b3-a5b2-4184-a28f-8efc8e8f8888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:14.886335 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e217b3-a5b2-4184-a28f-8efc8e8f8888 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:14.898115 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1439/2875] 10.222.0.49 () {58 vars in 1152 bytes} [Mon May 23 17:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:14.902589 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081df56-e60d-4174-8359-45bb14a4b528 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:14.912529 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081df56-e60d-4174-8359-45bb14a4b528 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:14.917194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84bc9-a961-4ac4-b5b5-0f658c4dbaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:14.917839 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84bc9-a961-4ac4-b5b5-0f658c4dbaed admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.918130 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84bc9-a961-4ac4-b5b5-0f658c4dbaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.918463 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84bc9-a961-4ac4-b5b5-0f658c4dbaed admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.919136 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e84bc9-a961-4ac4-b5b5-0f658c4dbaed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:14.921033 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e84bc9-a961-4ac4-b5b5-0f658c4dbaed admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:14.948523 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1437/2876] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:18:14 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:14.952001 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e217b3-a5b2-4184-a28f-8efc8e8f8888 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:14.962455 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e217b3-a5b2-4184-a28f-8efc8e8f8888 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:15.030710 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1eba7-4f89-4c00-9b6c-3bef910c8c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:15.031383 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1eba7-4f89-4c00-9b6c-3bef910c8c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:15.031668 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1eba7-4f89-4c00-9b6c-3bef910c8c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:15.031944 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1eba7-4f89-4c00-9b6c-3bef910c8c04 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:15.032623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1eba7-4f89-4c00-9b6c-3bef910c8c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:15.034731 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1eba7-4f89-4c00-9b6c-3bef910c8c04 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:15.042061 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:15.057051 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1440/2877] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:18:14 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:15.061086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84bc9-a961-4ac4-b5b5-0f658c4dbaed admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:15.072881 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84bc9-a961-4ac4-b5b5-0f658c4dbaed admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:15.079324 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5e8c-1dd6-4d52-a375-e715f10e94c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:15.080375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5e8c-1dd6-4d52-a375-e715f10e94c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:15.080662 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5e8c-1dd6-4d52-a375-e715f10e94c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:15.080935 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5e8c-1dd6-4d52-a375-e715f10e94c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:15.081664 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5e8c-1dd6-4d52-a375-e715f10e94c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:15.083790 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5e8c-1dd6-4d52-a375-e715f10e94c6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:15.099000 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1438/2878] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:15.104374 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1eba7-4f89-4c00-9b6c-3bef910c8c04 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:15.115488 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1eba7-4f89-4c00-9b6c-3bef910c8c04 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:15.121371 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cd783-ab5f-462b-84c3-cb20a7b97ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:15.122054 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cd783-ab5f-462b-84c3-cb20a7b97ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:15.122336 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cd783-ab5f-462b-84c3-cb20a7b97ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:15.122645 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cd783-ab5f-462b-84c3-cb20a7b97ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:15.123375 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cd783-ab5f-462b-84c3-cb20a7b97ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:15.124955 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cd783-ab5f-462b-84c3-cb20a7b97ecc admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:15.137939 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1441/2879] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:15.142301 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5e8c-1dd6-4d52-a375-e715f10e94c6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:15.153213 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5e8c-1dd6-4d52-a375-e715f10e94c6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:15.158154 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523324e-46e7-4997-9837-2c99c1e9537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:15.159386 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523324e-46e7-4997-9837-2c99c1e9537c admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:15.159667 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523324e-46e7-4997-9837-2c99c1e9537c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:15.159943 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523324e-46e7-4997-9837-2c99c1e9537c admin admin] PATH_INFO: `/v3/projects/daad3b417b88410291a452d82308fd9c/users/e2ce1a67e8d24550a669d96e22a4481e/roles/3027d01b9e8b469784a8db0de5f043bd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:15.176482 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523324e-46e7-4997-9837-2c99c1e9537c admin admin] RBAC: Authorizing `identity:create_grant(project_id=daad3b417b88410291a452d82308fd9c, user_id=e2ce1a67e8d24550a669d96e22a4481e, role_id=3027d01b9e8b469784a8db0de5f043bd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:15.179167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523324e-46e7-4997-9837-2c99c1e9537c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:15.192931 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1439/2880] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:18:15 2022] PUT /identity/v3/projects/daad3b417b88410291a452d82308fd9c/users/e2ce1a67e8d24550a669d96e22a4481e/roles/3027d01b9e8b469784a8db0de5f043bd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:15.198124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602105b2-641a-41c4-8158-47d1fcb653db None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:15.198449 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602105b2-641a-41c4-8158-47d1fcb653db None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:15.198841 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602105b2-641a-41c4-8158-47d1fcb653db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:15.219185 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-602105b2-641a-41c4-8158-47d1fcb653db None None] MFA Rules not processed for user `c22f03b3c05b411a8e1b74bbae3a8adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:15.220398 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-602105b2-641a-41c4-8158-47d1fcb653db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:15.289616 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1442/2881] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:15.300845 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523324e-46e7-4997-9837-2c99c1e9537c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:15.302763 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6523324e-46e7-4997-9837-2c99c1e9537c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:15.335830 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:15.365535 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523324e-46e7-4997-9837-2c99c1e9537c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:15.369383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78746-04c9-4caf-bbf6-bf125ae7ccd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:15.370041 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78746-04c9-4caf-bbf6-bf125ae7ccd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:15.370327 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78746-04c9-4caf-bbf6-bf125ae7ccd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:15.370643 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78746-04c9-4caf-bbf6-bf125ae7ccd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:15.381376 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d78746-04c9-4caf-bbf6-bf125ae7ccd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:15.382875 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d78746-04c9-4caf-bbf6-bf125ae7ccd3 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:15.392945 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1440/2882] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:19.391670 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c6773-bb26-4d78-b8ca-f16a470e15b0 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.392243 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c6773-bb26-4d78-b8ca-f16a470e15b0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.392243 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c6773-bb26-4d78-b8ca-f16a470e15b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.423457 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-da0c6773-bb26-4d78-b8ca-f16a470e15b0 None None] MFA Rules not processed for user `e2ce1a67e8d24550a669d96e22a4481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:19.429655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-da0c6773-bb26-4d78-b8ca-f16a470e15b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:19.498003 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1443/2883] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:18:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:19.502608 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78746-04c9-4caf-bbf6-bf125ae7ccd3 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:19.513168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78746-04c9-4caf-bbf6-bf125ae7ccd3 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:19.517850 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cc549-ed0d-43b8-84f3-3fff7f55134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:19.518630 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cc549-ed0d-43b8-84f3-3fff7f55134f admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.518923 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cc549-ed0d-43b8-84f3-3fff7f55134f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.519205 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cc549-ed0d-43b8-84f3-3fff7f55134f admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.519969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cc549-ed0d-43b8-84f3-3fff7f55134f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:19.522110 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cc549-ed0d-43b8-84f3-3fff7f55134f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:19.569811 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1441/2884] 10.222.0.49 () {60 vars in 1152 bytes} [Mon May 23 17:18:19 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:19.574114 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c6773-bb26-4d78-b8ca-f16a470e15b0 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:19.588034 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c6773-bb26-4d78-b8ca-f16a470e15b0 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:19.653990 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645603a-aa11-466e-b270-f2f35a930b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:19.654612 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645603a-aa11-466e-b270-f2f35a930b79 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.654900 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645603a-aa11-466e-b270-f2f35a930b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.655176 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645603a-aa11-466e-b270-f2f35a930b79 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.655865 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645603a-aa11-466e-b270-f2f35a930b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:19.657810 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645603a-aa11-466e-b270-f2f35a930b79 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:19.672901 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:19.684192 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1444/2885] 10.222.0.49 () {60 vars in 1143 bytes} [Mon May 23 17:18:19 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:19.685401 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cc549-ed0d-43b8-84f3-3fff7f55134f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:19.696545 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cc549-ed0d-43b8-84f3-3fff7f55134f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:19.701452 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27d234-f6b3-49b5-b424-a58dd037d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:19.702130 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27d234-f6b3-49b5-b424-a58dd037d31f admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.702505 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27d234-f6b3-49b5-b424-a58dd037d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.702788 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27d234-f6b3-49b5-b424-a58dd037d31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.703554 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27d234-f6b3-49b5-b424-a58dd037d31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:19.705892 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27d234-f6b3-49b5-b424-a58dd037d31f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:19.718614 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1442/2886] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:19.722860 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645603a-aa11-466e-b270-f2f35a930b79 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:19.734124 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645603a-aa11-466e-b270-f2f35a930b79 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:19.739171 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdbe3c-faea-437f-95b6-cff44bdd6cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:19.740307 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdbe3c-faea-437f-95b6-cff44bdd6cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.740616 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdbe3c-faea-437f-95b6-cff44bdd6cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.740890 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdbe3c-faea-437f-95b6-cff44bdd6cc1 admin admin] PATH_INFO: `/v3/projects/995d1f6367c54eaebbd39e9ff774b3e3/users/57292a0684344715898b27c067a786e6/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.757043 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdbe3c-faea-437f-95b6-cff44bdd6cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=995d1f6367c54eaebbd39e9ff774b3e3, user_id=57292a0684344715898b27c067a786e6, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:19.759745 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdbe3c-faea-437f-95b6-cff44bdd6cc1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:19.774677 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1445/2887] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:18:19 2022] PUT /identity/v3/projects/995d1f6367c54eaebbd39e9ff774b3e3/users/57292a0684344715898b27c067a786e6/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:19.779349 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27d234-f6b3-49b5-b424-a58dd037d31f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:19.792425 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27d234-f6b3-49b5-b424-a58dd037d31f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:19.853718 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a7b22-7241-44b2-819f-535a19dfc61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:19.854430 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a7b22-7241-44b2-819f-535a19dfc61a admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.854720 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a7b22-7241-44b2-819f-535a19dfc61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.854999 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a7b22-7241-44b2-819f-535a19dfc61a admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.855732 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a7b22-7241-44b2-819f-535a19dfc61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:19.857338 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a7b22-7241-44b2-819f-535a19dfc61a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:19.867869 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1443/2888] 10.222.0.49 () {58 vars in 1121 bytes} [Mon May 23 17:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:19.872766 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdbe3c-faea-437f-95b6-cff44bdd6cc1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:19.884640 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdbe3c-faea-437f-95b6-cff44bdd6cc1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:19.889559 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b827a-6f63-458c-94ac-99589211decf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:19.890570 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b827a-6f63-458c-94ac-99589211decf admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.890925 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b827a-6f63-458c-94ac-99589211decf admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.891266 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b827a-6f63-458c-94ac-99589211decf admin admin] PATH_INFO: `/v3/projects/995d1f6367c54eaebbd39e9ff774b3e3/users/57292a0684344715898b27c067a786e6/roles/1782947fb0ed4dffa8eb78e32146991d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.893362 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b827a-6f63-458c-94ac-99589211decf admin admin] RBAC: Authorizing `identity:create_grant(project_id=995d1f6367c54eaebbd39e9ff774b3e3, user_id=57292a0684344715898b27c067a786e6, role_id=1782947fb0ed4dffa8eb78e32146991d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:19.897000 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b827a-6f63-458c-94ac-99589211decf admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:19.912655 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1446/2889] 10.222.0.49 () {60 vars in 1482 bytes} [Mon May 23 17:18:19 2022] PUT /identity/v3/projects/995d1f6367c54eaebbd39e9ff774b3e3/users/57292a0684344715898b27c067a786e6/roles/1782947fb0ed4dffa8eb78e32146991d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:24.452514 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1e524-7d9d-4db2-81b1-efc6715e5c64 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.452969 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1e524-7d9d-4db2-81b1-efc6715e5c64 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.453053 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1e524-7d9d-4db2-81b1-efc6715e5c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.486750 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-19b1e524-7d9d-4db2-81b1-efc6715e5c64 None None] MFA Rules not processed for user `57292a0684344715898b27c067a786e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:24.489124 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-19b1e524-7d9d-4db2-81b1-efc6715e5c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:24.559152 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1444/2890] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:18:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:24.575072 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b827a-6f63-458c-94ac-99589211decf admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:24.577516 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1d4b827a-6f63-458c-94ac-99589211decf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:24.657898 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b827a-6f63-458c-94ac-99589211decf admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:24.663845 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26144e45-4095-46a2-88bd-cae4baef9060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:24.664499 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26144e45-4095-46a2-88bd-cae4baef9060 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.664785 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26144e45-4095-46a2-88bd-cae4baef9060 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.665062 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26144e45-4095-46a2-88bd-cae4baef9060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.725513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26144e45-4095-46a2-88bd-cae4baef9060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:24.728055 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26144e45-4095-46a2-88bd-cae4baef9060 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:24.739719 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1447/2891] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:18:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:18:25.765275 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08491e1-9e26-41b1-afdc-71dee6873bcd None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:25.765769 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08491e1-9e26-41b1-afdc-71dee6873bcd None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:25.765890 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08491e1-9e26-41b1-afdc-71dee6873bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:25.785948 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e08491e1-9e26-41b1-afdc-71dee6873bcd None None] MFA Rules not processed for user `e2ce1a67e8d24550a669d96e22a4481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:25.787086 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e08491e1-9e26-41b1-afdc-71dee6873bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:25.794130 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1445/2892] 10.222.0.49 () {58 vars in 957 bytes} [Mon May 23 17:18:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:34.734623 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:35.779094 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:54.663400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26144e45-4095-46a2-88bd-cae4baef9060 service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:54.719528 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26144e45-4095-46a2-88bd-cae4baef9060 service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:54.723073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65356b-1022-46a6-9276-0709841a44c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:54.724008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65356b-1022-46a6-9276-0709841a44c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.724293 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65356b-1022-46a6-9276-0709841a44c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.724566 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65356b-1022-46a6-9276-0709841a44c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.733855 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65356b-1022-46a6-9276-0709841a44c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:54.735316 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65356b-1022-46a6-9276-0709841a44c3 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:54.745414 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1448/2893] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:18:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:56.304496 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08491e1-9e26-41b1-afdc-71dee6873bcd None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:56.305953 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e08491e1-9e26-41b1-afdc-71dee6873bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:56.321882 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08491e1-9e26-41b1-afdc-71dee6873bcd None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:56.327507 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c55905-1665-4f30-9b04-ca30718f2652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:56.328150 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55905-1665-4f30-9b04-ca30718f2652 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:56.328433 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55905-1665-4f30-9b04-ca30718f2652 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:56.328707 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55905-1665-4f30-9b04-ca30718f2652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:56.330484 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-84c55905-1665-4f30-9b04-ca30718f2652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:56.342983 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c55905-1665-4f30-9b04-ca30718f2652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:56.344603 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c55905-1665-4f30-9b04-ca30718f2652 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:56.356057 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1446/2894] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:18:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:04.741260 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=26 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:06.351353 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=6 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:12.569798 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65356b-1022-46a6-9276-0709841a44c3 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:12.571327 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7c65356b-1022-46a6-9276-0709841a44c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:12.582693 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65356b-1022-46a6-9276-0709841a44c3 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:12.586513 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a05b6-b12c-4c81-aec6-3f07f57a446a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:12.587152 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a05b6-b12c-4c81-aec6-3f07f57a446a service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:12.587438 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a05b6-b12c-4c81-aec6-3f07f57a446a service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:12.587717 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a05b6-b12c-4c81-aec6-3f07f57a446a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:12.589412 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6d6a05b6-b12c-4c81-aec6-3f07f57a446a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:12.598867 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a05b6-b12c-4c81-aec6-3f07f57a446a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:12.600269 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a05b6-b12c-4c81-aec6-3f07f57a446a service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:12.608204 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1449/2895] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:20:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:22.604618 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=6 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:52.179058 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c55905-1665-4f30-9b04-ca30718f2652 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:52.198780 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c55905-1665-4f30-9b04-ca30718f2652 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:52.202234 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c88a31-2b90-4463-9042-1f3946489771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:52.202896 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c88a31-2b90-4463-9042-1f3946489771 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:52.203180 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c88a31-2b90-4463-9042-1f3946489771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:52.203455 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c88a31-2b90-4463-9042-1f3946489771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:52.205210 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-31c88a31-2b90-4463-9042-1f3946489771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:52.258207 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c88a31-2b90-4463-9042-1f3946489771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:52.259673 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c88a31-2b90-4463-9042-1f3946489771 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:52.270594 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1447/2896] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:20:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:53.450471 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a05b6-b12c-4c81-aec6-3f07f57a446a service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:53.487352 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a05b6-b12c-4c81-aec6-3f07f57a446a service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:53.491468 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29fffd-6ba9-4ad4-a5c2-73934359f6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:53.492146 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29fffd-6ba9-4ad4-a5c2-73934359f6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:53.492431 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29fffd-6ba9-4ad4-a5c2-73934359f6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:53.492727 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29fffd-6ba9-4ad4-a5c2-73934359f6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:53.494508 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9a29fffd-6ba9-4ad4-a5c2-73934359f6b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:53.508215 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29fffd-6ba9-4ad4-a5c2-73934359f6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:53.509613 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29fffd-6ba9-4ad4-a5c2-73934359f6b9 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:53.520321 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1450/2897] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:20:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:21:02.265688 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=28 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:03.515536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=18 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:05.720046 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c88a31-2b90-4463-9042-1f3946489771 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:21:05.738657 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c88a31-2b90-4463-9042-1f3946489771 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:21:05.742487 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d9b1f-3417-4d1f-96c5-87a98485c3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:21:05.743140 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9b1f-3417-4d1f-96c5-87a98485c3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:05.743975 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9b1f-3417-4d1f-96c5-87a98485c3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:05.744388 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9b1f-3417-4d1f-96c5-87a98485c3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:05.746245 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-516d9b1f-3417-4d1f-96c5-87a98485c3b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:05.770767 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d9b1f-3417-4d1f-96c5-87a98485c3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:21:05.772231 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d9b1f-3417-4d1f-96c5-87a98485c3b3 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:21:05.782494 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1448/2898] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:21:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:21:05.861949 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29fffd-6ba9-4ad4-a5c2-73934359f6b9 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:21:05.871381 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29fffd-6ba9-4ad4-a5c2-73934359f6b9 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:21:05.875027 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fce56f-a67e-492f-92af-bf8fa7d8c6c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73bdfedb6d9e4ddab18a8143ba7142fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:21:05.875661 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fce56f-a67e-492f-92af-bf8fa7d8c6c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:05.875942 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fce56f-a67e-492f-92af-bf8fa7d8c6c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:05.876218 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fce56f-a67e-492f-92af-bf8fa7d8c6c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:05.877978 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-97fce56f-a67e-492f-92af-bf8fa7d8c6c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:05.891183 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fce56f-a67e-492f-92af-bf8fa7d8c6c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:21:05.892578 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fce56f-a67e-492f-92af-bf8fa7d8c6c8 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:21:05.903230 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1451/2899] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:21:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:21:05.963623 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d9b1f-3417-4d1f-96c5-87a98485c3b3 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:21:05.965017 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-516d9b1f-3417-4d1f-96c5-87a98485c3b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:06.033979 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d9b1f-3417-4d1f-96c5-87a98485c3b3 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:21:06.038987 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b06af-df9e-4638-a558-a66a86b506de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81fb8b261e2142fcbf8d23bd010bf715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:21:06.039634 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b06af-df9e-4638-a558-a66a86b506de service placement] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:06.039917 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b06af-df9e-4638-a558-a66a86b506de service placement] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:06.040190 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b06af-df9e-4638-a558-a66a86b506de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:06.042959 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f36b06af-df9e-4638-a558-a66a86b506de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:06.054475 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b06af-df9e-4638-a558-a66a86b506de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:21:06.056746 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b06af-df9e-4638-a558-a66a86b506de service placement] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:21:06.066792 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1449/2900] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:21:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:21:09.142882 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fce56f-a67e-492f-92af-bf8fa7d8c6c8 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:21:09.156925 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fce56f-a67e-492f-92af-bf8fa7d8c6c8 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:21:09.162914 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50030c-730d-496f-aab2-095baf6871cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:21:09.163569 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50030c-730d-496f-aab2-095baf6871cf service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:09.163858 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50030c-730d-496f-aab2-095baf6871cf service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:09.164141 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50030c-730d-496f-aab2-095baf6871cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:09.165931 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1f50030c-730d-496f-aab2-095baf6871cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:09.178586 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50030c-730d-496f-aab2-095baf6871cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:21:09.180334 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50030c-730d-496f-aab2-095baf6871cf service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:21:09.191924 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1452/2901] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:21:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:21:16.062615 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=47 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:19.187308 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=12 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:25.673899 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b06af-df9e-4638-a558-a66a86b506de service placement] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:22:25.703976 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b06af-df9e-4638-a558-a66a86b506de service placement] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:22:25.709846 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ba8a5-4512-4cb9-9ff5-662dfd4d9f1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9884780c88aa48ffa92a696740761387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:22:25.710530 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ba8a5-4512-4cb9-9ff5-662dfd4d9f1c service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:25.710823 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ba8a5-4512-4cb9-9ff5-662dfd4d9f1c service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:25.711108 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ba8a5-4512-4cb9-9ff5-662dfd4d9f1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:25.712889 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0f0ba8a5-4512-4cb9-9ff5-662dfd4d9f1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:25.738583 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ba8a5-4512-4cb9-9ff5-662dfd4d9f1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:22:25.740168 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ba8a5-4512-4cb9-9ff5-662dfd4d9f1c service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:22:25.752194 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1450/2902] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:22:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:22:26.022324 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50030c-730d-496f-aab2-095baf6871cf service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:22:26.048676 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50030c-730d-496f-aab2-095baf6871cf service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:22:26.055649 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f431a-cb04-4f4b-9020-b1db8c33c2cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81fb8b261e2142fcbf8d23bd010bf715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:22:26.056750 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f431a-cb04-4f4b-9020-b1db8c33c2cf service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:26.057132 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f431a-cb04-4f4b-9020-b1db8c33c2cf service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:26.058660 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f431a-cb04-4f4b-9020-b1db8c33c2cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:26.072131 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3a7f431a-cb04-4f4b-9020-b1db8c33c2cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:26.101581 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f431a-cb04-4f4b-9020-b1db8c33c2cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:22:26.103206 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f431a-cb04-4f4b-9020-b1db8c33c2cf service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:22:26.114896 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1453/2903] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:22:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:22:30.307465 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ba8a5-4512-4cb9-9ff5-662dfd4d9f1c service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:22:30.310852 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0f0ba8a5-4512-4cb9-9ff5-662dfd4d9f1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:30.339647 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ba8a5-4512-4cb9-9ff5-662dfd4d9f1c service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:22:30.347929 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a42454-d8d6-4b84-b32d-304d2bdc169f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81fb8b261e2142fcbf8d23bd010bf715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733d8651e4a74a2ab694091d9fd83e49', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:22:30.348727 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a42454-d8d6-4b84-b32d-304d2bdc169f service placement] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:30.349090 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a42454-d8d6-4b84-b32d-304d2bdc169f service placement] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:30.349445 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a42454-d8d6-4b84-b32d-304d2bdc169f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:30.351383 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-61a42454-d8d6-4b84-b32d-304d2bdc169f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:30.366445 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a42454-d8d6-4b84-b32d-304d2bdc169f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:22:30.368307 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a42454-d8d6-4b84-b32d-304d2bdc169f service placement] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:22:30.381668 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1451/2904] 10.222.0.49 () {60 vars in 1365 bytes} [Mon May 23 17:22:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:22:33.428714 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f431a-cb04-4f4b-9020-b1db8c33c2cf service placement] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:22:33.518696 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f431a-cb04-4f4b-9020-b1db8c33c2cf service placement] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:22:33.523535 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:22:33.524413 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:33.524701 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:33.525008 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] PATH_INFO: `/v3/users/e2ce1a67e8d24550a669d96e22a4481e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:33.526247 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ce1a67e8d24550a669d96e22a4481e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:22:33.528583 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:22:33.574842 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ce1a67e8d24550a669d96e22a4481e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:33.575501 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ce1a67e8d24550a669d96e22a4481e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:33.582272 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ce1a67e8d24550a669d96e22a4481e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:33.589994 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ce1a67e8d24550a669d96e22a4481e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:33.590656 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ce1a67e8d24550a669d96e22a4481e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:33.607459 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1454/2905] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:22:33 2022] DELETE /identity/v3/users/e2ce1a67e8d24550a669d96e22a4481e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:22:33.784195 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a42454-d8d6-4b84-b32d-304d2bdc169f service placement] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:22:33.796493 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a42454-d8d6-4b84-b32d-304d2bdc169f service placement] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:22:33.855114 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:22:33.855994 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:33.856283 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:33.856561 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] PATH_INFO: `/v3/projects/daad3b417b88410291a452d82308fd9c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:33.857828 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] RBAC: Authorizing `identity:delete_project(project_id=daad3b417b88410291a452d82308fd9c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:22:33.859864 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:22:33.906043 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daad3b417b88410291a452d82308fd9c', 'request_id': 'req-a973742f-f62b-4960-ad4b-b5f35c31616f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:33.911393 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daad3b417b88410291a452d82308fd9c', 'request_id': 'req-a973742f-f62b-4960-ad4b-b5f35c31616f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:33.917982 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daad3b417b88410291a452d82308fd9c', 'request_id': 'req-a973742f-f62b-4960-ad4b-b5f35c31616f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:33.944075 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] The token cache is being invalidate because project daad3b417b88410291a452d82308fd9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:22:33.944365 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:33.944990 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:33.946546 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1452/2906] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:22:33 2022] DELETE /identity/v3/projects/daad3b417b88410291a452d82308fd9c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:22:33.950575 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:22:33.951976 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:33.965502 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d872c7-1a4e-456c-b89f-e1552ece2acb admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:22:33.991400 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:34.024076 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2622b6b-77d1-48da-afe0-dfbeab0eade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:22:34.024956 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622b6b-77d1-48da-afe0-dfbeab0eade5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:34.025244 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622b6b-77d1-48da-afe0-dfbeab0eade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:34.025524 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622b6b-77d1-48da-afe0-dfbeab0eade5 admin admin] PATH_INFO: `/v3/users/57292a0684344715898b27c067a786e6` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:34.026834 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2622b6b-77d1-48da-afe0-dfbeab0eade5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57292a0684344715898b27c067a786e6)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:22:34.029105 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2622b6b-77d1-48da-afe0-dfbeab0eade5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:22:34.083073 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f2622b6b-77d1-48da-afe0-dfbeab0eade5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57292a0684344715898b27c067a786e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:34.084004 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f2622b6b-77d1-48da-afe0-dfbeab0eade5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57292a0684344715898b27c067a786e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:34.091574 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f2622b6b-77d1-48da-afe0-dfbeab0eade5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57292a0684344715898b27c067a786e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:34.099066 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f2622b6b-77d1-48da-afe0-dfbeab0eade5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57292a0684344715898b27c067a786e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:34.099692 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f2622b6b-77d1-48da-afe0-dfbeab0eade5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57292a0684344715898b27c067a786e6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:34.118536 dv-cinder-842998-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1455/2907] 10.222.0.49 () {58 vars in 1223 bytes} [Mon May 23 17:22:33 2022] DELETE /identity/v3/users/57292a0684344715898b27c067a786e6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:22:34.291004 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:22:34.293412 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:34.306350 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973742f-f62b-4960-ad4b-b5f35c31616f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:22:34.330916 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:34.365502 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a304d75-52a7-4aed-8a08-db788c757c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22f03b3c05b411a8e1b74bbae3a8adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e61a710b27f4ea29e3f6c7963fdf0c4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:22:34.366375 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a304d75-52a7-4aed-8a08-db788c757c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:34.366671 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a304d75-52a7-4aed-8a08-db788c757c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:34.366946 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a304d75-52a7-4aed-8a08-db788c757c1a admin admin] PATH_INFO: `/v3/projects/995d1f6367c54eaebbd39e9ff774b3e3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:34.368102 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a304d75-52a7-4aed-8a08-db788c757c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=995d1f6367c54eaebbd39e9ff774b3e3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:22:34.370092 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a304d75-52a7-4aed-8a08-db788c757c1a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:22:34.421781 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1a304d75-52a7-4aed-8a08-db788c757c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995d1f6367c54eaebbd39e9ff774b3e3', 'request_id': 'req-1a304d75-52a7-4aed-8a08-db788c757c1a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:34.427167 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1a304d75-52a7-4aed-8a08-db788c757c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995d1f6367c54eaebbd39e9ff774b3e3', 'request_id': 'req-1a304d75-52a7-4aed-8a08-db788c757c1a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:34.433329 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1a304d75-52a7-4aed-8a08-db788c757c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995d1f6367c54eaebbd39e9ff774b3e3', 'request_id': 'req-1a304d75-52a7-4aed-8a08-db788c757c1a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:34.447622 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1a304d75-52a7-4aed-8a08-db788c757c1a admin admin] The token cache is being invalidate because project 995d1f6367c54eaebbd39e9ff774b3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:22:34.447913 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1a304d75-52a7-4aed-8a08-db788c757c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:34.448642 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1a304d75-52a7-4aed-8a08-db788c757c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:34.450345 dv-cinder-842998-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1453/2908] 10.222.0.49 () {58 vars in 1232 bytes} [Mon May 23 17:22:34 2022] DELETE /identity/v3/projects/995d1f6367c54eaebbd39e9ff774b3e3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:22:44.114797 dv-cinder-842998-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=40,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:44.444400 dv-cinder-842998-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=39,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}